02:02:41.368 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
02:02:41.368 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskz_z_wR/test-tmp
02:02:41.368 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/asan/bin
02:02:41.368 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskz_z_wR/java/build/dist-test/../../../build/asan/bin/kudu, test, mini_cluster, --serialization=pb]
02:02:41.372 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
num_masters: 1
num_tservers: 0
enable_kerberos: true
cluster_root: "/tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349"
extra_master_flags: "--webserver_require_spnego=false"
extra_master_flags: "--enable-jwt-token-auth"
extra_master_flags: "--rpc-trace-negotiation"
extra_master_flags: "--enable-jwt-token-auth"
extra_master_flags: "--rpc-trace-negotiation"
extra_master_flags: "--rpc-authentication=optional"
extra_master_flags: "--rpc-trace-negotiation"
extra_master_flags: "--user-acl=*"
extra_master_flags: "--enable-jwt-token-auth"
extra_master_flags: "--rpc-authentication=required"
extra_master_flags: "--rpc-negotiation-timeout-ms=1500"
extra_master_flags: "--rpc-trace-negotiation"
extra_master_flags: "--enable-jwt-token-auth"
extra_master_flags: "--rpc-negotiation-timeout-ms=1500"
extra_master_flags: "--rpc-trace-negotiation"
extra_tserver_flags: "--webserver_require_spnego=false"
hms_mode: NONE
mini_kdc_options {
}
principal: "kudu"
mini_oidc_options {
}
}
02:02:41.729 [DEBUG - main] (MiniKuduCluster.java:195) Response:
02:02:41.730 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}
02:02:41.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:41.732631 12800 mini_oidc.cc:150] Starting JWKS server
02:02:41.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:41.735042 12800 webserver.cc:492] Webserver started at http://127.0.0.1:38773/ using document root <none> and password file <none>
02:02:41.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:41.735339 12800 mini_oidc.cc:186] Starting OIDC Discovery server
02:02:41.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:41.736083 12800 webserver.cc:492] Webserver started at http://127.0.0.1:41065/ using document root <none> and password file <none>
02:02:41.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Loading random data
02:02:41.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Initializing database '/tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/krb5kdc/principal' for realm 'KRBTEST.COM',
02:02:41.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master key name 'K/M@KRBTEST.COM'
02:02:41.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 05 02:02:41 dist-test-slave-xt3m krb5kdc[12810](info): setting up network...
02:02:41.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
02:02:41.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 05 02:02:41 dist-test-slave-xt3m krb5kdc[12810](info): set up 2 sockets
02:02:41.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 05 02:02:41 dist-test-slave-xt3m krb5kdc[12810](info): commencing operation
02:02:41.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) krb5kdc: starting...
02:02:42.098 [DEBUG - pool-18-thread-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=1, TimeoutTracker(timeout=1000, elapsed=1021), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.94.126:40887, [10ms] Sub RPC ConnectToMaster: received response from server master-127.12.94.126:40887: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, deferred=null) with no deferred attached!
02:02:43.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260505 02:02:43.929011 12800 mini_kdc.cc:121] Time spent starting KDC: real 2.185s user 0.008s sys 0.008s
02:02:43.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
02:02:44.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
02:02:44.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "test-admin@KRBTEST.COM" created.
02:02:44.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260505 02:02:44.135785 12800 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.207s user 0.001s sys 0.003s
02:02:44.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
02:02:44.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
02:02:44.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "test-user@KRBTEST.COM" created.
02:02:44.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260505 02:02:44.449548 12800 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.314s user 0.000s sys 0.004s
02:02:44.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
02:02:44.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
02:02:44.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "joe-interloper@KRBTEST.COM" created.
02:02:44.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260505 02:02:44.775272 12800 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.326s user 0.000s sys 0.004s
02:02:45.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
02:02:45.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/krb5kdc/test-user.keytab.
02:02:45.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/krb5kdc/test-user.keytab.
02:02:45.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260505 02:02:45.647919 12800 mini_kdc.cc:290] Time spent creating keytab for test-user: real 0.872s user 0.000s sys 0.004s
02:02:45.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 05 02:02:45 dist-test-slave-xt3m krb5kdc[12810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1777946565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
02:02:45.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Password for test-admin@KRBTEST.COM:
02:02:45.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-05T02:02:45Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
02:02:45.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-05T02:02:45Z Disabled control of system clock
02:02:45.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.12.128.62@KRBTEST.COM; defaulting to no policy
02:02:45.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:02:45.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.12.128.62@KRBTEST.COM" created.
02:02:47.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:02:47.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.12.128.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/krb5kdc/kudu.keytab.
02:02:47.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.12.128.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/krb5kdc/kudu.keytab.
02:02:47.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260505 02:02:47.024489 12800 mini_kdc.cc:268] Time spent creating service keytab for kudu/127.12.128.62: real 1.325s user 0.000s sys 0.009s
02:02:47.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.12.128.62@KRBTEST.COM; defaulting to no policy
02:02:47.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:02:47.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.12.128.62@KRBTEST.COM" created.
02:02:47.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:02:47.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.12.128.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/krb5kdc/kudu.keytab.
02:02:47.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.12.128.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/krb5kdc/kudu.keytab.
02:02:47.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260505 02:02:47.243031 12800 mini_kdc.cc:268] Time spent creating service keytab for HTTP/127.12.128.62: real 0.218s user 0.000s sys 0.009s
02:02:47.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.244748 12800 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskz_z_wR/build/asan/bin/kudu
02:02:47.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskz_z_wR/build/asan/bin/kudu
02:02:47.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/master-0/wal
02:02:47.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/master-0/data
02:02:47.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:02:47.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:02:47.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:02:47.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:02:47.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:02:47.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:02:47.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/master-0/logs
02:02:47.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/master-0/data/info.pb
02:02:47.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:02:47.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:02:47.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:02:47.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:02:47.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:02:47.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:02:47.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:02:47.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:02:47.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:02:47.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:02:47.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:02:47.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:02:47.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.128.62:39839
02:02:47.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.128.62
02:02:47.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:02:47.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/krb5kdc/kudu.keytab
02:02:47.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.12.128.62
02:02:47.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
02:02:47.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
02:02:47.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
02:02:47.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
02:02:47.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.128.20:34821
02:02:47.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:02:47.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:02:47.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:02:47.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:02:47.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.12.128.62:39839
02:02:47.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:02:47.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38773/jwks.json
02:02:47.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false
02:02:47.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable-jwt-token-auth
02:02:47.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc-trace-negotiation
02:02:47.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable-jwt-token-auth
02:02:47.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc-trace-negotiation
02:02:47.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc-authentication=optional
02:02:47.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc-trace-negotiation
02:02:47.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user-acl=*
02:02:47.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable-jwt-token-auth
02:02:47.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc-authentication=required
02:02:47.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc-negotiation-timeout-ms=1500
02:02:47.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc-trace-negotiation
02:02:47.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable-jwt-token-auth
02:02:47.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc-negotiation-timeout-ms=1500
02:02:47.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc-trace-negotiation with env {KRB5CCNAME=/tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
02:02:47.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260505 02:02:47.601413 12826 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:02:47.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260505 02:02:47.601830 12826 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:02:47.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260505 02:02:47.601996 12826 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:02:47.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260505 02:02:47.611338 12826 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:02:47.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260505 02:02:47.611538 12826 flags.cc:432] Enabled experimental flag: --rpc_trace_negotiation=true
02:02:47.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260505 02:02:47.611629 12826 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:02:47.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260505 02:02:47.611688 12826 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:02:47.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260505 02:02:47.611760 12826 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:02:47.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260505 02:02:47.611824 12826 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:02:47.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260505 02:02:47.611892 12826 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38773/jwks.json
02:02:47.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.623561 12826 master_runner.cc:386] Master server non-default flags:
02:02:47.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:02:47.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.128.20:34821
02:02:47.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:02:47.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:02:47.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/master-0/data
02:02:47.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/master-0/wal
02:02:47.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:02:47.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.12.128.62:39839
02:02:47.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_trace_negotiation=true
02:02:47.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/krb5kdc/kudu.keytab
02:02:47.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.12.128.62
02:02:47.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:02:47.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:02:47.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:02:47.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.128.62:39839
02:02:47.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:02:47.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:02:47.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:02:47.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38773/jwks.json
02:02:47.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
02:02:47.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_negotiation_timeout_ms=1500
02:02:47.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
02:02:47.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:02:47.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:02:47.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/master-0/data/info.pb
02:02:47.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.128.62
02:02:47.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:02:47.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:02:47.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:02:47.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:02:47.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:02:47.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:02:47.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/master-0/logs
02:02:47.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:02:47.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:02:47.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)
02:02:47.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:02:47.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:02:47.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 0ba7f54e15c9f673bf3e350f30b8d5f1a4037b79
02:02:47.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:02:47.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 05 May 2026 01:43:34 UTC on bdcb31816ec0
02:02:47.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11750
02:02:47.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
02:02:47.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.625830 12826 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:02:47.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.627301 12826 file_cache.cc:492] Constructed file cache file cache with capacity 419430
02:02:47.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260505 02:02:47.637449 12832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:02:47.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260505 02:02:47.637557 12831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:02:47.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260505 02:02:47.637831 12834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:02:47.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.638355 12826 server_base.cc:1061] running on GCE node
02:02:47.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.639200 12826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:02:47.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.641063 12826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:02:47.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.642459 12826 hybrid_clock.cc:648] HybridClock initialized: now 1777946567642377 us; error 58 us; skew 500 ppm
02:02:47.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.642978 12826 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:02:47.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 05 02:02:47 dist-test-slave-xt3m krb5kdc[12810](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1777946567, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.128.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
02:02:47.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.646540 12826 init.cc:377] Logged in from keytab as kudu/127.12.128.62@KRBTEST.COM (short username kudu)
02:02:47.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.648319 12826 webserver.cc:492] Webserver started at http://127.12.128.62:34009/ using document root <none> and password file <none>
02:02:47.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.649191 12826 fs_manager.cc:362] Metadata directory not provided
02:02:47.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.649336 12826 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:02:47.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.649748 12826 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:02:47.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.652333 12826 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/master-0/data/instance:
02:02:47.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e08ecef25c604013ab7393911d8b8e11"
02:02:47.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-05 02:02:47 on dist-test-slave-xt3m"
02:02:47.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.653227 12826 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/master-0/wal/instance:
02:02:47.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e08ecef25c604013ab7393911d8b8e11"
02:02:47.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-05 02:02:47 on dist-test-slave-xt3m"
02:02:47.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.659973 12826 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.005s sys 0.003s
02:02:47.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.664348 12841 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
02:02:47.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.666147 12826 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
02:02:47.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.666365 12826 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/master-0/data,/tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/master-0/wal
02:02:47.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e08ecef25c604013ab7393911d8b8e11"
02:02:47.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-05 02:02:47 on dist-test-slave-xt3m"
02:02:47.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.666638 12826 fs_report.cc:389] FS layout report
02:02:47.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:02:47.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/master-0/wal
02:02:47.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/master-0/wal
02:02:47.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/master-0/data/data
02:02:47.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:02:47.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:02:47.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:02:47.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:02:47.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:02:47.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:02:47.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:02:47.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:02:47.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:02:47.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:02:47.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:02:47.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.703747 12826 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
02:02:47.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.712658 12826 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:02:47.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.713007 12826 kserver.cc:163] Server-wide thread pool size limit: 3276
02:02:47.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.737017 12826 rpc_server.cc:307] RPC server started. Bound to: 127.12.128.62:39839
02:02:47.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.737053 12892 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.128.62:39839 every 8 connection(s)
02:02:47.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.740025 12826 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/master-0/data/info.pb
02:02:47.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.745823 12800 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskz_z_wR/build/asan/bin/kudu as pid 12826
02:02:47.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.746184 12800 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/master-0/wal/instance
02:02:47.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.746412 12893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:02:47.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.759337 12893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e08ecef25c604013ab7393911d8b8e11: Bootstrap starting.
02:02:47.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.764360 12893 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e08ecef25c604013ab7393911d8b8e11: Neither blocks nor log segments found. Creating new log.
02:02:47.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.765914 12893 log.cc:826] T 00000000000000000000000000000000 P e08ecef25c604013ab7393911d8b8e11: Log is configured to *not* fsync() on all Append() calls
02:02:47.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 05 02:02:47 dist-test-slave-xt3m krb5kdc[12810](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1777946565, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.128.62@KRBTEST.COM
02:02:47.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.770932 12893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e08ecef25c604013ab7393911d8b8e11: No bootstrap required, opened a new log
02:02:47.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.779779 12893 raft_consensus.cc:359] T 00000000000000000000000000000000 P e08ecef25c604013ab7393911d8b8e11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e08ecef25c604013ab7393911d8b8e11" member_type: VOTER last_known_addr { host: "127.12.128.62" port: 39839 } }
02:02:47.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.780239 12893 raft_consensus.cc:385] T 00000000000000000000000000000000 P e08ecef25c604013ab7393911d8b8e11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:02:47.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.780344 12893 raft_consensus.cc:740] T 00000000000000000000000000000000 P e08ecef25c604013ab7393911d8b8e11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e08ecef25c604013ab7393911d8b8e11, State: Initialized, Role: FOLLOWER
02:02:47.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.781069 12893 consensus_queue.cc:260] T 00000000000000000000000000000000 P e08ecef25c604013ab7393911d8b8e11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e08ecef25c604013ab7393911d8b8e11" member_type: VOTER last_known_addr { host: "127.12.128.62" port: 39839 } }
02:02:47.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.781345 12893 raft_consensus.cc:399] T 00000000000000000000000000000000 P e08ecef25c604013ab7393911d8b8e11 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
02:02:47.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.781502 12893 raft_consensus.cc:493] T 00000000000000000000000000000000 P e08ecef25c604013ab7393911d8b8e11 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
02:02:47.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.781769 12893 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e08ecef25c604013ab7393911d8b8e11 [term 0 FOLLOWER]: Advancing to term 1
02:02:47.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.783115 12896 negotiation.cc:338] RPC negotiation tracing enabled. Trace:
02:02:47.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.750930 (+ 0us) reactor.cc:678] Submitting negotiation task for server connection from 127.0.0.1:44846 (local address 127.12.128.62:39839)
02:02:47.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.753881 (+ 2951us) server_negotiation.cc:207] Beginning negotiation
02:02:47.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.753897 (+ 16us) server_negotiation.cc:400] Waiting for connection header
02:02:47.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.754003 (+ 106us) server_negotiation.cc:408] Connection header received
02:02:47.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.757061 (+ 3058us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
02:02:47.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.757084 (+ 23us) server_negotiation.cc:462] Received NEGOTIATE request from client
02:02:47.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.757554 (+ 470us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
02:02:47.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.758085 (+ 531us) server_negotiation.cc:227] Negotiated authn=SASL
02:02:47.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.761259 (+ 3174us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
02:02:47.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.763294 (+ 2035us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
02:02:47.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.764781 (+ 1487us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
02:02:47.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.765616 (+ 835us) server_negotiation.cc:658] Negotiated auth-only TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
02:02:47.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.772827 (+ 7211us) server_negotiation.cc:366] Received SASL_INITIATE NegotiatePB request
02:02:47.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.772912 (+ 85us) server_negotiation.cc:882] Received SASL_INITIATE request from client
02:02:47.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.772936 (+ 24us) server_negotiation.cc:893] Client requested to use mechanism: GSSAPI
02:02:47.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.773002 (+ 66us) server_negotiation.cc:923] calling sasl_server_start()
02:02:47.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.777041 (+ 4039us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
02:02:47.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.778072 (+ 1031us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
02:02:47.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.778092 (+ 20us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
02:02:47.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.778099 (+ 7us) server_negotiation.cc:968] calling sasl_server_step()
02:02:47.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.778279 (+ 180us) server_negotiation.cc:378] Sending SASL_CHALLENGE NegotiatePB response
02:02:47.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.779049 (+ 770us) server_negotiation.cc:366] Received SASL_RESPONSE NegotiatePB request
02:02:47.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.779055 (+ 6us) server_negotiation.cc:957] Received SASL_RESPONSE request from client
02:02:47.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.779059 (+ 4us) server_negotiation.cc:968] calling sasl_server_step()
02:02:47.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.779746 (+ 687us) server_negotiation.cc:378] Sending SASL_SUCCESS NegotiatePB response
02:02:47.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.780117 (+ 371us) server_negotiation.cc:1036] Waiting for connection context
02:02:47.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.781233 (+ 1116us) server_negotiation.cc:300] Negotiation successful
02:02:47.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.781671 (+ 438us) negotiation.cc:326] Negotiation complete: OK
02:02:47.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":2734,"thread_start_us":2456,"threads_started":1}
02:02:47.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.784775 12893 raft_consensus.cc:515] T 00000000000000000000000000000000 P e08ecef25c604013ab7393911d8b8e11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e08ecef25c604013ab7393911d8b8e11" member_type: VOTER last_known_addr { host: "127.12.128.62" port: 39839 } }
02:02:47.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.785429 12893 leader_election.cc:304] T 00000000000000000000000000000000 P e08ecef25c604013ab7393911d8b8e11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e08ecef25c604013ab7393911d8b8e11; no voters:
02:02:47.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.786286 12893 leader_election.cc:290] T 00000000000000000000000000000000 P e08ecef25c604013ab7393911d8b8e11 [CANDIDATE]: Term 1 election: Requested vote from peers
02:02:47.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.786402 12898 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e08ecef25c604013ab7393911d8b8e11 [term 1 FOLLOWER]: Leader election won for term 1
02:02:47.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.786964 12898 raft_consensus.cc:697] T 00000000000000000000000000000000 P e08ecef25c604013ab7393911d8b8e11 [term 1 LEADER]: Becoming Leader. State: Replica: e08ecef25c604013ab7393911d8b8e11, State: Running, Role: LEADER
02:02:47.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.787856 12898 consensus_queue.cc:237] T 00000000000000000000000000000000 P e08ecef25c604013ab7393911d8b8e11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e08ecef25c604013ab7393911d8b8e11" member_type: VOTER last_known_addr { host: "127.12.128.62" port: 39839 } }
02:02:47.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.788136 12800 external_mini_cluster.cc:949] 0 TS(s) registered with all masters
02:02:47.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.789839 12893 sys_catalog.cc:565] T 00000000000000000000000000000000 P e08ecef25c604013ab7393911d8b8e11 [sys.catalog]: configured and running, proceeding with master startup.
02:02:47.790 [DEBUG - main] (MiniKuduCluster.java:195) Response:
02:02:47.790 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_kdc_env_vars {
}
02:02:47.791 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_kdc_env_vars {
env_vars {
key: "KRB5CCNAME"
value: "/tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/krb5kdc/krb5cc"
}
env_vars {
key: "KRB5_CONFIG"
value: "/tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/krb5kdc/krb5.conf"
}
env_vars {
key: "KRB5_KDC_PROFILE"
value: "/tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/krb5kdc/kdc.conf"
}
env_vars {
key: "KUDU_ENABLE_KRB5_REALM_FIX"
value: "yes"
}
}
02:02:47.792 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}
02:02:47.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.791934 12899 sys_catalog.cc:455] T 00000000000000000000000000000000 P e08ecef25c604013ab7393911d8b8e11 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e08ecef25c604013ab7393911d8b8e11. Latest consensus state: current_term: 1 leader_uuid: "e08ecef25c604013ab7393911d8b8e11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e08ecef25c604013ab7393911d8b8e11" member_type: VOTER last_known_addr { host: "127.12.128.62" port: 39839 } } }
02:02:47.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.792353 12899 sys_catalog.cc:458] T 00000000000000000000000000000000 P e08ecef25c604013ab7393911d8b8e11 [sys.catalog]: This master's current role is: LEADER
02:02:47.793 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
masters {
id {
type: MASTER
index: 0
}
bound_rpc_address {
host: "127.12.128.62"
port: 39839
}
bound_http_address {
host: "127.12.128.62"
port: 34009
}
}
}
02:02:47.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.793080 12900 sys_catalog.cc:455] T 00000000000000000000000000000000 P e08ecef25c604013ab7393911d8b8e11 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e08ecef25c604013ab7393911d8b8e11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e08ecef25c604013ab7393911d8b8e11" member_type: VOTER last_known_addr { host: "127.12.128.62" port: 39839 } } }
02:02:47.793 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}
02:02:47.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.793355 12900 sys_catalog.cc:458] T 00000000000000000000000000000000 P e08ecef25c604013ab7393911d8b8e11 [sys.catalog]: This master's current role is: LEADER
02:02:47.794 [DEBUG - main] (MiniKuduCluster.java:195) Response:
02:02:47.794 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
02:02:47.796 [DEBUG - main] (SecurityUtil.java:105) Using ticketCache: /tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/krb5kdc/krb5cc
02:02:47.798 [DEBUG - main] (SecurityUtil.java:119) Logged in as subject: test-admin@KRBTEST.COM
02:02:47.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.800809 12903 catalog_manager.cc:1485] Loading table and tablet metadata into memory...
02:02:47.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.807255 12903 catalog_manager.cc:1494] Initializing Kudu cluster ID...
02:02:47.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.818281 12903 catalog_manager.cc:1357] Generated new cluster ID: 42f91e0aec1b42ccb55a37d7c5e498a4
02:02:47.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.818444 12903 catalog_manager.cc:1505] Initializing Kudu internal certificate authority...
02:02:47.818 [DEBUG - main] (SecurityUtil.java:105) Using ticketCache: /tmp/dist-test-taskz_z_wR/test-tmp/mini-kudu-cluster17752899550196385349/krb5kdc/krb5cc
02:02:47.820 [DEBUG - main] (SecurityUtil.java:119) Logged in as subject: test-admin@KRBTEST.COM
02:02:47.821 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_jwt {
account_id: "account-id"
subject: "kudu"
is_valid_key: false
}
02:02:47.827 [DEBUG - main] (MiniKuduCluster.java:195) Response: create_jwt {
jwt: "eyJhbGciOiJSUzI1NiIsImtpZCI6InB1YmxpYzo5YjlkMGI0Ny1iOWVkLTRiYTYtOTE4MC01MmZjNWIxNjFhM2EiLCJ0eXAiOiJKV1QifQ.eyJleHAiOjE3Nzc5NTAxNjcsImlzcyI6ImF1dGgwXC9hY2NvdW50LWlkIiwibmJmIjoxNzc3OTQ2NTY3LCJzdWIiOiJrdWR1In0.RZLdhq4GIFArpeCIYtOvobCeIcHAjlco_sI_I6RozJWKr9CkMpWiRVdE3zh6_-0SdiJ6n938OiGvgY6XfzBjvCKwaCJvjchA4v24TDDBji2Euq7QxbfX11NKtdGQjzEWlnEdG8_OXBKEtCUd0yy2cwVmd9VTSfwOsJXWinp4fOdLKUCzkIcqst29EFaCiTa6IVspks7WxPUtiJwQH4PoCPiFmGQufceSl4geaNrmu-StPt0Nu0YVXJXQnseLMdKUgCEVG4Hyj26UvqhD21YPhiGCy9e6YbpePl-sVeVUbaZgBRDKJKaih_v7YtpvmSj3hhz-KYO9x0EWEQc2O9k3pw"
}
02:02:47.828 [DEBUG - main] (SecurityContext.java:317) Importing authentication credentials with no authn token, with one JWT, 0 cert(s), and realUser=<none>
02:02:47.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.845732 12903 catalog_manager.cc:1380] Generated new certificate authority record
02:02:47.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.847586 12903 catalog_manager.cc:1514] Loading token signing keys...
02:02:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.858759 12903 catalog_manager.cc:6044] T 00000000000000000000000000000000 P e08ecef25c604013ab7393911d8b8e11: Generated new TSK 0
02:02:47.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.859772 12903 catalog_manager.cc:1524] Initializing in-progress tserver states...
02:02:47.891 [DEBUG - main] (Connection.java:748) [peer master-127.12.128.62:39839(127.12.128.62:39839)] connecting to peer
02:02:47.899 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.12.128.62:39839(127.12.128.62:39839)] Successfully connected to peer
02:02:47.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.941236 12896 negotiation.cc:338] RPC negotiation tracing enabled. Trace:
02:02:47.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.899384 (+ 0us) reactor.cc:678] Submitting negotiation task for server connection from 127.0.0.1:44856 (local address 127.12.128.62:39839)
02:02:47.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.899592 (+ 208us) server_negotiation.cc:207] Beginning negotiation
02:02:47.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.899598 (+ 6us) server_negotiation.cc:400] Waiting for connection header
02:02:47.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.904213 (+ 4615us) server_negotiation.cc:408] Connection header received
02:02:47.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.905205 (+ 992us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
02:02:47.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.905212 (+ 7us) server_negotiation.cc:462] Received NEGOTIATE request from client
02:02:47.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.905345 (+ 133us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
02:02:47.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.905527 (+ 182us) server_negotiation.cc:227] Negotiated authn=JWT
02:02:47.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.915222 (+ 9695us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
02:02:47.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.916830 (+ 1608us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
02:02:47.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.929494 (+ 12664us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
02:02:47.942 [DEBUG - kudu-nio-0] (Negotiator.java:352) peer /127.12.128.62:39839 sent connection negotiation error: Not authorized: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:47.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.930094 (+ 600us) server_negotiation.cc:663] Negotiated TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
02:02:47.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.931854 (+ 1760us) server_negotiation.cc:366] Received JWT_EXCHANGE NegotiatePB request
02:02:47.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.940365 (+ 8511us) server_negotiation.cc:395] Sending RPC error: FATAL_INVALID_JWT: Not authorized: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:47.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.940896 (+ 531us) negotiation.cc:326] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44856: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:47.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":76,"thread_start_us":449,"threads_started":1}
02:02:47.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260505 02:02:47.942631 12896 negotiation.cc:343] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44856: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:47.944 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.12.128.62:39839(127.12.128.62:39839)] handling channelInactive
02:02:47.944 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.128.62:39839(127.12.128.62:39839)] cleaning up while in state NEGOTIATION_FAILED due to: connection closed
02:02:47.944 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.128.62:39839: connection closed
02:02:47.945 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.128.62:39839; will retry
02:02:47.951 [DEBUG - pool-22-thread-1] (Connection.java:748) [peer master-127.12.128.62:39839(127.12.128.62:39839)] connecting to peer
02:02:47.954 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.12.128.62:39839(127.12.128.62:39839)] Successfully connected to peer
02:02:47.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:47.987622 12896 negotiation.cc:338] RPC negotiation tracing enabled. Trace:
02:02:47.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.954276 (+ 0us) reactor.cc:678] Submitting negotiation task for server connection from 127.0.0.1:44872 (local address 127.12.128.62:39839)
02:02:47.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.954524 (+ 248us) server_negotiation.cc:207] Beginning negotiation
02:02:47.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.954530 (+ 6us) server_negotiation.cc:400] Waiting for connection header
02:02:47.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.959350 (+ 4820us) server_negotiation.cc:408] Connection header received
02:02:47.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.960469 (+ 1119us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
02:02:47.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.960476 (+ 7us) server_negotiation.cc:462] Received NEGOTIATE request from client
02:02:47.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.960561 (+ 85us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
02:02:47.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.960665 (+ 104us) server_negotiation.cc:227] Negotiated authn=JWT
02:02:47.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.970115 (+ 9450us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
02:02:47.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.971270 (+ 1155us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
02:02:47.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.982078 (+ 10808us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
02:02:47.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.982800 (+ 722us) server_negotiation.cc:663] Negotiated TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
02:02:47.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.985786 (+ 2986us) server_negotiation.cc:366] Received JWT_EXCHANGE NegotiatePB request
02:02:47.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.986904 (+ 1118us) server_negotiation.cc:395] Sending RPC error: FATAL_INVALID_JWT: Not authorized: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:47.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:47.987302 (+ 398us) negotiation.cc:326] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44872: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:47.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":104}
02:02:47.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260505 02:02:47.989708 12896 negotiation.cc:343] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44872: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:47.991 [DEBUG - kudu-nio-1] (Negotiator.java:352) peer /127.12.128.62:39839 sent connection negotiation error: Not authorized: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:47.993 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.12.128.62:39839(127.12.128.62:39839)] handling channelInactive
02:02:47.993 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.128.62:39839(127.12.128.62:39839)] cleaning up while in state NEGOTIATION_FAILED due to: connection closed
02:02:47.993 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.128.62:39839: connection closed
02:02:47.994 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.12.128.62:39839; will retry
02:02:48.012 [DEBUG - pool-22-thread-1] (Connection.java:748) [peer master-127.12.128.62:39839(127.12.128.62:39839)] connecting to peer
02:02:48.014 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.12.128.62:39839(127.12.128.62:39839)] Successfully connected to peer
02:02:48.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:48.043386 12896 negotiation.cc:338] RPC negotiation tracing enabled. Trace:
02:02:48.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.014324 (+ 0us) reactor.cc:678] Submitting negotiation task for server connection from 127.0.0.1:44886 (local address 127.12.128.62:39839)
02:02:48.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.014715 (+ 391us) server_negotiation.cc:207] Beginning negotiation
02:02:48.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.014722 (+ 7us) server_negotiation.cc:400] Waiting for connection header
02:02:48.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.018294 (+ 3572us) server_negotiation.cc:408] Connection header received
02:02:48.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.019279 (+ 985us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
02:02:48.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.019287 (+ 8us) server_negotiation.cc:462] Received NEGOTIATE request from client
02:02:48.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.019438 (+ 151us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
02:02:48.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.019529 (+ 91us) server_negotiation.cc:227] Negotiated authn=JWT
02:02:48.044 [DEBUG - kudu-nio-2] (Negotiator.java:352) peer /127.12.128.62:39839 sent connection negotiation error: Not authorized: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.027874 (+ 8345us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
02:02:48.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.029537 (+ 1663us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
02:02:48.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.039551 (+ 10014us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
02:02:48.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.040146 (+ 595us) server_negotiation.cc:663] Negotiated TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
02:02:48.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.041524 (+ 1378us) server_negotiation.cc:366] Received JWT_EXCHANGE NegotiatePB request
02:02:48.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.042709 (+ 1185us) server_negotiation.cc:395] Sending RPC error: FATAL_INVALID_JWT: Not authorized: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.043069 (+ 360us) negotiation.cc:326] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44886: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":89}
02:02:48.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260505 02:02:48.045082 12896 negotiation.cc:343] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44886: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.045 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.12.128.62:39839(127.12.128.62:39839)] handling channelInactive
02:02:48.045 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.12.128.62:39839(127.12.128.62:39839)] cleaning up while in state NEGOTIATION_FAILED due to: connection closed
02:02:48.046 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.12.128.62:39839: connection closed
02:02:48.046 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.12.128.62:39839; will retry
02:02:48.052 [DEBUG - pool-22-thread-1] (Connection.java:748) [peer master-127.12.128.62:39839(127.12.128.62:39839)] connecting to peer
02:02:48.054 [DEBUG - kudu-nio-3] (Connection.java:757) [peer master-127.12.128.62:39839(127.12.128.62:39839)] Successfully connected to peer
02:02:48.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:48.090998 12896 negotiation.cc:338] RPC negotiation tracing enabled. Trace:
02:02:48.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.054824 (+ 0us) reactor.cc:678] Submitting negotiation task for server connection from 127.0.0.1:44902 (local address 127.12.128.62:39839)
02:02:48.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.055027 (+ 203us) server_negotiation.cc:207] Beginning negotiation
02:02:48.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.055034 (+ 7us) server_negotiation.cc:400] Waiting for connection header
02:02:48.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.059568 (+ 4534us) server_negotiation.cc:408] Connection header received
02:02:48.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.060963 (+ 1395us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
02:02:48.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.060970 (+ 7us) server_negotiation.cc:462] Received NEGOTIATE request from client
02:02:48.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.061073 (+ 103us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
02:02:48.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.061196 (+ 123us) server_negotiation.cc:227] Negotiated authn=JWT
02:02:48.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.072568 (+ 11372us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
02:02:48.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.074247 (+ 1679us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
02:02:48.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.087153 (+ 12906us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
02:02:48.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.087870 (+ 717us) server_negotiation.cc:663] Negotiated TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
02:02:48.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.089171 (+ 1301us) server_negotiation.cc:366] Received JWT_EXCHANGE NegotiatePB request
02:02:48.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.090329 (+ 1158us) server_negotiation.cc:395] Sending RPC error: FATAL_INVALID_JWT: Not authorized: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.090696 (+ 367us) negotiation.cc:326] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44902: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":79}
02:02:48.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260505 02:02:48.091126 12896 negotiation.cc:343] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44902: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.093 [DEBUG - kudu-nio-3] (Negotiator.java:352) peer /127.12.128.62:39839 sent connection negotiation error: Not authorized: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.095 [DEBUG - kudu-nio-3] (Connection.java:239) [peer master-127.12.128.62:39839(127.12.128.62:39839)] handling channelInactive
02:02:48.095 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.128.62:39839(127.12.128.62:39839)] cleaning up while in state NEGOTIATION_FAILED due to: connection closed
02:02:48.095 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.12.128.62:39839: connection closed
02:02:48.096 [WARN - kudu-nio-3] (ConnectToCluster.java:305) Unable to find the leader master 127.12.128.62:39839; will retry
02:02:48.112 [DEBUG - pool-22-thread-1] (Connection.java:748) [peer master-127.12.128.62:39839(127.12.128.62:39839)] connecting to peer
02:02:48.114 [DEBUG - kudu-nio-4] (Connection.java:757) [peer master-127.12.128.62:39839(127.12.128.62:39839)] Successfully connected to peer
02:02:48.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:48.141314 12896 negotiation.cc:338] RPC negotiation tracing enabled. Trace:
02:02:48.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.114662 (+ 0us) reactor.cc:678] Submitting negotiation task for server connection from 127.0.0.1:44916 (local address 127.12.128.62:39839)
02:02:48.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.114893 (+ 231us) server_negotiation.cc:207] Beginning negotiation
02:02:48.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.114900 (+ 7us) server_negotiation.cc:400] Waiting for connection header
02:02:48.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.118698 (+ 3798us) server_negotiation.cc:408] Connection header received
02:02:48.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.119311 (+ 613us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
02:02:48.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.119318 (+ 7us) server_negotiation.cc:462] Received NEGOTIATE request from client
02:02:48.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.119426 (+ 108us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
02:02:48.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.119558 (+ 132us) server_negotiation.cc:227] Negotiated authn=JWT
02:02:48.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.128425 (+ 8867us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
02:02:48.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.129529 (+ 1104us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
02:02:48.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.138112 (+ 8583us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
02:02:48.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.138783 (+ 671us) server_negotiation.cc:663] Negotiated TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
02:02:48.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.139946 (+ 1163us) server_negotiation.cc:366] Received JWT_EXCHANGE NegotiatePB request
02:02:48.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.140819 (+ 873us) server_negotiation.cc:395] Sending RPC error: FATAL_INVALID_JWT: Not authorized: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.141082 (+ 263us) negotiation.cc:326] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44916: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":83}
02:02:48.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260505 02:02:48.141526 12896 negotiation.cc:343] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44916: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.144 [DEBUG - kudu-nio-4] (Negotiator.java:352) peer /127.12.128.62:39839 sent connection negotiation error: Not authorized: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.145 [DEBUG - kudu-nio-4] (Connection.java:239) [peer master-127.12.128.62:39839(127.12.128.62:39839)] handling channelInactive
02:02:48.146 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.12.128.62:39839(127.12.128.62:39839)] cleaning up while in state NEGOTIATION_FAILED due to: connection closed
02:02:48.146 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.12.128.62:39839: connection closed
02:02:48.146 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.12.128.62:39839; will retry
02:02:48.171 [DEBUG - pool-22-thread-1] (Connection.java:748) [peer master-127.12.128.62:39839(127.12.128.62:39839)] connecting to peer
02:02:48.173 [DEBUG - kudu-nio-5] (Connection.java:757) [peer master-127.12.128.62:39839(127.12.128.62:39839)] Successfully connected to peer
02:02:48.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:48.200524 12896 negotiation.cc:338] RPC negotiation tracing enabled. Trace:
02:02:48.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.173828 (+ 0us) reactor.cc:678] Submitting negotiation task for server connection from 127.0.0.1:44930 (local address 127.12.128.62:39839)
02:02:48.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.174077 (+ 249us) server_negotiation.cc:207] Beginning negotiation
02:02:48.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.174085 (+ 8us) server_negotiation.cc:400] Waiting for connection header
02:02:48.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.177776 (+ 3691us) server_negotiation.cc:408] Connection header received
02:02:48.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.178707 (+ 931us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
02:02:48.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.178715 (+ 8us) server_negotiation.cc:462] Received NEGOTIATE request from client
02:02:48.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.178815 (+ 100us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
02:02:48.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.178941 (+ 126us) server_negotiation.cc:227] Negotiated authn=JWT
02:02:48.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.187868 (+ 8927us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
02:02:48.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.189454 (+ 1586us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
02:02:48.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.197294 (+ 7840us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
02:02:48.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.197857 (+ 563us) server_negotiation.cc:663] Negotiated TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
02:02:48.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.199256 (+ 1399us) server_negotiation.cc:366] Received JWT_EXCHANGE NegotiatePB request
02:02:48.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.200009 (+ 753us) server_negotiation.cc:395] Sending RPC error: FATAL_INVALID_JWT: Not authorized: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.200272 (+ 263us) negotiation.cc:326] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44930: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":106}
02:02:48.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260505 02:02:48.200688 12896 negotiation.cc:343] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44930: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.203 [DEBUG - kudu-nio-5] (Negotiator.java:352) peer /127.12.128.62:39839 sent connection negotiation error: Not authorized: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.204 [DEBUG - kudu-nio-5] (Connection.java:239) [peer master-127.12.128.62:39839(127.12.128.62:39839)] handling channelInactive
02:02:48.204 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.12.128.62:39839(127.12.128.62:39839)] cleaning up while in state NEGOTIATION_FAILED due to: connection closed
02:02:48.205 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.12.128.62:39839: connection closed
02:02:48.205 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.12.128.62:39839; will retry
02:02:48.231 [DEBUG - pool-22-thread-1] (Connection.java:748) [peer master-127.12.128.62:39839(127.12.128.62:39839)] connecting to peer
02:02:48.234 [DEBUG - kudu-nio-6] (Connection.java:757) [peer master-127.12.128.62:39839(127.12.128.62:39839)] Successfully connected to peer
02:02:48.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:48.262055 12896 negotiation.cc:338] RPC negotiation tracing enabled. Trace:
02:02:48.262 [DEBUG - kudu-nio-6] (Negotiator.java:352) peer /127.12.128.62:39839 sent connection negotiation error: Not authorized: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.234470 (+ 0us) reactor.cc:678] Submitting negotiation task for server connection from 127.0.0.1:44932 (local address 127.12.128.62:39839)
02:02:48.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.234677 (+ 207us) server_negotiation.cc:207] Beginning negotiation
02:02:48.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.234684 (+ 7us) server_negotiation.cc:400] Waiting for connection header
02:02:48.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.239706 (+ 5022us) server_negotiation.cc:408] Connection header received
02:02:48.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.240438 (+ 732us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
02:02:48.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.240448 (+ 10us) server_negotiation.cc:462] Received NEGOTIATE request from client
02:02:48.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.240563 (+ 115us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
02:02:48.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.240675 (+ 112us) server_negotiation.cc:227] Negotiated authn=JWT
02:02:48.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.248990 (+ 8315us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
02:02:48.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.250323 (+ 1333us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
02:02:48.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.258516 (+ 8193us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
02:02:48.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.259015 (+ 499us) server_negotiation.cc:663] Negotiated TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
02:02:48.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.260312 (+ 1297us) server_negotiation.cc:366] Received JWT_EXCHANGE NegotiatePB request
02:02:48.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.261381 (+ 1069us) server_negotiation.cc:395] Sending RPC error: FATAL_INVALID_JWT: Not authorized: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.261730 (+ 349us) negotiation.cc:326] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44932: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":85}
02:02:48.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260505 02:02:48.262219 12896 negotiation.cc:343] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44932: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.264 [DEBUG - kudu-nio-6] (Connection.java:239) [peer master-127.12.128.62:39839(127.12.128.62:39839)] handling channelInactive
02:02:48.264 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.12.128.62:39839(127.12.128.62:39839)] cleaning up while in state NEGOTIATION_FAILED due to: connection closed
02:02:48.264 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.12.128.62:39839: connection closed
02:02:48.265 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.12.128.62:39839; will retry
02:02:48.331 [DEBUG - pool-22-thread-1] (Connection.java:748) [peer master-127.12.128.62:39839(127.12.128.62:39839)] connecting to peer
02:02:48.333 [DEBUG - kudu-nio-7] (Connection.java:757) [peer master-127.12.128.62:39839(127.12.128.62:39839)] Successfully connected to peer
02:02:48.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:48.352855 12896 negotiation.cc:338] RPC negotiation tracing enabled. Trace:
02:02:48.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.333614 (+ 0us) reactor.cc:678] Submitting negotiation task for server connection from 127.0.0.1:44948 (local address 127.12.128.62:39839)
02:02:48.353 [DEBUG - kudu-nio-7] (Negotiator.java:352) peer /127.12.128.62:39839 sent connection negotiation error: Not authorized: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.333813 (+ 199us) server_negotiation.cc:207] Beginning negotiation
02:02:48.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.333820 (+ 7us) server_negotiation.cc:400] Waiting for connection header
02:02:48.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.334286 (+ 466us) server_negotiation.cc:408] Connection header received
02:02:48.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.334965 (+ 679us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
02:02:48.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.334972 (+ 7us) server_negotiation.cc:462] Received NEGOTIATE request from client
02:02:48.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.335089 (+ 117us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
02:02:48.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.335210 (+ 121us) server_negotiation.cc:227] Negotiated authn=JWT
02:02:48.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.340100 (+ 4890us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
02:02:48.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.341647 (+ 1547us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
02:02:48.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.350240 (+ 8593us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
02:02:48.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.350800 (+ 560us) server_negotiation.cc:663] Negotiated TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
02:02:48.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.350981 (+ 181us) server_negotiation.cc:366] Received JWT_EXCHANGE NegotiatePB request
02:02:48.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.352192 (+ 1211us) server_negotiation.cc:395] Sending RPC error: FATAL_INVALID_JWT: Not authorized: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.352572 (+ 380us) negotiation.cc:326] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44948: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":77}
02:02:48.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260505 02:02:48.352989 12896 negotiation.cc:343] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44948: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.354 [DEBUG - kudu-nio-7] (Connection.java:239) [peer master-127.12.128.62:39839(127.12.128.62:39839)] handling channelInactive
02:02:48.354 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.12.128.62:39839(127.12.128.62:39839)] cleaning up while in state NEGOTIATION_FAILED due to: connection closed
02:02:48.355 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.12.128.62:39839: connection closed
02:02:48.355 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.12.128.62:39839; will retry
02:02:48.512 [DEBUG - pool-22-thread-1] (Connection.java:748) [peer master-127.12.128.62:39839(127.12.128.62:39839)] connecting to peer
02:02:48.513 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.12.128.62:39839(127.12.128.62:39839)] Successfully connected to peer
02:02:48.528 [DEBUG - kudu-nio-0] (Negotiator.java:352) peer /127.12.128.62:39839 sent connection negotiation error: Not authorized: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:48.527832 12896 negotiation.cc:338] RPC negotiation tracing enabled. Trace:
02:02:48.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.513576 (+ 0us) reactor.cc:678] Submitting negotiation task for server connection from 127.0.0.1:44950 (local address 127.12.128.62:39839)
02:02:48.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.513902 (+ 326us) server_negotiation.cc:207] Beginning negotiation
02:02:48.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.513909 (+ 7us) server_negotiation.cc:400] Waiting for connection header
02:02:48.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.514052 (+ 143us) server_negotiation.cc:408] Connection header received
02:02:48.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.514674 (+ 622us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
02:02:48.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.514684 (+ 10us) server_negotiation.cc:462] Received NEGOTIATE request from client
02:02:48.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.514789 (+ 105us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
02:02:48.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.514943 (+ 154us) server_negotiation.cc:227] Negotiated authn=JWT
02:02:48.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.519194 (+ 4251us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
02:02:48.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.520174 (+ 980us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
02:02:48.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.525315 (+ 5141us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
02:02:48.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.525850 (+ 535us) server_negotiation.cc:663] Negotiated TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
02:02:48.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.526088 (+ 238us) server_negotiation.cc:366] Received JWT_EXCHANGE NegotiatePB request
02:02:48.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.527143 (+ 1055us) server_negotiation.cc:395] Sending RPC error: FATAL_INVALID_JWT: Not authorized: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.527545 (+ 402us) negotiation.cc:326] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44950: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":166}
02:02:48.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260505 02:02:48.529018 12896 negotiation.cc:343] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44950: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.529 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.12.128.62:39839(127.12.128.62:39839)] handling channelInactive
02:02:48.529 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.128.62:39839(127.12.128.62:39839)] cleaning up while in state NEGOTIATION_FAILED due to: connection closed
02:02:48.530 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.12.128.62:39839: connection closed
02:02:48.530 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.12.128.62:39839; will retry
02:02:48.871 [DEBUG - pool-22-thread-1] (Connection.java:748) [peer master-127.12.128.62:39839(127.12.128.62:39839)] connecting to peer
02:02:48.873 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.12.128.62:39839(127.12.128.62:39839)] Successfully connected to peer
02:02:48.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:48.890439 12896 negotiation.cc:338] RPC negotiation tracing enabled. Trace:
02:02:48.890 [DEBUG - kudu-nio-1] (Negotiator.java:352) peer /127.12.128.62:39839 sent connection negotiation error: Not authorized: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.873094 (+ 0us) reactor.cc:678] Submitting negotiation task for server connection from 127.0.0.1:44960 (local address 127.12.128.62:39839)
02:02:48.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.873292 (+ 198us) server_negotiation.cc:207] Beginning negotiation
02:02:48.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.873296 (+ 4us) server_negotiation.cc:400] Waiting for connection header
02:02:48.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.873568 (+ 272us) server_negotiation.cc:408] Connection header received
02:02:48.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.874252 (+ 684us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
02:02:48.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.874258 (+ 6us) server_negotiation.cc:462] Received NEGOTIATE request from client
02:02:48.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.874337 (+ 79us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
02:02:48.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.874456 (+ 119us) server_negotiation.cc:227] Negotiated authn=JWT
02:02:48.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.879190 (+ 4734us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
02:02:48.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.880276 (+ 1086us) server_negotiation.cc:378] Sending TLS_HANDSHAKE NegotiatePB response
02:02:48.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.887871 (+ 7595us) server_negotiation.cc:366] Received TLS_HANDSHAKE NegotiatePB request
02:02:48.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.888490 (+ 619us) server_negotiation.cc:663] Negotiated TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 TLSv1.3 Kx=any Au=any Enc=AESGCM(128) Mac=AEAD
02:02:48.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.888690 (+ 200us) server_negotiation.cc:366] Received JWT_EXCHANGE NegotiatePB request
02:02:48.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.889723 (+ 1033us) server_negotiation.cc:395] Sending RPC error: FATAL_INVALID_JWT: Not authorized: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0505 02:02:48.890109 (+ 386us) negotiation.cc:326] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:44960: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":74}
02:02:48.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260505 02:02:48.891763 12896 negotiation.cc:343] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:44960: JWT verification failed: failed to verify signature: VerifyFinal failed (error:0407008A:rsa routines:RSA_padding_check_PKCS1_type_1:invalid padding:../crypto/rsa/rsa_pk1.c:67 error:04067072:rsa routines:rsa_ossl_public_decrypt:padding check failed:../crypto/rsa/rsa_ossl.c:581)
02:02:48.892 [INFO - pool-22-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.12.128.62:39839: cannot complete before timeout: KuduRpc(method=ConnectToMaster, tablet=null, attempt=1, TimeoutTracker(timeout=19, elapsed=20), Traces: [0ms] sending RPC to server master-127.12.128.62:39839, deferred=Deferred@1395463045(state=PENDING, result=null, callback=passthrough -> ConnectToMasterCB for 127.12.128.62:39839, errback=org.apache.kudu.client.ConnectToCluster$1@522cb9ce -> ConnectToMasterErrCB for 127.12.128.62:39839))
02:02:48.892 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.12.128.62:39839(127.12.128.62:39839)] handling channelInactive
02:02:48.892 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.128.62:39839(127.12.128.62:39839)] cleaning up while in state NEGOTIATION_FAILED due to: connection closed
02:02:48.892 [DEBUG - kudu-nio-1] (KuduRpc.java:260) Handling a callback on RPC KuduRpc(method=ConnectToMaster, tablet=null, attempt=0, TimeoutTracker(timeout=0, elapsed=0), Traces: [0ms] received response from server master-127.12.128.62:39839: Network error: connection closed, deferred=null) with no deferred attached!
02:02:48.892 [DEBUG - pool-22-thread-1] (AsyncKuduClient.java:1523) Notify RPC KuduRpc(method=GetTableSchema, tablet=null, attempt=10, TimeoutTracker(timeout=1000, elapsed=1002), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.128.62:39839, [54ms] Sub RPC ConnectToMaster: received response from server master-127.12.128.62:39839: Network error: connection closed, [55ms] delaying RPC due to: Service unavailable: Master config (127.12.128.62:39839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.128.62:39839, [103ms] Sub RPC ConnectToMaster: received response from server master-127.12.128.62:39839: Network error: connection closed, [104ms] delaying RPC due to: Service unavailable: Master config (127.12.128.62:39839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [121ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.128.62:39839, [155ms] Sub RPC ConnectToMaster: received response from server master-127.12.128.62:39839: Network error: connection closed, [156ms] delaying RPC due to: Service unavailable: Master config (127.12.128.62:39839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [161ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.128.62:39839, [205ms] Sub RPC ConnectToMaster: received response from server master-127.12.128.62:39839: Network error: connection closed, [206ms] delaying RPC due to: Service unavailable: Master config (127.12.128.62:39839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [221ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.128.62:39839, [256ms] Sub RPC ConnectToMaster: received response from server master-127.12.128.62:39839: Network error: connection closed, [256ms] delaying RPC due to: Service unavailable: Master config (127.12.128.62:39839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.128.62:39839, [314ms] Sub RPC ConnectToMaster: received response from server master-127.12.128.62:39839: Network error: connection closed, [315ms] delaying RPC due to: Service unavailable: Master config (127.12.128.62:39839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [340ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.128.62:39839, [374ms] Sub RPC ConnectToMaster: received response from server master-127.12.128.62:39839: Network error: connection closed, [375ms] delaying RPC due to: Service unavailable: Master config (127.12.128.62:39839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [440ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.128.62:39839, [464ms] Sub RPC ConnectToMaster: received response from server master-127.12.128.62:39839: Network error: connection closed, [465ms] delaying RPC due to: Service unavailable: Master config (127.12.128.62:39839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [621ms] refreshing cache from master, [621ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.128.62:39839, [640ms] Sub RPC ConnectToMaster: received response from server master-127.12.128.62:39839: Network error: connection closed, [640ms] delaying RPC due to: Service unavailable: Master config (127.12.128.62:39839) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: connection closed, [980ms] refreshing cache from master, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.128.62:39839, deferred=Deferred@1614582560(state=PENDING, result=null, callback=(continuation of Deferred@660907803 after retry RPC after error@476981577) -> (continuation of Deferred@733680067 after retry RPC after error@790245895) -> (continuation of Deferred@759432320 after retry RPC after error@1083003904) -> (continuation of Deferred@868966619 after retry RPC after error@1296033455) -> (continuation of Deferred@1087540108 after retry RPC after error@1792404162) -> (continuation of Deferred@40927995 after retry RPC after error@818415236) -> (continuation of Deferred@1678927354 after retry RPC after error@567545920) -> (continuation of Deferred@666184155 after retry RPC after error@1463416719) -> (continuation of Deferred@552826151 after retry RPC after error@556017513), errback=(continuation of Deferred@660907803 after retry RPC after error@476981577) -> (continuation of Deferred@733680067 after retry RPC after error@790245895) -> (continuation of Deferred@759432320 after retry RPC after error@1083003904) -> (continuation of Deferred@868966619 after retry RPC after error@1296033455) -> (continuation of Deferred@1087540108 after retry RPC after error@1792404162) -> (continuation of Deferred@40927995 after retry RPC after error@818415236) -> (continuation of Deferred@1678927354 after retry RPC after error@567545920) -> (continuation of Deferred@666184155 after retry RPC after error@1463416719) -> (continuation of Deferred@552826151 after retry RPC after error@556017513))) after lookup exception
org.apache.kudu.client.NonRecoverableException: Couldn't find a valid master in (127.12.128.62:39839). Exceptions received: [org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=ConnectToMaster, tablet=null, attempt=1, TimeoutTracker(timeout=19, elapsed=20), Traces: [0ms] sending RPC to server master-127.12.128.62:39839, deferred=Deferred@1395463045(state=PENDING, result=null, callback=passthrough -> ConnectToMasterCB for 127.12.128.62:39839, errback=org.apache.kudu.client.ConnectToCluster$1@522cb9ce -> ConnectToMasterErrCB for 127.12.128.62:39839))]
at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:268)
at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
at org.apache.kudu.client.KuduRpc$RpcTimeoutTask.run(KuduRpc.java:466)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.run(HashedWheelTimer.java:713)
at io.netty.util.concurrent.ImmediateExecutor.execute(ImmediateExecutor.java:34)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:701)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:787)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:501)
at java.base/java.lang.Thread.run(Thread.java:840)
org.apache.kudu.client.NonRecoverableException: Couldn't find a valid master in (127.12.128.62:39839). Exceptions received: [org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=ConnectToMaster, tablet=null, attempt=1, TimeoutTracker(timeout=19, elapsed=20), Traces: [0ms] sending RPC to server master-127.12.128.62:39839, deferred=Deferred@1395463045(state=PENDING, result=null, callback=passthrough -> ConnectToMasterCB for 127.12.128.62:39839, errback=org.apache.kudu.client.ConnectToCluster$1@522cb9ce -> ConnectToMasterErrCB for 127.12.128.62:39839))]
at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:268)
at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
at org.apache.kudu.client.KuduRpc$RpcTimeoutTask.run(KuduRpc.java:466)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.run(HashedWheelTimer.java:713)
at io.netty.util.concurrent.ImmediateExecutor.execute(ImmediateExecutor.java:34)
at io.netty.util.HashedWheelTimer$HashedWheelTimeout.expire(HashedWheelTimer.java:701)
at io.netty.util.HashedWheelTimer$HashedWheelBucket.expireTimeouts(HashedWheelTimer.java:787)
at io.netty.util.HashedWheelTimer$Worker.run(HashedWheelTimer.java:501)
at java.base/java.lang.Thread.run(Thread.java:840)
02:02:48.894 [DEBUG - main] (AsyncKuduClient.java:2704) Releasing all remaining resources
02:02:48.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:48.897739 12800 external_mini_cluster.cc:1699] Attempting to check leaks for /tmp/dist-test-taskz_z_wR/build/asan/bin/kudu pid 12826
02:02:48.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:48.899442 12888 generic_service.cc:196] Checking for leaks (request via RPC)
02:02:49.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260505 02:02:49.005818 12800 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskz_z_wR/build/asan/bin/kudu with pid 12826
02:02:49.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-05T02:02:49Z chronyd exiting
02:02:49.162 [ERROR - main] (RetryRule.java:206) org.apache.kudu.client.TestNegotiation.testInvalidJwt: failed attempt 1
junit.framework.AssertionFailedError
at junit.framework.Assert.fail(Assert.java:55)
at junit.framework.Assert.assertTrue(Assert.java:22)
at junit.framework.Assert.assertTrue(Assert.java:31)
at junit.framework.TestCase.assertTrue(TestCase.java:200)
at org.apache.kudu.client.TestNegotiation.testInvalidJwt(TestNegotiation.java:280)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:569)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
at org.junit.runners.Suite.runChild(Suite.java:128)
at org.junit.runners.Suite.runChild(Suite.java:27)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
junit.framework.AssertionFailedError
at junit.framework.Assert.fail(Assert.java:55)
at junit.framework.Assert.assertTrue(Assert.java:22)
at junit.framework.Assert.assertTrue(Assert.java:31)
at junit.framework.TestCase.assertTrue(TestCase.java:200)
at org.apache.kudu.client.TestNegotiation.testInvalidJwt(TestNegotiation.java:280)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:569)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
at org.junit.runners.Suite.runChild(Suite.java:128)
at org.junit.runners.Suite.runChild(Suite.java:27)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
at org.junit.runner.JUnitCore.main(JUnitCore.java:36)