08:07:55.364 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
08:07:55.364 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskoj2_XN/test-tmp
08:07:55.365 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
08:07:55.365 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskoj2_XN/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
08:07:55.367 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
num_masters: 3
num_tservers: 3
enable_kerberos: true
cluster_root: "/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130"
extra_master_flags: "--webserver_require_spnego=false"
extra_tserver_flags: "--webserver_require_spnego=false"
extra_tserver_flags: "--tserver_enforce_access_control=true"
hms_mode: NONE
mini_kdc_options {
}
principal: "kudu"
mini_oidc_options {
}
}
08:07:55.690 [DEBUG - main] (MiniKuduCluster.java:195) Response:
08:07:55.690 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}
08:07:55.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:55.693704 20815 mini_oidc.cc:150] Starting JWKS server
08:07:55.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:55.696848 20815 webserver.cc:533] Webserver started at http://127.0.0.1:43533/ using document root <none> and password file <none>
08:07:55.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:55.697254 20815 mini_oidc.cc:186] Starting OIDC Discovery server
08:07:55.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:55.698936 20815 webserver.cc:533] Webserver started at http://127.0.0.1:44529/ using document root <none> and password file <none>
08:07:55.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Loading random data
08:07:55.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Initializing database '/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/principal' for realm 'KRBTEST.COM',
08:07:55.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master key name 'K/M@KRBTEST.COM'
08:07:55.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:07:55 dist-test-slave-6f13 krb5kdc[20826](info): setting up network...
08:07:55.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
08:07:55.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:07:55 dist-test-slave-6f13 krb5kdc[20826](info): set up 2 sockets
08:07:55.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:07:55 dist-test-slave-6f13 krb5kdc[20826](info): commencing operation
08:07:55.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) krb5kdc: starting...
08:07:57.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:07:57.583590 20815 mini_kdc.cc:121] Time spent starting KDC: real 1.851s user 0.007s sys 0.016s
08:07:57.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
08:07:57.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
08:07:57.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "test-admin@KRBTEST.COM" created.
08:07:57.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
08:07:57.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
08:07:57.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "test-user@KRBTEST.COM" created.
08:07:57.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
08:07:57.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
08:07:57.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "joe-interloper@KRBTEST.COM" created.
08:07:57.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
08:07:57.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/test-user.keytab.
08:07:57.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/test-user.keytab.
08:07:57.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:07:57 dist-test-slave-6f13 krb5kdc[20826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790496477, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
08:07:57.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Password for test-admin@KRBTEST.COM:
08:07:57.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-09-27T08:07:57Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
08:07:57.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-09-27T08:07:57Z Disabled control of system clock
08:07:57.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.20.83.254@KRBTEST.COM; defaulting to no policy
08:07:57.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
08:07:57.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.20.83.254@KRBTEST.COM" created.
08:07:57.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
08:07:57.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.20.83.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab.
08:07:57.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.20.83.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab.
08:07:57.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.20.83.254@KRBTEST.COM; defaulting to no policy
08:07:57.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
08:07:57.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.20.83.254@KRBTEST.COM" created.
08:07:57.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
08:07:57.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.20.83.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab.
08:07:57.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.20.83.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab.
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:57.801970 20815 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskoj2_XN/build/tsan/bin/kudu
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskoj2_XN/build/tsan/bin/kudu
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-0/wal
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-0/data
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-0/logs
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-0/data/info.pb
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.83.254:35719
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.83.254
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.20.83.254
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.83.212:45995
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.83.254:35719,127.20.83.253:40403,127.20.83.252:44501
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43533/jwks.json
08:07:57.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false with env {KRB5CCNAME=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
08:07:58.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:07:58.094225 20842 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:07:58.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:07:58.094853 20842 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:07:58.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:07:58.095510 20842 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:07:58.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:07:58.129040 20842 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:07:58.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:07:58.129489 20842 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:07:58.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:07:58.129798 20842 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:07:58.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:07:58.130069 20842 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:07:58.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:07:58.130339 20842 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:07:58.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:07:58.130549 20842 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:43533/jwks.json
08:07:58.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:58.168988 20842 master_runner.cc:387] Master server non-default flags:
08:07:58.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-0/logs
08:07:58.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:58.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:07:58.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:58.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.83.212:45995
08:07:58.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:58.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:58.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-0/data
08:07:58.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-0/wal
08:07:58.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:07:58.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.83.254:35719,127.20.83.253:40403,127.20.83.252:44501
08:07:58.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab
08:07:58.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.20.83.254
08:07:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:07:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.83.254:35719
08:07:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:07:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:07:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:07:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43533/jwks.json
08:07:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
08:07:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
08:07:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
08:07:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-0/data/info.pb
08:07:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.83.254
08:07:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:07:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:07:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:07:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)
08:07:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:07:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:07:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3b18f0139b1d21a072b7353269301fba16dca54e
08:07:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:07:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 27 Sep 2026 07:43:23 UTC on e7f111948823
08:07:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 14022
08:07:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:07:58.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:58.170625 20842 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:07:58.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:58.171633 20842 file_cache.cc:504] Constructed file cache file cache with capacity 419430
08:07:58.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:07:58.182811 20848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:59.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:07:58.183516 20849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:59.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:07:59.314211 20851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:59.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:07:59.317921 20850 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1133 milliseconds
08:07:59.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.318022 20842 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:07:59.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.319219 20842 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:07:59.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.321615 20842 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:07:59.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.322949 20842 hybrid_clock.cc:648] HybridClock initialized: now 1790496479322916 us; error 40 us; skew 500 ppm
08:07:59.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.323727 20842 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:07:59.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:07:59 dist-test-slave-6f13 krb5kdc[20826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790496479, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.83.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
08:07:59.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.329321 20842 init.cc:377] Logged in from keytab as kudu/127.20.83.254@KRBTEST.COM (short username kudu)
08:07:59.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.334343 20842 webserver.cc:533] Webserver started at http://127.20.83.254:42747/ using document root <none> and password file <none>
08:07:59.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.335247 20842 fs_manager.cc:362] Metadata directory not provided
08:07:59.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.335465 20842 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:07:59.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.335929 20842 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:07:59.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.340364 20842 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-0/data/instance:
08:07:59.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cda37fce4fad4805a6bb1c38617f0c09"
08:07:59.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-09-27 08:07:59 on dist-test-slave-6f13"
08:07:59.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.341493 20842 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-0/wal/instance:
08:07:59.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cda37fce4fad4805a6bb1c38617f0c09"
08:07:59.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-09-27 08:07:59 on dist-test-slave-6f13"
08:07:59.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.349356 20842 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
08:07:59.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.355093 20859 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
08:07:59.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.356190 20842 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.002s sys 0.003s
08:07:59.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.356535 20842 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-0/data,/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-0/wal
08:07:59.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cda37fce4fad4805a6bb1c38617f0c09"
08:07:59.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-09-27 08:07:59 on dist-test-slave-6f13"
08:07:59.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.356873 20842 fs_report.cc:389] FS layout report
08:07:59.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:07:59.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-0/wal
08:07:59.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-0/wal
08:07:59.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-0/data/data
08:07:59.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:07:59.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:07:59.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:07:59.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:07:59.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:07:59.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:07:59.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:07:59.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:07:59.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:07:59.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:07:59.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:07:59.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.404332 20842 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
08:07:59.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.416635 20842 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:07:59.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.417150 20842 kserver.cc:163] Server-wide thread pool size limit: 3276
08:07:59.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.485332 20842 rpc_server.cc:307] RPC server started. Bound to: 127.20.83.254:35719
08:07:59.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.485397 20910 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.83.254:35719 every 8 connection(s)
08:07:59.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.488026 20842 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-0/data/info.pb
08:07:59.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.491851 20815 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskoj2_XN/build/tsan/bin/kudu as pid 20842
08:07:59.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.492406 20815 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-0/wal/instance
08:07:59.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.494689 20911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:59.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.507211 20911 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.83.254" port: 35719 } has no permanent_uuid. Determining permanent_uuid...
08:07:59.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.20.83.253@KRBTEST.COM; defaulting to no policy
08:07:59.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
08:07:59.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.20.83.253@KRBTEST.COM" created.
08:07:59.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:07:59 dist-test-slave-6f13 krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790496479, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.83.254@KRBTEST.COM for kudu/127.20.83.254@KRBTEST.COM
08:07:59.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
08:07:59.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.20.83.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab.
08:07:59.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.20.83.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab.
08:07:59.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.547291 20911 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.83.253" port: 40403 } has no permanent_uuid. Determining permanent_uuid...
08:07:59.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:07:59.549868 20862 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.83.253:40403: connect: Connection refused (error 111)
08:07:59.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.20.83.253@KRBTEST.COM; defaulting to no policy
08:07:59.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:07:59.553984 20911 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.83.253:40403: Network error: Client connection negotiation failed: client connection to 127.20.83.253:40403: connect: Connection refused (error 111)
08:07:59.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
08:07:59.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.20.83.253@KRBTEST.COM" created.
08:07:59.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
08:07:59.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.20.83.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab.
08:07:59.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.20.83.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab.
08:07:59.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.578621 20815 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskoj2_XN/build/tsan/bin/kudu
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskoj2_XN/build/tsan/bin/kudu
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-1/wal
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-1/data
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-1/logs
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-1/data/info.pb
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.83.253:40403
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.83.253
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.20.83.253
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.83.212:45995
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.83.254:35719,127.20.83.253:40403,127.20.83.252:44501
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43533/jwks.json
08:07:59.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false with env {KRB5CCNAME=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
08:07:59.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.603514 20911 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.83.253" port: 40403 } attempt: 1
08:07:59.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:07:59.607729 20911 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.83.253:40403: Network error: Client connection negotiation failed: client connection to 127.20.83.253:40403: connect: Connection refused (error 111)
08:07:59.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.676119 20911 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.83.253" port: 40403 } attempt: 2
08:07:59.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:07:59.680192 20911 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.83.253:40403: Network error: Client connection negotiation failed: client connection to 127.20.83.253:40403: connect: Connection refused (error 111)
08:07:59.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.771577 20911 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.83.253" port: 40403 } attempt: 3
08:07:59.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:07:59.775733 20911 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.83.253:40403: Network error: Client connection negotiation failed: client connection to 127.20.83.253:40403: connect: Connection refused (error 111)
08:07:59.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:07:59.874441 20920 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:07:59.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:07:59.875075 20920 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:07:59.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:07:59.875720 20920 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:07:59.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:07:59.908635 20920 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:07:59.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:07:59.909080 20920 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:07:59.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:07:59.909375 20920 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:07:59.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:07:59.909682 20920 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:07:59.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:07:59.909963 20920 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:07:59.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:07:59.910207 20920 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:43533/jwks.json
08:07:59.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.919111 20911 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.83.253" port: 40403 } attempt: 4
08:07:59.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:07:59.923102 20911 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.83.253:40403: Network error: Client connection negotiation failed: client connection to 127.20.83.253:40403: connect: Connection refused (error 111)
08:07:59.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.950249 20920 master_runner.cc:387] Master server non-default flags:
08:07:59.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-1/logs
08:07:59.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:59.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:07:59.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:59.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.83.212:45995
08:07:59.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:59.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:59.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-1/data
08:07:59.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-1/wal
08:07:59.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:07:59.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.83.254:35719,127.20.83.253:40403,127.20.83.252:44501
08:07:59.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab
08:07:59.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.20.83.253
08:07:59.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:59.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:59.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:07:59.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.83.253:40403
08:07:59.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:07:59.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:07:59.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:07:59.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43533/jwks.json
08:07:59.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
08:07:59.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
08:07:59.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
08:07:59.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:59.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:59.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-1/data/info.pb
08:07:59.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.83.253
08:07:59.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:59.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:07:59.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:59.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:07:59.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:07:59.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:59.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)
08:07:59.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:07:59.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:07:59.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3b18f0139b1d21a072b7353269301fba16dca54e
08:07:59.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:07:59.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 27 Sep 2026 07:43:23 UTC on e7f111948823
08:07:59.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 14022
08:07:59.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:07:59.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.951854 20920 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:07:59.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:07:59.952875 20920 file_cache.cc:504] Constructed file cache file cache with capacity 419430
08:07:59.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:07:59.963456 20926 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:00.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:00.222500 20911 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.83.253" port: 40403 } attempt: 5
08:08:00.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:00.231499 20911 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.83.253:40403: Network error: Client connection negotiation failed: client connection to 127.20.83.253:40403: connect: Connection refused (error 111)
08:08:00.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:00.778991 20911 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.83.253" port: 40403 } attempt: 6
08:08:00.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:00.817132 20911 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.83.253:40403: Network error: Client connection negotiation failed: client connection to 127.20.83.253:40403: connect: Connection refused (error 111)
08:08:01.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:07:59.964406 20927 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:01.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:01.329418 20929 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:01.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:01.332129 20928 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1367 milliseconds
08:08:01.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:01.333931 20920 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.371s user 0.526s sys 0.832s
08:08:01.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:01.334271 20920 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.371s user 0.526s sys 0.832s
08:08:01.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.334558 20920 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:08:01.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.336020 20920 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:08:01.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.339430 20920 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:08:01.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.341091 20920 hybrid_clock.cc:648] HybridClock initialized: now 1790496481341041 us; error 50 us; skew 500 ppm
08:08:01.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.342372 20920 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:08:01.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:08:01 dist-test-slave-6f13 krb5kdc[20826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790496481, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.83.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
08:08:01.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.350981 20920 init.cc:377] Logged in from keytab as kudu/127.20.83.253@KRBTEST.COM (short username kudu)
08:08:01.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.356536 20920 webserver.cc:533] Webserver started at http://127.20.83.253:33809/ using document root <none> and password file <none>
08:08:01.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.357461 20920 fs_manager.cc:362] Metadata directory not provided
08:08:01.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.357851 20920 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:08:01.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.358340 20920 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:08:01.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.362694 20920 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-1/data/instance:
08:08:01.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "869761207cd2465996249a0f0cf86a0a"
08:08:01.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-09-27 08:08:01 on dist-test-slave-6f13"
08:08:01.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.364035 20920 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-1/wal/instance:
08:08:01.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "869761207cd2465996249a0f0cf86a0a"
08:08:01.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-09-27 08:08:01 on dist-test-slave-6f13"
08:08:01.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.372079 20920 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.000s sys 0.008s
08:08:01.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.378000 20939 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
08:08:01.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.379238 20920 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.002s sys 0.002s
08:08:01.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.379580 20920 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-1/data,/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-1/wal
08:08:01.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "869761207cd2465996249a0f0cf86a0a"
08:08:01.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-09-27 08:08:01 on dist-test-slave-6f13"
08:08:01.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.379938 20920 fs_report.cc:389] FS layout report
08:08:01.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:08:01.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-1/wal
08:08:01.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-1/wal
08:08:01.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-1/data/data
08:08:01.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:08:01.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:08:01.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:08:01.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:08:01.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:08:01.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:08:01.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:08:01.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:08:01.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:08:01.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:08:01.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:08:01.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.453655 20920 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
08:08:01.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.459014 20920 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:08:01.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.459501 20920 kserver.cc:163] Server-wide thread pool size limit: 3276
08:08:01.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.530299 20920 rpc_server.cc:307] RPC server started. Bound to: 127.20.83.253:40403
08:08:01.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.530378 20990 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.83.253:40403 every 8 connection(s)
08:08:01.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.533046 20920 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-1/data/info.pb
08:08:01.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.536736 20815 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskoj2_XN/build/tsan/bin/kudu as pid 20920
08:08:01.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.537259 20815 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-1/wal/instance
08:08:01.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.539921 20991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:01.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.20.83.252@KRBTEST.COM; defaulting to no policy
08:08:01.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.551698 20991 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.83.254" port: 35719 } has no permanent_uuid. Determining permanent_uuid...
08:08:01.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
08:08:01.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.20.83.252@KRBTEST.COM" created.
08:08:01.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:08:01 dist-test-slave-6f13 krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790496481, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.83.253@KRBTEST.COM for kudu/127.20.83.254@KRBTEST.COM
08:08:01.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
08:08:01.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.20.83.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab.
08:08:01.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.20.83.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab.
08:08:01.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.589365 20991 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.83.253" port: 40403 } has no permanent_uuid. Determining permanent_uuid...
08:08:01.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.20.83.252@KRBTEST.COM; defaulting to no policy
08:08:01.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
08:08:01.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.20.83.252@KRBTEST.COM" created.
08:08:01.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:08:01 dist-test-slave-6f13 krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790496481, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.83.253@KRBTEST.COM for kudu/127.20.83.253@KRBTEST.COM
08:08:01.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.614904 20991 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } has no permanent_uuid. Determining permanent_uuid...
08:08:01.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:01.617461 20940 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.83.252:44501: connect: Connection refused (error 111)
08:08:01.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:01.621204 20991 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.83.252:44501: Network error: Client connection negotiation failed: client connection to 127.20.83.252:44501: connect: Connection refused (error 111)
08:08:01.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
08:08:01.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.20.83.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab.
08:08:01.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.20.83.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab.
08:08:01.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.626048 20815 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskoj2_XN/build/tsan/bin/kudu
08:08:01.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskoj2_XN/build/tsan/bin/kudu
08:08:01.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-2/wal
08:08:01.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-2/data
08:08:01.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:08:01.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:08:01.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:08:01.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:01.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:01.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:01.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-2/logs
08:08:01.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-2/data/info.pb
08:08:01.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:01.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:08:01.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:08:01.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:08:01.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:08:01.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:01.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:01.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:01.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:08:01.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:08:01.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:08:01.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:08:01.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.83.252:44501
08:08:01.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.83.252
08:08:01.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:01.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab
08:08:01.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.20.83.252
08:08:01.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
08:08:01.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
08:08:01.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
08:08:01.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
08:08:01.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.83.212:45995
08:08:01.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:01.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:01.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:08:01.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:08:01.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.83.254:35719,127.20.83.253:40403,127.20.83.252:44501
08:08:01.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:08:01.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43533/jwks.json
08:08:01.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false with env {KRB5CCNAME=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
08:08:01.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.670715 20991 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } attempt: 1
08:08:01.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:01.675110 20991 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.83.252:44501: Network error: Client connection negotiation failed: client connection to 127.20.83.252:44501: connect: Connection refused (error 111)
08:08:01.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.743566 20991 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } attempt: 2
08:08:01.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:01.747871 20991 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.83.252:44501: Network error: Client connection negotiation failed: client connection to 127.20.83.252:44501: connect: Connection refused (error 111)
08:08:01.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.839365 20991 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } attempt: 3
08:08:01.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:01.843771 20991 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.83.252:44501: Network error: Client connection negotiation failed: client connection to 127.20.83.252:44501: connect: Connection refused (error 111)
08:08:01.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.877643 20911 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.83.253" port: 40403 } attempt: 7
08:08:01.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:08:01 dist-test-slave-6f13 krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790496479, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.83.254@KRBTEST.COM for kudu/127.20.83.253@KRBTEST.COM
08:08:01.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.900101 20911 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } has no permanent_uuid. Determining permanent_uuid...
08:08:01.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:01.905889 20911 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.83.252:44501: Network error: Client connection negotiation failed: client connection to 127.20.83.252:44501: connect: Connection refused (error 111)
08:08:01.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:01.928896 21001 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:08:01.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:01.929564 21001 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:08:01.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:01.930164 21001 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:08:01.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:01.963140 21001 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:08:01.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:01.963528 21001 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:08:01.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:01.963747 21001 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:08:01.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:01.963949 21001 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:08:01.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:01.964140 21001 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:08:01.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:01.964288 21001 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:43533/jwks.json
08:08:01.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.964394 20911 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } attempt: 1
08:08:01.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:01.968639 20911 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.83.252:44501: Network error: Client connection negotiation failed: client connection to 127.20.83.252:44501: connect: Connection refused (error 111)
08:08:01.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:01.987229 20991 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } attempt: 4
08:08:01.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:01.991371 20991 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.83.252:44501: Network error: Client connection negotiation failed: client connection to 127.20.83.252:44501: connect: Connection refused (error 111)
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:02.004799 21001 master_runner.cc:387] Master server non-default flags:
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-2/logs
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.83.212:45995
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-2/data
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-2/wal
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.83.254:35719,127.20.83.253:40403,127.20.83.252:44501
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.20.83.252
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.83.252:44501
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43533/jwks.json
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-2/data/info.pb
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.83.252
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:08:02.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:02.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)
08:08:02.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:08:02.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:08:02.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3b18f0139b1d21a072b7353269301fba16dca54e
08:08:02.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:08:02.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 27 Sep 2026 07:43:23 UTC on e7f111948823
08:08:02.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 14022
08:08:02.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:08:02.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:02.006073 21001 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:08:02.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:02.007085 21001 file_cache.cc:504] Constructed file cache file cache with capacity 419430
08:08:02.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:02.018466 21009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:02.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:02.050034 20911 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } attempt: 2
08:08:02.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:02.055878 20911 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.83.252:44501: Network error: Client connection negotiation failed: client connection to 127.20.83.252:44501: connect: Connection refused (error 111)
08:08:02.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:02.141399 20911 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } attempt: 3
08:08:02.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:02.147259 20911 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.83.252:44501: Network error: Client connection negotiation failed: client connection to 127.20.83.252:44501: connect: Connection refused (error 111)
08:08:02.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:02.287849 20911 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } attempt: 4
08:08:02.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:02.290795 20991 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } attempt: 5
08:08:02.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:02.293380 20911 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.83.252:44501: Network error: Client connection negotiation failed: client connection to 127.20.83.252:44501: connect: Connection refused (error 111)
08:08:02.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:02.295421 20991 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.83.252:44501: Network error: Client connection negotiation failed: client connection to 127.20.83.252:44501: connect: Connection refused (error 111)
08:08:02.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:02.577078 20911 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } attempt: 5
08:08:02.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:02.582896 20911 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.83.252:44501: Network error: Client connection negotiation failed: client connection to 127.20.83.252:44501: connect: Connection refused (error 111)
08:08:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:02.842823 20991 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } attempt: 6
08:08:02.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:02.851717 20991 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.83.252:44501: Network error: Client connection negotiation failed: client connection to 127.20.83.252:44501: connect: Connection refused (error 111)
08:08:03.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.135442 20911 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } attempt: 6
08:08:03.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:03.143795 20911 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.20.83.252:44501: Network error: Client connection negotiation failed: client connection to 127.20.83.252:44501: connect: Connection refused (error 111)
08:08:03.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:02.018838 21010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:03.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:03.175968 21012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:03.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:03.177814 21011 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1155 milliseconds
08:08:03.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.177954 21001 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:08:03.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.179209 21001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:08:03.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.182170 21001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:08:03.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.183589 21001 hybrid_clock.cc:648] HybridClock initialized: now 1790496483183546 us; error 56 us; skew 500 ppm
08:08:03.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.184396 21001 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:08:03.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:08:03 dist-test-slave-6f13 krb5kdc[20826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790496483, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.83.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
08:08:03.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.190271 21001 init.cc:377] Logged in from keytab as kudu/127.20.83.252@KRBTEST.COM (short username kudu)
08:08:03.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.195672 21001 webserver.cc:533] Webserver started at http://127.20.83.252:40317/ using document root <none> and password file <none>
08:08:03.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.196619 21001 fs_manager.cc:362] Metadata directory not provided
08:08:03.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.196852 21001 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:08:03.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.197348 21001 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:08:03.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.201589 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-2/data/instance:
08:08:03.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "710ae1a9691a4a1baa751f0a45974696"
08:08:03.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-09-27 08:08:03 on dist-test-slave-6f13"
08:08:03.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.202720 21001 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-2/wal/instance:
08:08:03.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "710ae1a9691a4a1baa751f0a45974696"
08:08:03.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-09-27 08:08:03 on dist-test-slave-6f13"
08:08:03.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.210430 21001 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
08:08:03.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.215965 21024 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
08:08:03.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.217060 21001 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
08:08:03.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.217434 21001 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-2/data,/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-2/wal
08:08:03.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "710ae1a9691a4a1baa751f0a45974696"
08:08:03.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-09-27 08:08:03 on dist-test-slave-6f13"
08:08:03.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.217833 21001 fs_report.cc:389] FS layout report
08:08:03.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:08:03.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-2/wal
08:08:03.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-2/wal
08:08:03.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-2/data/data
08:08:03.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:08:03.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:08:03.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:08:03.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:08:03.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:08:03.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:08:03.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:08:03.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:08:03.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:08:03.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:08:03.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:08:03.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.271057 21001 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
08:08:03.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.276520 21001 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:08:03.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.277038 21001 kserver.cc:163] Server-wide thread pool size limit: 3276
08:08:03.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.343856 21001 rpc_server.cc:307] RPC server started. Bound to: 127.20.83.252:44501
08:08:03.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.343924 21075 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.83.252:44501 every 8 connection(s)
08:08:03.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.346513 21001 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-2/data/info.pb
08:08:03.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.348548 20815 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskoj2_XN/build/tsan/bin/kudu as pid 21001
08:08:03.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.349078 20815 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/master-2/wal/instance
08:08:03.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.353127 21076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:03.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.367782 21076 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.83.254" port: 35719 } has no permanent_uuid. Determining permanent_uuid...
08:08:03.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:08:03 dist-test-slave-6f13 krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790496477, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.83.254@KRBTEST.COM
08:08:03.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:08:03 dist-test-slave-6f13 krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790496483, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.83.252@KRBTEST.COM for kudu/127.20.83.254@KRBTEST.COM
08:08:03.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:08:03 dist-test-slave-6f13 krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790496477, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.83.253@KRBTEST.COM
08:08:03.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.402881 21076 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.83.253" port: 40403 } has no permanent_uuid. Determining permanent_uuid...
08:08:03.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:08:03 dist-test-slave-6f13 krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790496483, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.83.252@KRBTEST.COM for kudu/127.20.83.253@KRBTEST.COM
08:08:03.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:08:03 dist-test-slave-6f13 krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790496477, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.83.252@KRBTEST.COM
08:08:03.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.427160 21076 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } has no permanent_uuid. Determining permanent_uuid...
08:08:03.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:08:03 dist-test-slave-6f13 krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790496483, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.83.252@KRBTEST.COM for kudu/127.20.83.252@KRBTEST.COM
08:08:03.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.459396 21076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696: Bootstrap starting.
08:08:03.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.465363 21076 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696: Neither blocks nor log segments found. Creating new log.
08:08:03.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.467727 21076 log.cc:826] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696: Log is configured to *not* fsync() on all Append() calls
08:08:03.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.471944 21076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696: No bootstrap required, opened a new log
08:08:03.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.494226 21076 raft_consensus.cc:359] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda37fce4fad4805a6bb1c38617f0c09" member_type: VOTER last_known_addr { host: "127.20.83.254" port: 35719 } } peers { permanent_uuid: "869761207cd2465996249a0f0cf86a0a" member_type: VOTER last_known_addr { host: "127.20.83.253" port: 40403 } } peers { permanent_uuid: "710ae1a9691a4a1baa751f0a45974696" member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } }
08:08:03.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.494982 21076 raft_consensus.cc:385] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:03.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.495190 21076 raft_consensus.cc:740] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 710ae1a9691a4a1baa751f0a45974696, State: Initialized, Role: FOLLOWER
08:08:03.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.496055 21076 consensus_queue.cc:260] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda37fce4fad4805a6bb1c38617f0c09" member_type: VOTER last_known_addr { host: "127.20.83.254" port: 35719 } } peers { permanent_uuid: "869761207cd2465996249a0f0cf86a0a" member_type: VOTER last_known_addr { host: "127.20.83.253" port: 40403 } } peers { permanent_uuid: "710ae1a9691a4a1baa751f0a45974696" member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } }
08:08:03.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.499032 21087 sys_catalog.cc:455] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda37fce4fad4805a6bb1c38617f0c09" member_type: VOTER last_known_addr { host: "127.20.83.254" port: 35719 } } peers { permanent_uuid: "869761207cd2465996249a0f0cf86a0a" member_type: VOTER last_known_addr { host: "127.20.83.253" port: 40403 } } peers { permanent_uuid: "710ae1a9691a4a1baa751f0a45974696" member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } } }
08:08:03.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.500415 21087 sys_catalog.cc:458] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696 [sys.catalog]: This master's current role is: FOLLOWER
08:08:03.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.500972 21076 sys_catalog.cc:565] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696 [sys.catalog]: configured and running, proceeding with master startup.
08:08:03.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:03.529079 21098 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:08:03.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:03.529471 21098 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:08:03.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:03.532181 21030 tablet.cc:2433] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:08:03.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.525238 21001 master_runner.cc:187] Error getting master registration for 127.20.83.254:35719: OK, instance_id { permanent_uuid: "cda37fce4fad4805a6bb1c38617f0c09" instance_seqno: 1790496479467061 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:08:03.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.551214 21001 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:08:03.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.912247 20991 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } attempt: 7
08:08:03.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:08:03 dist-test-slave-6f13 krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790496481, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.83.253@KRBTEST.COM for kudu/127.20.83.252@KRBTEST.COM
08:08:03.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.944149 20991 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 869761207cd2465996249a0f0cf86a0a: Bootstrap starting.
08:08:03.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.950754 20991 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 869761207cd2465996249a0f0cf86a0a: Neither blocks nor log segments found. Creating new log.
08:08:03.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.953053 20991 log.cc:826] T 00000000000000000000000000000000 P 869761207cd2465996249a0f0cf86a0a: Log is configured to *not* fsync() on all Append() calls
08:08:03.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.954706 21087 raft_consensus.cc:493] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:08:03.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.955328 21087 raft_consensus.cc:515] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda37fce4fad4805a6bb1c38617f0c09" member_type: VOTER last_known_addr { host: "127.20.83.254" port: 35719 } } peers { permanent_uuid: "869761207cd2465996249a0f0cf86a0a" member_type: VOTER last_known_addr { host: "127.20.83.253" port: 40403 } } peers { permanent_uuid: "710ae1a9691a4a1baa751f0a45974696" member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } }
08:08:03.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.959589 21087 leader_election.cc:290] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cda37fce4fad4805a6bb1c38617f0c09 (127.20.83.254:35719), 869761207cd2465996249a0f0cf86a0a (127.20.83.253:40403)
08:08:03.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.961848 20991 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 869761207cd2465996249a0f0cf86a0a: No bootstrap required, opened a new log
08:08:03.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.984932 20991 raft_consensus.cc:359] T 00000000000000000000000000000000 P 869761207cd2465996249a0f0cf86a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda37fce4fad4805a6bb1c38617f0c09" member_type: VOTER last_known_addr { host: "127.20.83.254" port: 35719 } } peers { permanent_uuid: "869761207cd2465996249a0f0cf86a0a" member_type: VOTER last_known_addr { host: "127.20.83.253" port: 40403 } } peers { permanent_uuid: "710ae1a9691a4a1baa751f0a45974696" member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } }
08:08:03.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.985679 20991 raft_consensus.cc:385] T 00000000000000000000000000000000 P 869761207cd2465996249a0f0cf86a0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:03.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.985992 20991 raft_consensus.cc:740] T 00000000000000000000000000000000 P 869761207cd2465996249a0f0cf86a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 869761207cd2465996249a0f0cf86a0a, State: Initialized, Role: FOLLOWER
08:08:03.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.986992 20991 consensus_queue.cc:260] T 00000000000000000000000000000000 P 869761207cd2465996249a0f0cf86a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda37fce4fad4805a6bb1c38617f0c09" member_type: VOTER last_known_addr { host: "127.20.83.254" port: 35719 } } peers { permanent_uuid: "869761207cd2465996249a0f0cf86a0a" member_type: VOTER last_known_addr { host: "127.20.83.253" port: 40403 } } peers { permanent_uuid: "710ae1a9691a4a1baa751f0a45974696" member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } }
08:08:03.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.990060 21102 sys_catalog.cc:455] T 00000000000000000000000000000000 P 869761207cd2465996249a0f0cf86a0a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda37fce4fad4805a6bb1c38617f0c09" member_type: VOTER last_known_addr { host: "127.20.83.254" port: 35719 } } peers { permanent_uuid: "869761207cd2465996249a0f0cf86a0a" member_type: VOTER last_known_addr { host: "127.20.83.253" port: 40403 } } peers { permanent_uuid: "710ae1a9691a4a1baa751f0a45974696" member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } } }
08:08:03.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.991076 21102 sys_catalog.cc:458] T 00000000000000000000000000000000 P 869761207cd2465996249a0f0cf86a0a [sys.catalog]: This master's current role is: FOLLOWER
08:08:03.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.992164 20991 sys_catalog.cc:565] T 00000000000000000000000000000000 P 869761207cd2465996249a0f0cf86a0a [sys.catalog]: configured and running, proceeding with master startup.
08:08:03.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.992415 20966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "710ae1a9691a4a1baa751f0a45974696" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "869761207cd2465996249a0f0cf86a0a" is_pre_election: true
08:08:03.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.993505 20966 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 869761207cd2465996249a0f0cf86a0a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 710ae1a9691a4a1baa751f0a45974696 in term 0.
08:08:03.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.995545 21027 leader_election.cc:304] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 710ae1a9691a4a1baa751f0a45974696, 869761207cd2465996249a0f0cf86a0a; no voters:
08:08:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.997162 21087 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:08:03.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.997643 21087 raft_consensus.cc:493] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:08:03.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:03.998102 21087 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696 [term 0 FOLLOWER]: Advancing to term 1
08:08:04.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.005882 21087 raft_consensus.cc:515] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda37fce4fad4805a6bb1c38617f0c09" member_type: VOTER last_known_addr { host: "127.20.83.254" port: 35719 } } peers { permanent_uuid: "869761207cd2465996249a0f0cf86a0a" member_type: VOTER last_known_addr { host: "127.20.83.253" port: 40403 } } peers { permanent_uuid: "710ae1a9691a4a1baa751f0a45974696" member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } }
08:08:04.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.010214 21087 leader_election.cc:290] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696 [CANDIDATE]: Term 1 election: Requested vote from peers cda37fce4fad4805a6bb1c38617f0c09 (127.20.83.254:35719), 869761207cd2465996249a0f0cf86a0a (127.20.83.253:40403)
08:08:04.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.012490 20966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "710ae1a9691a4a1baa751f0a45974696" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "869761207cd2465996249a0f0cf86a0a"
08:08:04.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.013116 20966 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 869761207cd2465996249a0f0cf86a0a [term 0 FOLLOWER]: Advancing to term 1
08:08:04.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.029326 20966 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 869761207cd2465996249a0f0cf86a0a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 710ae1a9691a4a1baa751f0a45974696 in term 1.
08:08:04.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.031055 21027 leader_election.cc:304] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 710ae1a9691a4a1baa751f0a45974696, 869761207cd2465996249a0f0cf86a0a; no voters:
08:08:04.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.031955 21087 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696 [term 1 FOLLOWER]: Leader election won for term 1
08:08:04.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.042104 21087 raft_consensus.cc:697] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696 [term 1 LEADER]: Becoming Leader. State: Replica: 710ae1a9691a4a1baa751f0a45974696, State: Running, Role: LEADER
08:08:04.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.044376 21087 consensus_queue.cc:237] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda37fce4fad4805a6bb1c38617f0c09" member_type: VOTER last_known_addr { host: "127.20.83.254" port: 35719 } } peers { permanent_uuid: "869761207cd2465996249a0f0cf86a0a" member_type: VOTER last_known_addr { host: "127.20.83.253" port: 40403 } } peers { permanent_uuid: "710ae1a9691a4a1baa751f0a45974696" member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } }
08:08:04.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.056411 21109 sys_catalog.cc:455] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 710ae1a9691a4a1baa751f0a45974696. Latest consensus state: current_term: 1 leader_uuid: "710ae1a9691a4a1baa751f0a45974696" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda37fce4fad4805a6bb1c38617f0c09" member_type: VOTER last_known_addr { host: "127.20.83.254" port: 35719 } } peers { permanent_uuid: "869761207cd2465996249a0f0cf86a0a" member_type: VOTER last_known_addr { host: "127.20.83.253" port: 40403 } } peers { permanent_uuid: "710ae1a9691a4a1baa751f0a45974696" member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } } }
08:08:04.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.057157 21109 sys_catalog.cc:458] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696 [sys.catalog]: This master's current role is: LEADER
08:08:04.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.068020 21112 catalog_manager.cc:1524] Loading table and tablet metadata into memory...
08:08:04.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.080747 21112 catalog_manager.cc:1533] Initializing Kudu cluster ID...
08:08:04.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:04.102330 21116 catalog_manager.cc:1607] T 00000000000000000000000000000000 P 869761207cd2465996249a0f0cf86a0a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:08:04.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:04.103112 21116 catalog_manager.cc:896] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:08:04.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.081902 20920 master_runner.cc:187] Error getting master registration for 127.20.83.254:35719: OK, instance_id { permanent_uuid: "cda37fce4fad4805a6bb1c38617f0c09" instance_seqno: 1790496479467061 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:08:04.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.122008 20920 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:08:04.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.122200 20966 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 869761207cd2465996249a0f0cf86a0a [term 1 FOLLOWER]: Refusing update from remote peer 710ae1a9691a4a1baa751f0a45974696: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:08:04.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.124434 21087 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696 [LEADER]: Connected to new peer: Peer: permanent_uuid: "869761207cd2465996249a0f0cf86a0a" member_type: VOTER last_known_addr { host: "127.20.83.253" port: 40403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:08:04.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.162974 21102 sys_catalog.cc:455] T 00000000000000000000000000000000 P 869761207cd2465996249a0f0cf86a0a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 710ae1a9691a4a1baa751f0a45974696. Latest consensus state: current_term: 1 leader_uuid: "710ae1a9691a4a1baa751f0a45974696" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda37fce4fad4805a6bb1c38617f0c09" member_type: VOTER last_known_addr { host: "127.20.83.254" port: 35719 } } peers { permanent_uuid: "869761207cd2465996249a0f0cf86a0a" member_type: VOTER last_known_addr { host: "127.20.83.253" port: 40403 } } peers { permanent_uuid: "710ae1a9691a4a1baa751f0a45974696" member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } } }
08:08:04.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.171914 21109 sys_catalog.cc:455] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "710ae1a9691a4a1baa751f0a45974696" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda37fce4fad4805a6bb1c38617f0c09" member_type: VOTER last_known_addr { host: "127.20.83.254" port: 35719 } } peers { permanent_uuid: "869761207cd2465996249a0f0cf86a0a" member_type: VOTER last_known_addr { host: "127.20.83.253" port: 40403 } } peers { permanent_uuid: "710ae1a9691a4a1baa751f0a45974696" member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } } }
08:08:04.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.172649 21109 sys_catalog.cc:458] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696 [sys.catalog]: This master's current role is: LEADER
08:08:04.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.172454 21102 sys_catalog.cc:458] T 00000000000000000000000000000000 P 869761207cd2465996249a0f0cf86a0a [sys.catalog]: This master's current role is: FOLLOWER
08:08:04.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.176218 21112 catalog_manager.cc:1396] Generated new cluster ID: 0e95c8ab87074a4583fcc4f469b6c01d
08:08:04.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.176512 21112 catalog_manager.cc:1544] Initializing Kudu internal certificate authority...
08:08:04.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.177299 20911 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } attempt: 7
08:08:04.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.183751 21119 mvcc.cc:204] Tried to move back new op lower bound from 7333873598893035520 to 7333873598667579392. Current Snapshot: MvccSnapshot[applied={T|T < 7333873598893035520}]
08:08:04.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.188663 21102 sys_catalog.cc:455] T 00000000000000000000000000000000 P 869761207cd2465996249a0f0cf86a0a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "710ae1a9691a4a1baa751f0a45974696" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda37fce4fad4805a6bb1c38617f0c09" member_type: VOTER last_known_addr { host: "127.20.83.254" port: 35719 } } peers { permanent_uuid: "869761207cd2465996249a0f0cf86a0a" member_type: VOTER last_known_addr { host: "127.20.83.253" port: 40403 } } peers { permanent_uuid: "710ae1a9691a4a1baa751f0a45974696" member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } } }
08:08:04.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.192046 21102 sys_catalog.cc:458] T 00000000000000000000000000000000 P 869761207cd2465996249a0f0cf86a0a [sys.catalog]: This master's current role is: FOLLOWER
08:08:04.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:08:04 dist-test-slave-6f13 krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790496479, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.83.254@KRBTEST.COM for kudu/127.20.83.252@KRBTEST.COM
08:08:04.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.241997 21112 catalog_manager.cc:1419] Generated new certificate authority record
08:08:04.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.244239 21112 catalog_manager.cc:1553] Loading token signing keys...
08:08:04.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.274741 21112 catalog_manager.cc:6219] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696: Generated new TSK 0
08:08:04.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.277711 21112 catalog_manager.cc:1563] Initializing in-progress tserver states...
08:08:04.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.289142 20911 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cda37fce4fad4805a6bb1c38617f0c09: Bootstrap starting.
08:08:04.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.296875 20911 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cda37fce4fad4805a6bb1c38617f0c09: Neither blocks nor log segments found. Creating new log.
08:08:04.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.299363 20911 log.cc:826] T 00000000000000000000000000000000 P cda37fce4fad4805a6bb1c38617f0c09: Log is configured to *not* fsync() on all Append() calls
08:08:04.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.319296 20911 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cda37fce4fad4805a6bb1c38617f0c09: No bootstrap required, opened a new log
08:08:04.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.347903 20911 raft_consensus.cc:359] T 00000000000000000000000000000000 P cda37fce4fad4805a6bb1c38617f0c09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda37fce4fad4805a6bb1c38617f0c09" member_type: VOTER last_known_addr { host: "127.20.83.254" port: 35719 } } peers { permanent_uuid: "869761207cd2465996249a0f0cf86a0a" member_type: VOTER last_known_addr { host: "127.20.83.253" port: 40403 } } peers { permanent_uuid: "710ae1a9691a4a1baa751f0a45974696" member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } }
08:08:04.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.349268 20911 raft_consensus.cc:385] T 00000000000000000000000000000000 P cda37fce4fad4805a6bb1c38617f0c09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:04.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.349707 20911 raft_consensus.cc:740] T 00000000000000000000000000000000 P cda37fce4fad4805a6bb1c38617f0c09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cda37fce4fad4805a6bb1c38617f0c09, State: Initialized, Role: FOLLOWER
08:08:04.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.351024 20911 consensus_queue.cc:260] T 00000000000000000000000000000000 P cda37fce4fad4805a6bb1c38617f0c09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda37fce4fad4805a6bb1c38617f0c09" member_type: VOTER last_known_addr { host: "127.20.83.254" port: 35719 } } peers { permanent_uuid: "869761207cd2465996249a0f0cf86a0a" member_type: VOTER last_known_addr { host: "127.20.83.253" port: 40403 } } peers { permanent_uuid: "710ae1a9691a4a1baa751f0a45974696" member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } }
08:08:04.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.365906 21127 sys_catalog.cc:455] T 00000000000000000000000000000000 P cda37fce4fad4805a6bb1c38617f0c09 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda37fce4fad4805a6bb1c38617f0c09" member_type: VOTER last_known_addr { host: "127.20.83.254" port: 35719 } } peers { permanent_uuid: "869761207cd2465996249a0f0cf86a0a" member_type: VOTER last_known_addr { host: "127.20.83.253" port: 40403 } } peers { permanent_uuid: "710ae1a9691a4a1baa751f0a45974696" member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } } }
08:08:04.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.368300 21127 sys_catalog.cc:458] T 00000000000000000000000000000000 P cda37fce4fad4805a6bb1c38617f0c09 [sys.catalog]: This master's current role is: FOLLOWER
08:08:04.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.367929 20911 sys_catalog.cc:565] T 00000000000000000000000000000000 P cda37fce4fad4805a6bb1c38617f0c09 [sys.catalog]: configured and running, proceeding with master startup.
08:08:04.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.369009 20884 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cda37fce4fad4805a6bb1c38617f0c09 [term 0 FOLLOWER]: Advancing to term 1
08:08:04.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.372534 20886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "710ae1a9691a4a1baa751f0a45974696" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cda37fce4fad4805a6bb1c38617f0c09" is_pre_election: true
08:08:04.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.373987 20885 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "710ae1a9691a4a1baa751f0a45974696" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cda37fce4fad4805a6bb1c38617f0c09"
08:08:04.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.384054 20884 raft_consensus.cc:1275] T 00000000000000000000000000000000 P cda37fce4fad4805a6bb1c38617f0c09 [term 1 FOLLOWER]: Refusing update from remote peer 710ae1a9691a4a1baa751f0a45974696: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:08:04.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.391191 21109 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cda37fce4fad4805a6bb1c38617f0c09" member_type: VOTER last_known_addr { host: "127.20.83.254" port: 35719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:08:04.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.20.83.193@KRBTEST.COM; defaulting to no policy
08:08:04.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
08:08:04.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.20.83.193@KRBTEST.COM" created.
08:08:04.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:04.432549 20865 tablet.cc:2433] T 00000000000000000000000000000000 P cda37fce4fad4805a6bb1c38617f0c09: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:08:04.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.476207 21127 sys_catalog.cc:455] T 00000000000000000000000000000000 P cda37fce4fad4805a6bb1c38617f0c09 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 710ae1a9691a4a1baa751f0a45974696. Latest consensus state: current_term: 1 leader_uuid: "710ae1a9691a4a1baa751f0a45974696" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda37fce4fad4805a6bb1c38617f0c09" member_type: VOTER last_known_addr { host: "127.20.83.254" port: 35719 } } peers { permanent_uuid: "869761207cd2465996249a0f0cf86a0a" member_type: VOTER last_known_addr { host: "127.20.83.253" port: 40403 } } peers { permanent_uuid: "710ae1a9691a4a1baa751f0a45974696" member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } } }
08:08:04.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.478868 21127 sys_catalog.cc:458] T 00000000000000000000000000000000 P cda37fce4fad4805a6bb1c38617f0c09 [sys.catalog]: This master's current role is: FOLLOWER
08:08:04.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.477977 21134 sys_catalog.cc:455] T 00000000000000000000000000000000 P cda37fce4fad4805a6bb1c38617f0c09 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "710ae1a9691a4a1baa751f0a45974696" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda37fce4fad4805a6bb1c38617f0c09" member_type: VOTER last_known_addr { host: "127.20.83.254" port: 35719 } } peers { permanent_uuid: "869761207cd2465996249a0f0cf86a0a" member_type: VOTER last_known_addr { host: "127.20.83.253" port: 40403 } } peers { permanent_uuid: "710ae1a9691a4a1baa751f0a45974696" member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } } }
08:08:04.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
08:08:04.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.20.83.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab.
08:08:04.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.20.83.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab.
08:08:04.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.479725 21134 sys_catalog.cc:458] T 00000000000000000000000000000000 P cda37fce4fad4805a6bb1c38617f0c09 [sys.catalog]: This master's current role is: FOLLOWER
08:08:04.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:04.480472 20815 mini_kdc.cc:268] Time spent creating service keytab for kudu/127.20.83.193: real 0.172s user 0.004s sys 0.012s
08:08:04.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.505678 21145 catalog_manager.cc:818] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
08:08:04.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.20.83.193@KRBTEST.COM; defaulting to no policy
08:08:04.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
08:08:04.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.20.83.193@KRBTEST.COM" created.
08:08:04.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
08:08:04.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.20.83.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab.
08:08:04.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.20.83.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab.
08:08:04.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:04.593190 20815 mini_kdc.cc:268] Time spent creating service keytab for HTTP/127.20.83.193: real 0.112s user 0.008s sys 0.008s
08:08:04.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.595715 20815 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskoj2_XN/build/tsan/bin/kudu
08:08:04.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskoj2_XN/build/tsan/bin/kudu
08:08:04.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-0/wal
08:08:04.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-0/data
08:08:04.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:08:04.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:08:04.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:08:04.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:04.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:04.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:04.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-0/logs
08:08:04.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-0/data/info.pb
08:08:04.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:04.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:08:04.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:08:04.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:08:04.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:08:04.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:04.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:04.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:04.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:08:04.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:08:04.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.83.193:0
08:08:04.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.20.83.193
08:08:04.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.83.193
08:08:04.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:04.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.20.83.254:35719,127.20.83.253:40403,127.20.83.252:44501
08:08:04.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab
08:08:04.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.20.83.193
08:08:04.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
08:08:04.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
08:08:04.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
08:08:04.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
08:08:04.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.83.212:45995
08:08:04.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:04.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:04.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:08:04.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false
08:08:04.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_enforce_access_control=true with env {KRB5CCNAME=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
08:08:04.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.828830 21109 sys_catalog.cc:455] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "710ae1a9691a4a1baa751f0a45974696" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cda37fce4fad4805a6bb1c38617f0c09" member_type: VOTER last_known_addr { host: "127.20.83.254" port: 35719 } } peers { permanent_uuid: "869761207cd2465996249a0f0cf86a0a" member_type: VOTER last_known_addr { host: "127.20.83.253" port: 40403 } } peers { permanent_uuid: "710ae1a9691a4a1baa751f0a45974696" member_type: VOTER last_known_addr { host: "127.20.83.252" port: 44501 } } }
08:08:04.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:04.830037 21109 sys_catalog.cc:458] T 00000000000000000000000000000000 P 710ae1a9691a4a1baa751f0a45974696 [sys.catalog]: This master's current role is: LEADER
08:08:05.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:05.061518 21147 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:08:05.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:05.062222 21147 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:08:05.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:05.063234 21147 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:08:05.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:05.108985 21116 catalog_manager.cc:1308] Loaded cluster ID: 0e95c8ab87074a4583fcc4f469b6c01d
08:08:05.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:05.109586 21116 catalog_manager.cc:1601] T 00000000000000000000000000000000 P 869761207cd2465996249a0f0cf86a0a: loading cluster ID for follower catalog manager: success
08:08:05.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:05.117731 21116 catalog_manager.cc:1623] T 00000000000000000000000000000000 P 869761207cd2465996249a0f0cf86a0a: acquiring CA information for follower catalog manager: success
08:08:05.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:05.123605 21147 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:08:05.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:05.123570 21116 catalog_manager.cc:1651] T 00000000000000000000000000000000 P 869761207cd2465996249a0f0cf86a0a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:08:05.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:05.125221 21147 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.83.193
08:08:05.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:05.193001 21147 tablet_server_runner.cc:78] Tablet server non-default flags:
08:08:05.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-0/logs
08:08:05.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:05.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:08:05.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:05.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.83.212:45995
08:08:05.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:05.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:08:05.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-0/data
08:08:05.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-0/wal
08:08:05.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab
08:08:05.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.20.83.193
08:08:05.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:05.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:05.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.83.193:0
08:08:05.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:08:05.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
08:08:05.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
08:08:05.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
08:08:05.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:05.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:05.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-0/data/info.pb
08:08:05.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.83.193
08:08:05.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:05.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.20.83.254:35719,127.20.83.253:40403,127.20.83.252:44501
08:08:05.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_enforce_access_control=true
08:08:05.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:08:05.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:05.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:08:05.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:08:05.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:05.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.20.83.193
08:08:05.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)
08:08:05.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:08:05.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:08:05.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3b18f0139b1d21a072b7353269301fba16dca54e
08:08:05.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:08:05.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 27 Sep 2026 07:43:23 UTC on e7f111948823
08:08:05.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 14022
08:08:05.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:08:05.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:05.194763 21147 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:08:05.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:05.196135 21147 file_cache.cc:504] Constructed file cache file cache with capacity 419430
08:08:05.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:05.212136 21155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:05.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:05.556547 21145 catalog_manager.cc:1308] Loaded cluster ID: 0e95c8ab87074a4583fcc4f469b6c01d
08:08:05.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:05.565665 21145 catalog_manager.cc:1601] T 00000000000000000000000000000000 P cda37fce4fad4805a6bb1c38617f0c09: loading cluster ID for follower catalog manager: success
08:08:05.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:05.596966 21145 catalog_manager.cc:1623] T 00000000000000000000000000000000 P cda37fce4fad4805a6bb1c38617f0c09: acquiring CA information for follower catalog manager: success
08:08:05.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:05.627673 21145 catalog_manager.cc:1651] T 00000000000000000000000000000000 P cda37fce4fad4805a6bb1c38617f0c09: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:08:06.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:06.614462 21154 debug-util.cc:398] Leaking SignalData structure 0x7b0800037ca0 after lost signal to thread 21147
08:08:06.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:06.679031 21147 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.467s user 0.379s sys 0.593s
08:08:06.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:06.679843 21147 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.468s user 0.379s sys 0.594s
08:08:06.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:05.214061 21156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:06.696650 21147 server_base.cc:1061] running on GCE node
08:08:06.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:06.696509 21166 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:06.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:06.698503 21147 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:08:06.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:06.701246 21147 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:08:06.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:06.702852 21147 hybrid_clock.cc:648] HybridClock initialized: now 1790496486702792 us; error 61 us; skew 500 ppm
08:08:06.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:06.703999 21147 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:08:06.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:08:06 dist-test-slave-6f13 krb5kdc[20826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790496486, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.83.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
08:08:06.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:06.712486 21147 init.cc:377] Logged in from keytab as kudu/127.20.83.193@KRBTEST.COM (short username kudu)
08:08:06.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:06.725363 21147 webserver.cc:533] Webserver started at http://127.20.83.193:45563/ using document root <none> and password file <none>
08:08:06.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:06.726899 21147 fs_manager.cc:362] Metadata directory not provided
08:08:06.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:06.727172 21147 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:08:06.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:06.727708 21147 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:08:06.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:06.733712 21147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-0/data/instance:
08:08:06.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "823ed75fe4bd49aeb034d3c15b959fd1"
08:08:06.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-09-27 08:08:06 on dist-test-slave-6f13"
08:08:06.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:06.735189 21147 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-0/wal/instance:
08:08:06.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "823ed75fe4bd49aeb034d3c15b959fd1"
08:08:06.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-09-27 08:08:06 on dist-test-slave-6f13"
08:08:06.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:06.745057 21147 fs_manager.cc:696] Time spent creating directory manager: real 0.009s user 0.010s sys 0.000s
08:08:06.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:06.752288 21172 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
08:08:06.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:06.753712 21147 fs_manager.cc:730] Time spent opening block manager: real 0.005s user 0.006s sys 0.001s
08:08:06.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:06.754098 21147 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-0/data,/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-0/wal
08:08:06.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "823ed75fe4bd49aeb034d3c15b959fd1"
08:08:06.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-09-27 08:08:06 on dist-test-slave-6f13"
08:08:06.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:06.754514 21147 fs_report.cc:389] FS layout report
08:08:06.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:08:06.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-0/wal
08:08:06.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-0/wal
08:08:06.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-0/data/data
08:08:06.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:08:06.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:08:06.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:08:06.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:08:06.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:08:06.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:08:06.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:08:06.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:08:06.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:08:06.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:08:06.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:08:06.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:06.824162 21147 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
08:08:06.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:06.835446 21147 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:08:06.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:06.836009 21147 kserver.cc:163] Server-wide thread pool size limit: 3276
08:08:06.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:06.839617 21147 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:08:06.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:06.845245 21147 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:08:06.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:06.845569 21147 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
08:08:06.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:06.845871 21147 ts_tablet_manager.cc:616] Registered 0 tablets
08:08:06.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:06.846064 21147 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
08:08:07.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:07.006533 21147 rpc_server.cc:307] RPC server started. Bound to: 127.20.83.193:37463
08:08:07.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:07.006630 21284 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.83.193:37463 every 8 connection(s)
08:08:07.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:07.009119 21147 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-0/data/info.pb
08:08:07.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:07.012521 20815 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskoj2_XN/build/tsan/bin/kudu as pid 21147
08:08:07.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:07.013202 20815 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-0/wal/instance
08:08:07.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:08:07 dist-test-slave-6f13 krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790496486, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.83.193@KRBTEST.COM for kudu/127.20.83.252@KRBTEST.COM
08:08:07.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.20.83.194@KRBTEST.COM; defaulting to no policy
08:08:07.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
08:08:07.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.20.83.194@KRBTEST.COM" created.
08:08:07.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:08:07 dist-test-slave-6f13 krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790496486, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.83.193@KRBTEST.COM for kudu/127.20.83.254@KRBTEST.COM
08:08:07.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:08:07 dist-test-slave-6f13 krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790496486, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.83.193@KRBTEST.COM for kudu/127.20.83.253@KRBTEST.COM
08:08:07.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:07.096676 21286 heartbeater.cc:344] Connected to a master server at 127.20.83.253:40403
08:08:07.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:07.097200 21286 heartbeater.cc:461] Registering TS with master...
08:08:07.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:07.098392 21286 heartbeater.cc:507] Master 127.20.83.253:40403 requested a full tablet report, sending...
08:08:07.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:07.099553 21287 heartbeater.cc:344] Connected to a master server at 127.20.83.254:35719
08:08:07.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:07.099845 21287 heartbeater.cc:461] Registering TS with master...
08:08:07.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:07.100675 21287 heartbeater.cc:507] Master 127.20.83.254:35719 requested a full tablet report, sending...
08:08:07.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:07.101792 21285 heartbeater.cc:344] Connected to a master server at 127.20.83.252:44501
08:08:07.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:07.101851 20956 ts_manager.cc:194] Registered new tserver with Master: 823ed75fe4bd49aeb034d3c15b959fd1 (127.20.83.193:37463)
08:08:07.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:07.102139 21285 heartbeater.cc:461] Registering TS with master...
08:08:07.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:07.103008 21285 heartbeater.cc:507] Master 127.20.83.252:44501 requested a full tablet report, sending...
08:08:07.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:07.103618 20876 ts_manager.cc:194] Registered new tserver with Master: 823ed75fe4bd49aeb034d3c15b959fd1 (127.20.83.193:37463)
08:08:07.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:07.105674 21041 ts_manager.cc:194] Registered new tserver with Master: 823ed75fe4bd49aeb034d3c15b959fd1 (127.20.83.193:37463)
08:08:07.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:07.108150 21041 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.83.193@KRBTEST.COM'} at 127.20.83.193:49289
08:08:07.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
08:08:07.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.20.83.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab.
08:08:07.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.20.83.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab.
08:08:07.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.20.83.194@KRBTEST.COM; defaulting to no policy
08:08:07.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
08:08:07.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.20.83.194@KRBTEST.COM" created.
08:08:07.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
08:08:07.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.20.83.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab.
08:08:07.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.20.83.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab.
08:08:07.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:07.162824 20815 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskoj2_XN/build/tsan/bin/kudu
08:08:07.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskoj2_XN/build/tsan/bin/kudu
08:08:07.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-1/wal
08:08:07.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-1/data
08:08:07.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:08:07.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:08:07.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:08:07.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:07.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:07.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:07.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-1/logs
08:08:07.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-1/data/info.pb
08:08:07.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:07.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:08:07.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:08:07.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:08:07.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:08:07.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:07.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:07.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:07.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:08:07.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:08:07.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.83.194:0
08:08:07.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.20.83.194
08:08:07.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.83.194
08:08:07.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:07.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.20.83.254:35719,127.20.83.253:40403,127.20.83.252:44501
08:08:07.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab
08:08:07.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.20.83.194
08:08:07.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
08:08:07.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
08:08:07.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
08:08:07.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
08:08:07.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.83.212:45995
08:08:07.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:07.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:07.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:08:07.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false
08:08:07.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_enforce_access_control=true with env {KRB5CCNAME=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
08:08:07.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:07.496940 21299 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:08:07.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:07.497622 21299 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:08:07.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:07.498700 21299 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:08:07.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:07.543898 21299 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:08:07.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:07.545171 21299 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.83.194
08:08:07.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:07.593137 21299 tablet_server_runner.cc:78] Tablet server non-default flags:
08:08:07.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-1/logs
08:08:07.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:07.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:08:07.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:07.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.83.212:45995
08:08:07.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:07.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:08:07.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-1/data
08:08:07.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-1/wal
08:08:07.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab
08:08:07.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.20.83.194
08:08:07.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:07.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:07.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.83.194:0
08:08:07.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:08:07.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
08:08:07.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
08:08:07.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
08:08:07.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:07.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:07.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-1/data/info.pb
08:08:07.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.83.194
08:08:07.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:07.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.20.83.254:35719,127.20.83.253:40403,127.20.83.252:44501
08:08:07.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_enforce_access_control=true
08:08:07.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:08:07.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:07.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:08:07.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:08:07.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:07.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.20.83.194
08:08:07.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)
08:08:07.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:08:07.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:08:07.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3b18f0139b1d21a072b7353269301fba16dca54e
08:08:07.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:08:07.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 27 Sep 2026 07:43:23 UTC on e7f111948823
08:08:07.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 14022
08:08:07.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:08:07.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:07.594815 21299 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:08:07.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:07.596135 21299 file_cache.cc:504] Constructed file cache file cache with capacity 419430
08:08:07.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:07.609835 21305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:08.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:08.113390 21285 heartbeater.cc:499] Master 127.20.83.252:44501 was elected leader, sending a full tablet report...
08:08:09.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:09.010710 21304 debug-util.cc:398] Leaking SignalData structure 0x7b0800037ca0 after lost signal to thread 21299
08:08:09.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:09.102276 21299 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.492s user 0.577s sys 0.832s
08:08:09.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:07.611291 21306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:09.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:09.102826 21299 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.492s user 0.578s sys 0.832s
08:08:09.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:09.105122 21308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:09.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:09.107128 21307 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1492 milliseconds
08:08:09.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.107153 21299 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:08:09.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.108351 21299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:08:09.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.110399 21299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:08:09.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.111735 21299 hybrid_clock.cc:648] HybridClock initialized: now 1790496489111695 us; error 41 us; skew 500 ppm
08:08:09.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.112701 21299 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:08:09.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:08:09 dist-test-slave-6f13 krb5kdc[20826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790496489, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.83.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
08:08:09.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.119340 21299 init.cc:377] Logged in from keytab as kudu/127.20.83.194@KRBTEST.COM (short username kudu)
08:08:09.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.125237 21299 webserver.cc:533] Webserver started at http://127.20.83.194:37933/ using document root <none> and password file <none>
08:08:09.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.126186 21299 fs_manager.cc:362] Metadata directory not provided
08:08:09.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.126436 21299 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:08:09.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.126929 21299 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:08:09.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.132025 21299 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-1/data/instance:
08:08:09.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ebc3bfd70d664520aa14fb6683962462"
08:08:09.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-09-27 08:08:09 on dist-test-slave-6f13"
08:08:09.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.133464 21299 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-1/wal/instance:
08:08:09.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ebc3bfd70d664520aa14fb6683962462"
08:08:09.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-09-27 08:08:09 on dist-test-slave-6f13"
08:08:09.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.141374 21299 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.001s sys 0.005s
08:08:09.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.146773 21317 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
08:08:09.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.147825 21299 fs_manager.cc:730] Time spent opening block manager: real 0.004s user 0.003s sys 0.002s
08:08:09.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.148165 21299 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-1/data,/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-1/wal
08:08:09.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ebc3bfd70d664520aa14fb6683962462"
08:08:09.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-09-27 08:08:09 on dist-test-slave-6f13"
08:08:09.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.148483 21299 fs_report.cc:389] FS layout report
08:08:09.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:08:09.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-1/wal
08:08:09.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-1/wal
08:08:09.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-1/data/data
08:08:09.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:08:09.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:08:09.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:08:09.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:08:09.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:08:09.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:08:09.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:08:09.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:08:09.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:08:09.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:08:09.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:08:09.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.198307 21299 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
08:08:09.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.203681 21299 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:08:09.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.204166 21299 kserver.cc:163] Server-wide thread pool size limit: 3276
08:08:09.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.206755 21299 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:08:09.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.210831 21299 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:08:09.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.211056 21299 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
08:08:09.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.211354 21299 ts_tablet_manager.cc:616] Registered 0 tablets
08:08:09.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.211515 21299 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
08:08:09.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.338690 21299 rpc_server.cc:307] RPC server started. Bound to: 127.20.83.194:33397
08:08:09.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.338812 21429 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.83.194:33397 every 8 connection(s)
08:08:09.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.341142 21299 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-1/data/info.pb
08:08:09.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.348565 20815 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskoj2_XN/build/tsan/bin/kudu as pid 21299
08:08:09.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.349076 20815 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-1/wal/instance
08:08:09.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:08:09 dist-test-slave-6f13 krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790496489, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.83.194@KRBTEST.COM for kudu/127.20.83.252@KRBTEST.COM
08:08:09.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:08:09 dist-test-slave-6f13 krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790496489, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.83.194@KRBTEST.COM for kudu/127.20.83.253@KRBTEST.COM
08:08:09.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.20.83.195@KRBTEST.COM; defaulting to no policy
08:08:09.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
08:08:09.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.20.83.195@KRBTEST.COM" created.
08:08:09.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.404994 21430 heartbeater.cc:344] Connected to a master server at 127.20.83.252:44501
08:08:09.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.405485 21430 heartbeater.cc:461] Registering TS with master...
08:08:09.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.406730 21430 heartbeater.cc:507] Master 127.20.83.252:44501 requested a full tablet report, sending...
08:08:09.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.409163 21041 ts_manager.cc:194] Registered new tserver with Master: ebc3bfd70d664520aa14fb6683962462 (127.20.83.194:33397)
08:08:09.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.411293 21041 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.83.194@KRBTEST.COM'} at 127.20.83.194:44613
08:08:09.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:08:09 dist-test-slave-6f13 krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790496489, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.83.194@KRBTEST.COM for kudu/127.20.83.254@KRBTEST.COM
08:08:09.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.414971 21431 heartbeater.cc:344] Connected to a master server at 127.20.83.253:40403
08:08:09.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.415274 21431 heartbeater.cc:461] Registering TS with master...
08:08:09.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.415807 21431 heartbeater.cc:507] Master 127.20.83.253:40403 requested a full tablet report, sending...
08:08:09.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.418396 20956 ts_manager.cc:194] Registered new tserver with Master: ebc3bfd70d664520aa14fb6683962462 (127.20.83.194:33397)
08:08:09.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.426445 21432 heartbeater.cc:344] Connected to a master server at 127.20.83.254:35719
08:08:09.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.426782 21432 heartbeater.cc:461] Registering TS with master...
08:08:09.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.427336 21432 heartbeater.cc:507] Master 127.20.83.254:35719 requested a full tablet report, sending...
08:08:09.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.429700 20876 ts_manager.cc:194] Registered new tserver with Master: ebc3bfd70d664520aa14fb6683962462 (127.20.83.194:33397)
08:08:09.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
08:08:09.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.20.83.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab.
08:08:09.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.20.83.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab.
08:08:09.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.20.83.195@KRBTEST.COM; defaulting to no policy
08:08:09.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
08:08:09.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.20.83.195@KRBTEST.COM" created.
08:08:09.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
08:08:09.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.20.83.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab.
08:08:09.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.20.83.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab.
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.474018 20815 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskoj2_XN/build/tsan/bin/kudu
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskoj2_XN/build/tsan/bin/kudu
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-2/wal
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-2/data
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-2/logs
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-2/data/info.pb
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.83.195:0
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.20.83.195
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.83.195
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.20.83.254:35719,127.20.83.253:40403,127.20.83.252:44501
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.20.83.195
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.83.212:45995
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false
08:08:09.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_enforce_access_control=true with env {KRB5CCNAME=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
08:08:09.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:09.806119 21444 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:08:09.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:09.806838 21444 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:08:09.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:09.807801 21444 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:08:09.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:09.844754 21444 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:08:09.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:09.845841 21444 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.83.195
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.889597 21444 tablet_server_runner.cc:78] Tablet server non-default flags:
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-2/logs
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.83.212:45995
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-2/data
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-2/wal
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kudu.keytab
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.20.83.195
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.83.195:0
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-2/data/info.pb
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.83.195
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.20.83.254:35719,127.20.83.253:40403,127.20.83.252:44501
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_enforce_access_control=true
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.20.83.195
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3b18f0139b1d21a072b7353269301fba16dca54e
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 27 Sep 2026 07:43:23 UTC on e7f111948823
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 14022
08:08:09.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:08:09.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.891217 21444 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:08:09.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:09.892428 21444 file_cache.cc:504] Constructed file cache file cache with capacity 419430
08:08:09.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:09.907126 21451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:10.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:10.415848 21430 heartbeater.cc:499] Master 127.20.83.252:44501 was elected leader, sending a full tablet report...
08:08:11.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:11.310014 21450 debug-util.cc:398] Leaking SignalData structure 0x7b0800037ca0 after lost signal to thread 21444
08:08:11.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:09.909022 21452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:11.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:11.414230 21450 kernel_stack_watchdog.cc:198] Thread 21444 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 399ms:
08:08:11.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:08:11.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:08:11.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:08:11.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:08:11.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:11.416532 21454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:08:11.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:11.415740 21444 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.507s user 0.519s sys 0.884s
08:08:11.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:11.417011 21444 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.509s user 0.519s sys 0.884s
08:08:11.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:11.420919 21453 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1512 milliseconds
08:08:11.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.420995 21444 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:08:11.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.422214 21444 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:08:11.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.424268 21444 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:08:11.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.425635 21444 hybrid_clock.cc:648] HybridClock initialized: now 1790496491425587 us; error 44 us; skew 500 ppm
08:08:11.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.426631 21444 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:08:11.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:08:11 dist-test-slave-6f13 krb5kdc[20826](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790496491, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.83.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
08:08:11.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.433125 21444 init.cc:377] Logged in from keytab as kudu/127.20.83.195@KRBTEST.COM (short username kudu)
08:08:11.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.437831 21444 webserver.cc:533] Webserver started at http://127.20.83.195:37715/ using document root <none> and password file <none>
08:08:11.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.438946 21444 fs_manager.cc:362] Metadata directory not provided
08:08:11.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.439218 21444 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:08:11.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.439690 21444 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:08:11.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.443835 21444 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-2/data/instance:
08:08:11.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "09d9db8ceded4089a158702d3aeae88f"
08:08:11.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-09-27 08:08:11 on dist-test-slave-6f13"
08:08:11.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.445029 21444 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-2/wal/instance:
08:08:11.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "09d9db8ceded4089a158702d3aeae88f"
08:08:11.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-09-27 08:08:11 on dist-test-slave-6f13"
08:08:11.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.453384 21444 fs_manager.cc:696] Time spent creating directory manager: real 0.008s user 0.005s sys 0.001s
08:08:11.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.458663 21465 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
08:08:11.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.459712 21444 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.000s sys 0.005s
08:08:11.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.460021 21444 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-2/data,/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-2/wal
08:08:11.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "09d9db8ceded4089a158702d3aeae88f"
08:08:11.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-09-27 08:08:11 on dist-test-slave-6f13"
08:08:11.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.460317 21444 fs_report.cc:389] FS layout report
08:08:11.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:08:11.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-2/wal
08:08:11.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-2/wal
08:08:11.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-2/data/data
08:08:11.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:08:11.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:08:11.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:08:11.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:08:11.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:08:11.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:08:11.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:08:11.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:08:11.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:08:11.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:08:11.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:08:11.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.534790 21444 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
08:08:11.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.540182 21444 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:08:11.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.540582 21444 kserver.cc:163] Server-wide thread pool size limit: 3276
08:08:11.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.543219 21444 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:08:11.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.547399 21444 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:08:11.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.547608 21444 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
08:08:11.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.547888 21444 ts_tablet_manager.cc:616] Registered 0 tablets
08:08:11.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.548059 21444 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
08:08:11.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.676169 21444 rpc_server.cc:307] RPC server started. Bound to: 127.20.83.195:36287
08:08:11.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.676283 21577 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.20.83.195:36287 every 8 connection(s)
08:08:11.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.678691 21444 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-2/data/info.pb
08:08:11.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.683204 20815 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskoj2_XN/build/tsan/bin/kudu as pid 21444
08:08:11.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.683692 20815 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/ts-2/wal/instance
08:08:11.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:08:11 dist-test-slave-6f13 krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790496491, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.83.195@KRBTEST.COM for kudu/127.20.83.252@KRBTEST.COM
08:08:11.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:08:11 dist-test-slave-6f13 krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790496491, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.83.195@KRBTEST.COM for kudu/127.20.83.253@KRBTEST.COM
08:08:11.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:08:11 dist-test-slave-6f13 krb5kdc[20826](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790496491, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.83.195@KRBTEST.COM for kudu/127.20.83.254@KRBTEST.COM
08:08:11.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.747885 21578 heartbeater.cc:344] Connected to a master server at 127.20.83.252:44501
08:08:11.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.748337 21578 heartbeater.cc:461] Registering TS with master...
08:08:11.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.749709 21578 heartbeater.cc:507] Master 127.20.83.252:44501 requested a full tablet report, sending...
08:08:11.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.751336 21579 heartbeater.cc:344] Connected to a master server at 127.20.83.253:40403
08:08:11.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.751677 21579 heartbeater.cc:461] Registering TS with master...
08:08:11.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.752501 21579 heartbeater.cc:507] Master 127.20.83.253:40403 requested a full tablet report, sending...
08:08:11.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.754613 21580 heartbeater.cc:344] Connected to a master server at 127.20.83.254:35719
08:08:11.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.754597 21041 ts_manager.cc:194] Registered new tserver with Master: 09d9db8ceded4089a158702d3aeae88f (127.20.83.195:36287)
08:08:11.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.754854 21580 heartbeater.cc:461] Registering TS with master...
08:08:11.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.755499 21580 heartbeater.cc:507] Master 127.20.83.254:35719 requested a full tablet report, sending...
08:08:11.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.755460 20956 ts_manager.cc:194] Registered new tserver with Master: 09d9db8ceded4089a158702d3aeae88f (127.20.83.195:36287)
08:08:11.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.756227 21041 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.83.195@KRBTEST.COM'} at 127.20.83.195:47941
08:08:11.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.757731 20876 ts_manager.cc:194] Registered new tserver with Master: 09d9db8ceded4089a158702d3aeae88f (127.20.83.195:36287)
08:08:11.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.774834 20815 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
08:08:11.786 [DEBUG - main] (MiniKuduCluster.java:195) Response:
08:08:11.786 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_kdc_env_vars {
}
08:08:11.787 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_kdc_env_vars {
env_vars {
key: "KRB5CCNAME"
value: "/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/krb5cc"
}
env_vars {
key: "KRB5_CONFIG"
value: "/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/krb5.conf"
}
env_vars {
key: "KRB5_KDC_PROFILE"
value: "/tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/kdc.conf"
}
env_vars {
key: "KUDU_ENABLE_KRB5_REALM_FIX"
value: "yes"
}
}
08:08:11.787 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}
08:08:11.788 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
masters {
id {
type: MASTER
index: 0
}
bound_rpc_address {
host: "127.20.83.254"
port: 35719
}
bound_http_address {
host: "127.20.83.254"
port: 42747
}
}
masters {
id {
type: MASTER
index: 1
}
bound_rpc_address {
host: "127.20.83.253"
port: 40403
}
bound_http_address {
host: "127.20.83.253"
port: 33809
}
}
masters {
id {
type: MASTER
index: 2
}
bound_rpc_address {
host: "127.20.83.252"
port: 44501
}
bound_http_address {
host: "127.20.83.252"
port: 40317
}
}
}
08:08:11.788 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}
08:08:11.788 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
tservers {
id {
type: TSERVER
index: 0
}
bound_rpc_address {
host: "127.20.83.193"
port: 37463
}
bound_http_address {
host: "127.20.83.193"
port: 45563
}
}
tservers {
id {
type: TSERVER
index: 1
}
bound_rpc_address {
host: "127.20.83.194"
port: 33397
}
bound_http_address {
host: "127.20.83.194"
port: 37933
}
}
tservers {
id {
type: TSERVER
index: 2
}
bound_rpc_address {
host: "127.20.83.195"
port: 36287
}
bound_http_address {
host: "127.20.83.195"
port: 37715
}
}
}
08:08:11.788 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
08:08:11.790 [DEBUG - main] (SecurityUtil.java:105) Using ticketCache: /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/krb5cc
08:08:11.791 [DEBUG - main] (SecurityUtil.java:119) Logged in as subject: test-admin@KRBTEST.COM
08:08:11.792 [DEBUG - main] (Connection.java:748) [peer master-127.20.83.253:40403(127.20.83.253:40403)] connecting to peer
08:08:11.793 [DEBUG - main] (Connection.java:748) [peer master-127.20.83.254:35719(127.20.83.254:35719)] connecting to peer
08:08:11.793 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.83.253:40403(127.20.83.253:40403)] Successfully connected to peer
08:08:11.794 [DEBUG - main] (Connection.java:748) [peer master-127.20.83.252:44501(127.20.83.252:44501)] connecting to peer
08:08:11.795 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.20.83.252:44501(127.20.83.252:44501)] Successfully connected to peer
08:08:11.797 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.83.254:35719(127.20.83.254:35719)] Successfully connected to peer
08:08:11.799 [DEBUG - kudu-nio-2] (Negotiator.java:528) SASL mechanism GSSAPI chosen for peer 127.20.83.252
08:08:11.800 [DEBUG - kudu-nio-0] (Negotiator.java:528) SASL mechanism GSSAPI chosen for peer 127.20.83.253
08:08:11.800 [DEBUG - kudu-nio-1] (Negotiator.java:528) SASL mechanism GSSAPI chosen for peer 127.20.83.254
08:08:11.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:08:11 dist-test-slave-6f13 krb5kdc[20826](info): TGS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790496477, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.83.254@KRBTEST.COM
08:08:11.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:08:11 dist-test-slave-6f13 krb5kdc[20826](info): TGS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790496477, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.83.253@KRBTEST.COM
08:08:11.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:08:11 dist-test-slave-6f13 krb5kdc[20826](info): TGS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790496477, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.83.252@KRBTEST.COM
08:08:11.827 [DEBUG - kudu-nio-1] (Negotiator.java:918) Authenticated connection [id: 0xd219549e, L:/127.0.0.1:55100 - R:/127.20.83.254:35719] using SASL/GSSAPI
08:08:11.834 [DEBUG - kudu-nio-0] (Negotiator.java:918) Authenticated connection [id: 0x6d4dfa57, L:/127.0.0.1:45808 - R:/127.20.83.253:40403] using SASL/GSSAPI
08:08:11.835 [DEBUG - kudu-nio-2] (Negotiator.java:918) Authenticated connection [id: 0x572bfe6d, L:/127.0.0.1:46056 - R:/127.20.83.252:44501] using SASL/GSSAPI
08:08:11.839 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:08:11.839 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=48), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.83.253:40403, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.83.254:35719, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.83.252:44501, [38ms] Sub RPC ConnectToMaster: received response from server master-127.20.83.254:35719: OK, [46ms] Sub RPC ConnectToMaster: received response from server master-127.20.83.253:40403: OK, [47ms] Sub RPC ConnectToMaster: received response from server master-127.20.83.252:44501: OK, deferred=null) after lookup
08:08:11.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.841780 21041 catalog_manager.cc:2296] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46056:
08:08:11.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "TestScanToken"
08:08:11.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
08:08:11.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) columns {
08:08:11.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "key"
08:08:11.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) type: INT32
08:08:11.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) is_key: true
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) is_nullable: false
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) cfile_block_size: 0
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) immutable: false
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) is_auto_incrementing: false
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) columns {
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "column1_i"
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) type: INT32
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) is_key: false
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) is_nullable: false
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) cfile_block_size: 0
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) immutable: false
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) is_auto_incrementing: false
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) columns {
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "column2_i"
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) type: INT32
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) is_key: false
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) is_nullable: false
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) cfile_block_size: 0
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) immutable: false
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) is_auto_incrementing: false
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) columns {
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "column3_s"
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) type: STRING
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) is_key: false
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) is_nullable: true
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) encoding: DICT_ENCODING
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) compression: LZ4
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) cfile_block_size: 4096
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) immutable: false
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) is_auto_incrementing: false
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) columns {
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "column4_b"
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) type: BOOL
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) is_key: false
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) is_nullable: false
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) cfile_block_size: 0
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) immutable: false
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) is_auto_incrementing: false
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) num_replicas: 3
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) range_schema {
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:08:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:08:11.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:11.844748 21041 catalog_manager.cc:7226] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestScanToken in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
08:08:11.872 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 5d00bb5cbde24fa7a6bda47f170a6db5
08:08:11.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.917554 21220 tablet_service.cc:1511] Processing CreateTablet for tablet 01b184ec05ec4f2e818c26e78465a78d (DEFAULT_TABLE table=TestScanToken [id=5d00bb5cbde24fa7a6bda47f170a6db5]), partition=
08:08:11.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.918171 21365 tablet_service.cc:1511] Processing CreateTablet for tablet 01b184ec05ec4f2e818c26e78465a78d (DEFAULT_TABLE table=TestScanToken [id=5d00bb5cbde24fa7a6bda47f170a6db5]), partition=
08:08:11.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.919051 21220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01b184ec05ec4f2e818c26e78465a78d. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:11.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.919636 21365 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01b184ec05ec4f2e818c26e78465a78d. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:11.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.919713 21513 tablet_service.cc:1511] Processing CreateTablet for tablet 01b184ec05ec4f2e818c26e78465a78d (DEFAULT_TABLE table=TestScanToken [id=5d00bb5cbde24fa7a6bda47f170a6db5]), partition=
08:08:11.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.921084 21513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01b184ec05ec4f2e818c26e78465a78d. 1 dirs total, 0 dirs full, 0 dirs failed
08:08:11.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.952066 21610 tablet_bootstrap.cc:492] T 01b184ec05ec4f2e818c26e78465a78d P 823ed75fe4bd49aeb034d3c15b959fd1: Bootstrap starting.
08:08:11.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.953611 21612 tablet_bootstrap.cc:492] T 01b184ec05ec4f2e818c26e78465a78d P 09d9db8ceded4089a158702d3aeae88f: Bootstrap starting.
08:08:11.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.961786 21611 tablet_bootstrap.cc:492] T 01b184ec05ec4f2e818c26e78465a78d P ebc3bfd70d664520aa14fb6683962462: Bootstrap starting.
08:08:11.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.963587 21612 tablet_bootstrap.cc:654] T 01b184ec05ec4f2e818c26e78465a78d P 09d9db8ceded4089a158702d3aeae88f: Neither blocks nor log segments found. Creating new log.
08:08:11.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.964612 21610 tablet_bootstrap.cc:654] T 01b184ec05ec4f2e818c26e78465a78d P 823ed75fe4bd49aeb034d3c15b959fd1: Neither blocks nor log segments found. Creating new log.
08:08:11.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.965339 21612 log.cc:826] T 01b184ec05ec4f2e818c26e78465a78d P 09d9db8ceded4089a158702d3aeae88f: Log is configured to *not* fsync() on all Append() calls
08:08:11.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.966949 21610 log.cc:826] T 01b184ec05ec4f2e818c26e78465a78d P 823ed75fe4bd49aeb034d3c15b959fd1: Log is configured to *not* fsync() on all Append() calls
08:08:11.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.968997 21611 tablet_bootstrap.cc:654] T 01b184ec05ec4f2e818c26e78465a78d P ebc3bfd70d664520aa14fb6683962462: Neither blocks nor log segments found. Creating new log.
08:08:11.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.970050 21612 tablet_bootstrap.cc:492] T 01b184ec05ec4f2e818c26e78465a78d P 09d9db8ceded4089a158702d3aeae88f: No bootstrap required, opened a new log
08:08:11.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.970476 21612 ts_tablet_manager.cc:1403] T 01b184ec05ec4f2e818c26e78465a78d P 09d9db8ceded4089a158702d3aeae88f: Time spent bootstrapping tablet: real 0.017s user 0.009s sys 0.004s
08:08:11.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.971462 21611 log.cc:826] T 01b184ec05ec4f2e818c26e78465a78d P ebc3bfd70d664520aa14fb6683962462: Log is configured to *not* fsync() on all Append() calls
08:08:11.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.977450 21611 tablet_bootstrap.cc:492] T 01b184ec05ec4f2e818c26e78465a78d P ebc3bfd70d664520aa14fb6683962462: No bootstrap required, opened a new log
08:08:11.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.978027 21611 ts_tablet_manager.cc:1403] T 01b184ec05ec4f2e818c26e78465a78d P ebc3bfd70d664520aa14fb6683962462: Time spent bootstrapping tablet: real 0.017s user 0.012s sys 0.003s
08:08:11.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.981459 21610 tablet_bootstrap.cc:492] T 01b184ec05ec4f2e818c26e78465a78d P 823ed75fe4bd49aeb034d3c15b959fd1: No bootstrap required, opened a new log
08:08:11.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.982018 21610 ts_tablet_manager.cc:1403] T 01b184ec05ec4f2e818c26e78465a78d P 823ed75fe4bd49aeb034d3c15b959fd1: Time spent bootstrapping tablet: real 0.030s user 0.023s sys 0.000s
08:08:11.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.996563 21611 raft_consensus.cc:359] T 01b184ec05ec4f2e818c26e78465a78d P ebc3bfd70d664520aa14fb6683962462 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "823ed75fe4bd49aeb034d3c15b959fd1" member_type: VOTER last_known_addr { host: "127.20.83.193" port: 37463 } } peers { permanent_uuid: "ebc3bfd70d664520aa14fb6683962462" member_type: VOTER last_known_addr { host: "127.20.83.194" port: 33397 } } peers { permanent_uuid: "09d9db8ceded4089a158702d3aeae88f" member_type: VOTER last_known_addr { host: "127.20.83.195" port: 36287 } }
08:08:11.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.997257 21611 raft_consensus.cc:385] T 01b184ec05ec4f2e818c26e78465a78d P ebc3bfd70d664520aa14fb6683962462 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:11.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.997632 21611 raft_consensus.cc:740] T 01b184ec05ec4f2e818c26e78465a78d P ebc3bfd70d664520aa14fb6683962462 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebc3bfd70d664520aa14fb6683962462, State: Initialized, Role: FOLLOWER
08:08:11.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.997432 21612 raft_consensus.cc:359] T 01b184ec05ec4f2e818c26e78465a78d P 09d9db8ceded4089a158702d3aeae88f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "823ed75fe4bd49aeb034d3c15b959fd1" member_type: VOTER last_known_addr { host: "127.20.83.193" port: 37463 } } peers { permanent_uuid: "ebc3bfd70d664520aa14fb6683962462" member_type: VOTER last_known_addr { host: "127.20.83.194" port: 33397 } } peers { permanent_uuid: "09d9db8ceded4089a158702d3aeae88f" member_type: VOTER last_known_addr { host: "127.20.83.195" port: 36287 } }
08:08:11.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.998368 21612 raft_consensus.cc:385] T 01b184ec05ec4f2e818c26e78465a78d P 09d9db8ceded4089a158702d3aeae88f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:11.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.998687 21612 raft_consensus.cc:740] T 01b184ec05ec4f2e818c26e78465a78d P 09d9db8ceded4089a158702d3aeae88f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09d9db8ceded4089a158702d3aeae88f, State: Initialized, Role: FOLLOWER
08:08:11.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.998529 21611 consensus_queue.cc:260] T 01b184ec05ec4f2e818c26e78465a78d P ebc3bfd70d664520aa14fb6683962462 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "823ed75fe4bd49aeb034d3c15b959fd1" member_type: VOTER last_known_addr { host: "127.20.83.193" port: 37463 } } peers { permanent_uuid: "ebc3bfd70d664520aa14fb6683962462" member_type: VOTER last_known_addr { host: "127.20.83.194" port: 33397 } } peers { permanent_uuid: "09d9db8ceded4089a158702d3aeae88f" member_type: VOTER last_known_addr { host: "127.20.83.195" port: 36287 } }
08:08:12.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:11.999595 21612 consensus_queue.cc:260] T 01b184ec05ec4f2e818c26e78465a78d P 09d9db8ceded4089a158702d3aeae88f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "823ed75fe4bd49aeb034d3c15b959fd1" member_type: VOTER last_known_addr { host: "127.20.83.193" port: 37463 } } peers { permanent_uuid: "ebc3bfd70d664520aa14fb6683962462" member_type: VOTER last_known_addr { host: "127.20.83.194" port: 33397 } } peers { permanent_uuid: "09d9db8ceded4089a158702d3aeae88f" member_type: VOTER last_known_addr { host: "127.20.83.195" port: 36287 } }
08:08:12.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.002321 21611 ts_tablet_manager.cc:1434] T 01b184ec05ec4f2e818c26e78465a78d P ebc3bfd70d664520aa14fb6683962462: Time spent starting tablet: real 0.024s user 0.019s sys 0.004s
08:08:12.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.009508 21610 raft_consensus.cc:359] T 01b184ec05ec4f2e818c26e78465a78d P 823ed75fe4bd49aeb034d3c15b959fd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "823ed75fe4bd49aeb034d3c15b959fd1" member_type: VOTER last_known_addr { host: "127.20.83.193" port: 37463 } } peers { permanent_uuid: "ebc3bfd70d664520aa14fb6683962462" member_type: VOTER last_known_addr { host: "127.20.83.194" port: 33397 } } peers { permanent_uuid: "09d9db8ceded4089a158702d3aeae88f" member_type: VOTER last_known_addr { host: "127.20.83.195" port: 36287 } }
08:08:12.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.010406 21610 raft_consensus.cc:385] T 01b184ec05ec4f2e818c26e78465a78d P 823ed75fe4bd49aeb034d3c15b959fd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:08:12.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.010701 21610 raft_consensus.cc:740] T 01b184ec05ec4f2e818c26e78465a78d P 823ed75fe4bd49aeb034d3c15b959fd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 823ed75fe4bd49aeb034d3c15b959fd1, State: Initialized, Role: FOLLOWER
08:08:12.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.011974 21610 consensus_queue.cc:260] T 01b184ec05ec4f2e818c26e78465a78d P 823ed75fe4bd49aeb034d3c15b959fd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "823ed75fe4bd49aeb034d3c15b959fd1" member_type: VOTER last_known_addr { host: "127.20.83.193" port: 37463 } } peers { permanent_uuid: "ebc3bfd70d664520aa14fb6683962462" member_type: VOTER last_known_addr { host: "127.20.83.194" port: 33397 } } peers { permanent_uuid: "09d9db8ceded4089a158702d3aeae88f" member_type: VOTER last_known_addr { host: "127.20.83.195" port: 36287 } }
08:08:12.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.019177 21578 heartbeater.cc:499] Master 127.20.83.252:44501 was elected leader, sending a full tablet report...
08:08:12.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.020753 21612 ts_tablet_manager.cc:1434] T 01b184ec05ec4f2e818c26e78465a78d P 09d9db8ceded4089a158702d3aeae88f: Time spent starting tablet: real 0.050s user 0.026s sys 0.010s
08:08:12.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.023628 21610 ts_tablet_manager.cc:1434] T 01b184ec05ec4f2e818c26e78465a78d P 823ed75fe4bd49aeb034d3c15b959fd1: Time spent starting tablet: real 0.041s user 0.025s sys 0.010s
08:08:12.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:12.063699 21292 tablet.cc:2433] T 01b184ec05ec4f2e818c26e78465a78d P 823ed75fe4bd49aeb034d3c15b959fd1: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:08:12.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.115268 21618 raft_consensus.cc:493] T 01b184ec05ec4f2e818c26e78465a78d P 823ed75fe4bd49aeb034d3c15b959fd1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:08:12.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.115767 21618 raft_consensus.cc:515] T 01b184ec05ec4f2e818c26e78465a78d P 823ed75fe4bd49aeb034d3c15b959fd1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "823ed75fe4bd49aeb034d3c15b959fd1" member_type: VOTER last_known_addr { host: "127.20.83.193" port: 37463 } } peers { permanent_uuid: "ebc3bfd70d664520aa14fb6683962462" member_type: VOTER last_known_addr { host: "127.20.83.194" port: 33397 } } peers { permanent_uuid: "09d9db8ceded4089a158702d3aeae88f" member_type: VOTER last_known_addr { host: "127.20.83.195" port: 36287 } }
08:08:12.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.118364 21618 leader_election.cc:290] T 01b184ec05ec4f2e818c26e78465a78d P 823ed75fe4bd49aeb034d3c15b959fd1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ebc3bfd70d664520aa14fb6683962462 (127.20.83.194:33397), 09d9db8ceded4089a158702d3aeae88f (127.20.83.195:36287)
08:08:12.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:12.125460 21437 tablet.cc:2433] T 01b184ec05ec4f2e818c26e78465a78d P ebc3bfd70d664520aa14fb6683962462: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:08:12.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.129595 21385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b184ec05ec4f2e818c26e78465a78d" candidate_uuid: "823ed75fe4bd49aeb034d3c15b959fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebc3bfd70d664520aa14fb6683962462" is_pre_election: true
08:08:12.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.130402 21385 raft_consensus.cc:2468] T 01b184ec05ec4f2e818c26e78465a78d P ebc3bfd70d664520aa14fb6683962462 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 823ed75fe4bd49aeb034d3c15b959fd1 in term 0.
08:08:12.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.131357 21533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b184ec05ec4f2e818c26e78465a78d" candidate_uuid: "823ed75fe4bd49aeb034d3c15b959fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09d9db8ceded4089a158702d3aeae88f" is_pre_election: true
08:08:12.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.131832 21173 leader_election.cc:304] T 01b184ec05ec4f2e818c26e78465a78d P 823ed75fe4bd49aeb034d3c15b959fd1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 823ed75fe4bd49aeb034d3c15b959fd1, ebc3bfd70d664520aa14fb6683962462; no voters:
08:08:12.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.132200 21533 raft_consensus.cc:2468] T 01b184ec05ec4f2e818c26e78465a78d P 09d9db8ceded4089a158702d3aeae88f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 823ed75fe4bd49aeb034d3c15b959fd1 in term 0.
08:08:12.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.132669 21618 raft_consensus.cc:2804] T 01b184ec05ec4f2e818c26e78465a78d P 823ed75fe4bd49aeb034d3c15b959fd1 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:08:12.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.132956 21618 raft_consensus.cc:493] T 01b184ec05ec4f2e818c26e78465a78d P 823ed75fe4bd49aeb034d3c15b959fd1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:08:12.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.133232 21618 raft_consensus.cc:3060] T 01b184ec05ec4f2e818c26e78465a78d P 823ed75fe4bd49aeb034d3c15b959fd1 [term 0 FOLLOWER]: Advancing to term 1
08:08:12.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.137521 21618 raft_consensus.cc:515] T 01b184ec05ec4f2e818c26e78465a78d P 823ed75fe4bd49aeb034d3c15b959fd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "823ed75fe4bd49aeb034d3c15b959fd1" member_type: VOTER last_known_addr { host: "127.20.83.193" port: 37463 } } peers { permanent_uuid: "ebc3bfd70d664520aa14fb6683962462" member_type: VOTER last_known_addr { host: "127.20.83.194" port: 33397 } } peers { permanent_uuid: "09d9db8ceded4089a158702d3aeae88f" member_type: VOTER last_known_addr { host: "127.20.83.195" port: 36287 } }
08:08:12.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.139071 21618 leader_election.cc:290] T 01b184ec05ec4f2e818c26e78465a78d P 823ed75fe4bd49aeb034d3c15b959fd1 [CANDIDATE]: Term 1 election: Requested vote from peers ebc3bfd70d664520aa14fb6683962462 (127.20.83.194:33397), 09d9db8ceded4089a158702d3aeae88f (127.20.83.195:36287)
08:08:12.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.140074 21385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b184ec05ec4f2e818c26e78465a78d" candidate_uuid: "823ed75fe4bd49aeb034d3c15b959fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebc3bfd70d664520aa14fb6683962462"
08:08:12.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.140447 21533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01b184ec05ec4f2e818c26e78465a78d" candidate_uuid: "823ed75fe4bd49aeb034d3c15b959fd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09d9db8ceded4089a158702d3aeae88f"
08:08:12.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.140604 21385 raft_consensus.cc:3060] T 01b184ec05ec4f2e818c26e78465a78d P ebc3bfd70d664520aa14fb6683962462 [term 0 FOLLOWER]: Advancing to term 1
08:08:12.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.140863 21533 raft_consensus.cc:3060] T 01b184ec05ec4f2e818c26e78465a78d P 09d9db8ceded4089a158702d3aeae88f [term 0 FOLLOWER]: Advancing to term 1
08:08:12.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.144989 21385 raft_consensus.cc:2468] T 01b184ec05ec4f2e818c26e78465a78d P ebc3bfd70d664520aa14fb6683962462 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 823ed75fe4bd49aeb034d3c15b959fd1 in term 1.
08:08:12.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.145224 21533 raft_consensus.cc:2468] T 01b184ec05ec4f2e818c26e78465a78d P 09d9db8ceded4089a158702d3aeae88f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 823ed75fe4bd49aeb034d3c15b959fd1 in term 1.
08:08:12.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.146103 21173 leader_election.cc:304] T 01b184ec05ec4f2e818c26e78465a78d P 823ed75fe4bd49aeb034d3c15b959fd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 823ed75fe4bd49aeb034d3c15b959fd1, ebc3bfd70d664520aa14fb6683962462; no voters:
08:08:12.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.146744 21618 raft_consensus.cc:2804] T 01b184ec05ec4f2e818c26e78465a78d P 823ed75fe4bd49aeb034d3c15b959fd1 [term 1 FOLLOWER]: Leader election won for term 1
08:08:12.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.148250 21618 raft_consensus.cc:697] T 01b184ec05ec4f2e818c26e78465a78d P 823ed75fe4bd49aeb034d3c15b959fd1 [term 1 LEADER]: Becoming Leader. State: Replica: 823ed75fe4bd49aeb034d3c15b959fd1, State: Running, Role: LEADER
08:08:12.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.149128 21618 consensus_queue.cc:237] T 01b184ec05ec4f2e818c26e78465a78d P 823ed75fe4bd49aeb034d3c15b959fd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "823ed75fe4bd49aeb034d3c15b959fd1" member_type: VOTER last_known_addr { host: "127.20.83.193" port: 37463 } } peers { permanent_uuid: "ebc3bfd70d664520aa14fb6683962462" member_type: VOTER last_known_addr { host: "127.20.83.194" port: 33397 } } peers { permanent_uuid: "09d9db8ceded4089a158702d3aeae88f" member_type: VOTER last_known_addr { host: "127.20.83.195" port: 36287 } }
08:08:12.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.161211 21039 catalog_manager.cc:5838] T 01b184ec05ec4f2e818c26e78465a78d P 823ed75fe4bd49aeb034d3c15b959fd1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 823ed75fe4bd49aeb034d3c15b959fd1 (127.20.83.193). New cstate: current_term: 1 leader_uuid: "823ed75fe4bd49aeb034d3c15b959fd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "823ed75fe4bd49aeb034d3c15b959fd1" member_type: VOTER last_known_addr { host: "127.20.83.193" port: 37463 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ebc3bfd70d664520aa14fb6683962462" member_type: VOTER last_known_addr { host: "127.20.83.194" port: 33397 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09d9db8ceded4089a158702d3aeae88f" member_type: VOTER last_known_addr { host: "127.20.83.195" port: 36287 } health_report { overall_health: UNKNOWN } } }
08:08:12.198 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 01b184ec05ec4f2e818c26e78465a78d for table 'TestScanToken' with partition [<start>, <end>)
08:08:12.198 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=01b184ec05ec4f2e818c26e78465a78d@[09d9db8ceded4089a158702d3aeae88f(127.20.83.195:36287),823ed75fe4bd49aeb034d3c15b959fd1(127.20.83.193:37463)[L],ebc3bfd70d664520aa14fb6683962462(127.20.83.194:33397)]}]
08:08:12.198 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=3), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.20.83.252:44501, [3ms] Sub RPC GetTableLocations: received response from server master-127.20.83.252:44501: OK, deferred=null) after lookup
08:08:12.198 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 823ed75fe4bd49aeb034d3c15b959fd1(127.20.83.193:37463)] connecting to peer
08:08:12.199 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 823ed75fe4bd49aeb034d3c15b959fd1(127.20.83.193:37463)] Successfully connected to peer
08:08:12.211 [DEBUG - kudu-nio-3] (Negotiator.java:918) Authenticated connection [id: 0x7c36bdde, L:/127.0.0.1:39066 - R:/127.20.83.193:37463] using TOKEN/null
08:08:12.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260927 08:08:12.212350 21585 tablet.cc:2433] T 01b184ec05ec4f2e818c26e78465a78d P 09d9db8ceded4089a158702d3aeae88f: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:08:12.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.224465 21533 raft_consensus.cc:1275] T 01b184ec05ec4f2e818c26e78465a78d P 09d9db8ceded4089a158702d3aeae88f [term 1 FOLLOWER]: Refusing update from remote peer 823ed75fe4bd49aeb034d3c15b959fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:08:12.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.224843 21385 raft_consensus.cc:1275] T 01b184ec05ec4f2e818c26e78465a78d P ebc3bfd70d664520aa14fb6683962462 [term 1 FOLLOWER]: Refusing update from remote peer 823ed75fe4bd49aeb034d3c15b959fd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:08:12.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.226181 21621 consensus_queue.cc:1048] T 01b184ec05ec4f2e818c26e78465a78d P 823ed75fe4bd49aeb034d3c15b959fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09d9db8ceded4089a158702d3aeae88f" member_type: VOTER last_known_addr { host: "127.20.83.195" port: 36287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:08:12.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.226800 21618 consensus_queue.cc:1048] T 01b184ec05ec4f2e818c26e78465a78d P 823ed75fe4bd49aeb034d3c15b959fd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ebc3bfd70d664520aa14fb6683962462" member_type: VOTER last_known_addr { host: "127.20.83.194" port: 33397 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:08:12.265 [DEBUG - main] (SecurityUtil.java:105) Using ticketCache: /tmp/dist-test-taskoj2_XN/test-tmp/mini-kudu-cluster4355878307930118130/krb5kdc/krb5cc
08:08:12.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.265198 21624 mvcc.cc:204] Tried to move back new op lower bound from 7333873632134340608 to 7333873631850385408. Current Snapshot: MvccSnapshot[applied={T|T < 7333873632134340608 or (T in {7333873632134340608})}]
08:08:12.267 [DEBUG - main] (SecurityUtil.java:119) Logged in as subject: test-admin@KRBTEST.COM
08:08:12.267 [DEBUG - main] (TableLocationsCache.java:192) Discovered table locations: [Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299932, tablet=01b184ec05ec4f2e818c26e78465a78d@[09d9db8ceded4089a158702d3aeae88f(127.20.83.195:36287)[L],823ed75fe4bd49aeb034d3c15b959fd1(127.20.83.193:37463)]}]
08:08:12.271 [DEBUG - main] (Connection.java:748) [peer 09d9db8ceded4089a158702d3aeae88f(127.20.83.195:36287)] connecting to peer
08:08:12.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.276674 21625 mvcc.cc:204] Tried to move back new op lower bound from 7333873632134340608 to 7333873631850385408. Current Snapshot: MvccSnapshot[applied={T|T < 7333873632134340608}]
08:08:12.292 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 09d9db8ceded4089a158702d3aeae88f(127.20.83.195:36287)] Successfully connected to peer
08:08:12.294 [DEBUG - kudu-nio-0] (Negotiator.java:528) SASL mechanism GSSAPI chosen for peer 127.20.83.195
08:08:12.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Sep 27 08:08:12 dist-test-slave-6f13 krb5kdc[20826](info): TGS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790496477, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.83.195@KRBTEST.COM
08:08:12.338 [DEBUG - kudu-nio-0] (Negotiator.java:918) Authenticated connection [id: 0x4dc56ea7, L:/127.0.0.1:49962 - R:/127.20.83.195:36287] using SASL/GSSAPI
08:08:12.486 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestScanToken, tablet=01b184ec05ec4f2e818c26e78465a78d, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:08:12.487 [DEBUG - main] (Connection.java:575) [peer master-127.20.83.254:35719(127.20.83.254:35719)] disconnecting while in state READY
08:08:12.487 [DEBUG - main] (Connection.java:575) [peer master-127.20.83.253:40403(127.20.83.253:40403)] disconnecting while in state READY
08:08:12.487 [DEBUG - main] (Connection.java:575) [peer master-127.20.83.252:44501(127.20.83.252:44501)] disconnecting while in state READY
08:08:12.487 [DEBUG - main] (Connection.java:575) [peer 823ed75fe4bd49aeb034d3c15b959fd1(127.20.83.193:37463)] disconnecting while in state READY
08:08:12.488 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 823ed75fe4bd49aeb034d3c15b959fd1(127.20.83.193:37463)] handling channelInactive
08:08:12.488 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 823ed75fe4bd49aeb034d3c15b959fd1(127.20.83.193:37463)] cleaning up while in state READY due to: connection closed
08:08:12.489 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.83.254:35719(127.20.83.254:35719)] handling channelInactive
08:08:12.489 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.83.254:35719(127.20.83.254:35719)] cleaning up while in state READY due to: connection closed
08:08:12.490 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.20.83.252:44501(127.20.83.252:44501)] handling channelInactive
08:08:12.490 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.20.83.252:44501(127.20.83.252:44501)] cleaning up while in state READY due to: connection closed
08:08:12.490 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:08:12.492 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.83.253:40403(127.20.83.253:40403)] handling channelInactive
08:08:12.492 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.83.253:40403(127.20.83.253:40403)] cleaning up while in state READY due to: connection closed
08:08:12.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.492666 20815 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskoj2_XN/build/tsan/bin/kudu with pid 21147
08:08:12.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.527372 20815 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskoj2_XN/build/tsan/bin/kudu with pid 21299
08:08:12.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.566000 20815 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskoj2_XN/build/tsan/bin/kudu with pid 21444
08:08:12.587 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 09d9db8ceded4089a158702d3aeae88f(127.20.83.195:36287)] handling channelInactive
08:08:12.588 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 09d9db8ceded4089a158702d3aeae88f(127.20.83.195:36287)] cleaning up while in state READY due to: connection closed
08:08:12.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.588279 20815 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskoj2_XN/build/tsan/bin/kudu with pid 20842
08:08:12.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.618026 20815 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskoj2_XN/build/tsan/bin/kudu with pid 20920
08:08:12.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260927 08:08:12.642009 20815 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskoj2_XN/build/tsan/bin/kudu with pid 21001
08:08:13.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-09-27T08:08:13Z chronyd exiting
08:08:14.781 [ERROR - main] (RetryRule.java:206) org.apache.kudu.client.TestScanToken.testBuildTokensWithDownTabletServer: failed attempt 1
java.lang.AssertionError: expected:<1> but was:<0>
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.failNotEquals(Assert.java:835)
at org.junit.Assert.assertEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:633)
at org.apache.kudu.client.TestScanToken.testBuildTokensWithDownTabletServer(TestScanToken.java:920)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:569)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
at org.junit.runners.Suite.runChild(Suite.java:128)
at org.junit.runners.Suite.runChild(Suite.java:27)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
java.lang.AssertionError: expected:<1> but was:<0>
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.failNotEquals(Assert.java:835)
at org.junit.Assert.assertEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:633)
at org.apache.kudu.client.TestScanToken.testBuildTokensWithDownTabletServer(TestScanToken.java:920)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77)
at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.base/java.lang.reflect.Method.invoke(Method.java:569)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:54)
at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
at org.junit.runners.Suite.runChild(Suite.java:128)
at org.junit.runners.Suite.runChild(Suite.java:27)
at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
at org.junit.runner.JUnitCore.main(JUnitCore.java:36)