19:18:45.340 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
19:18:45.340 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskHiEzcr/test-tmp
19:18:45.340 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
19:18:45.340 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskHiEzcr/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
19:18:45.342 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
num_masters: 3
num_tservers: 3
enable_kerberos: false
cluster_root: "/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469"
hms_mode: NONE
mini_kdc_options {
}
principal: "kudu"
mini_oidc_options {
}
}
19:18:45.691 [DEBUG - main] (MiniKuduCluster.java:195) Response:
19:18:45.691 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}
19:18:45.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:45.694967 20598 mini_oidc.cc:152] Starting JWKS server
19:18:45.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:45.698813 20598 webserver.cc:460] Webserver started at http://127.0.0.1:36605/ using document root <none> and password file <none>
19:18:45.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:45.699337 20598 mini_oidc.cc:189] Starting OIDC Discovery server
19:18:45.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:45.701283 20598 webserver.cc:460] Webserver started at http://127.0.0.1:35617/ using document root <none> and password file <none>
19:18:45.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-08-08T19:18:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
19:18:45.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-08-08T19:18:45Z Disabled control of system clock
19:18:45.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:45.758424 20598 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu
19:18:45.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu
19:18:45.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-0/wal
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-0/data
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-0/logs
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-0/data/info.pb
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.29.190:32997
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.29.190
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.29.148:42177
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.29.190:32997,127.20.29.189:38617,127.20.29.188:41149
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
19:18:45.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36605/jwks.json with env {}
19:18:46.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:46.072937 20610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
19:18:46.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:46.073513 20610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
19:18:46.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:46.073995 20610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
19:18:46.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:46.105430 20610 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
19:18:46.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:46.105733 20610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
19:18:46.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:46.105969 20610 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
19:18:46.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:46.106168 20610 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
19:18:46.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:46.106353 20610 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
19:18:46.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:46.106520 20610 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:36605/jwks.json
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:46.143580 20610 master_runner.cc:386] Master server non-default flags:
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.29.148:42177
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-0/data
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-0/wal
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.29.190:32997,127.20.29.189:38617,127.20.29.188:41149
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.29.190:32997
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36605/jwks.json
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-0/data/info.pb
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.29.190
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-0/logs
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Aug 2026 17:52:48 UTC on ccycloud.quasar-oinjhi.root.comops.site
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4574925
19:18:46.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
19:18:46.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:46.144965 20610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
19:18:46.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:46.146561 20610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
19:18:46.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:46.166281 20616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:18:47.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:46.166543 20619 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:18:47.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:46.168637 20610 server_base.cc:1034] running on GCE node
19:18:47.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:46.166553 20617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:18:47.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.398257 20610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
19:18:47.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.401954 20610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
19:18:47.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.403463 20610 hybrid_clock.cc:648] HybridClock initialized: now 1786216727403408 us; error 66 us; skew 500 ppm
19:18:47.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.404348 20610 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
19:18:47.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.416345 20610 webserver.cc:460] Webserver started at http://127.20.29.190:44077/ using document root <none> and password file <none>
19:18:47.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.417703 20610 fs_manager.cc:359] Metadata directory not provided
19:18:47.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.417915 20610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
19:18:47.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.418339 20610 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
19:18:47.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.423542 20610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-0/data/instance:
19:18:47.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "08cf200342944c818f47adca4a3ae3de"
19:18:47.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-08 19:18:47 on dist-test-slave-77v9"
19:18:47.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.424707 20610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-0/wal/instance:
19:18:47.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "08cf200342944c818f47adca4a3ae3de"
19:18:47.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-08 19:18:47 on dist-test-slave-77v9"
19:18:47.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.433444 20610 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.006s sys 0.001s
19:18:47.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.439731 20626 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
19:18:47.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.441100 20610 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
19:18:47.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.441430 20610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-0/data,/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-0/wal
19:18:47.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "08cf200342944c818f47adca4a3ae3de"
19:18:47.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-08 19:18:47 on dist-test-slave-77v9"
19:18:47.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.441931 20610 fs_report.cc:383] FS layout report
19:18:47.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
19:18:47.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-0/wal
19:18:47.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-0/wal
19:18:47.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-0/data/data
19:18:47.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
19:18:47.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
19:18:47.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
19:18:47.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
19:18:47.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
19:18:47.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
19:18:47.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
19:18:47.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
19:18:47.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
19:18:47.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
19:18:47.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
19:18:47.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.480877 20610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
19:18:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.482594 20610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
19:18:47.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.483095 20610 kserver.cc:163] Server-wide thread pool size limit: 3276
19:18:47.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.559437 20610 rpc_server.cc:307] RPC server started. Bound to: 127.20.29.190:32997
19:18:47.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.559563 20679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.29.190:32997 every 8 connection(s)
19:18:47.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.562609 20610 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-0/data/info.pb
19:18:47.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.569233 20680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
19:18:47.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.570923 20598 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu as pid 20610
19:18:47.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.571447 20598 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-0/wal/instance
19:18:47.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.575032 20598 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu
19:18:47.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu
19:18:47.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-1/wal
19:18:47.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-1/data
19:18:47.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
19:18:47.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
19:18:47.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
19:18:47.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
19:18:47.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
19:18:47.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
19:18:47.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-1/logs
19:18:47.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-1/data/info.pb
19:18:47.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
19:18:47.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
19:18:47.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
19:18:47.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
19:18:47.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
19:18:47.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
19:18:47.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
19:18:47.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
19:18:47.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
19:18:47.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
19:18:47.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
19:18:47.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
19:18:47.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.29.189:38617
19:18:47.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.29.189
19:18:47.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
19:18:47.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.29.148:42177
19:18:47.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
19:18:47.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
19:18:47.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
19:18:47.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
19:18:47.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.29.190:32997,127.20.29.189:38617,127.20.29.188:41149
19:18:47.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
19:18:47.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36605/jwks.json with env {}
19:18:47.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.581468 20680 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.29.190" port: 32997 } has no permanent_uuid. Determining permanent_uuid...
19:18:47.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.611425 20680 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.29.189" port: 38617 } has no permanent_uuid. Determining permanent_uuid...
19:18:47.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:47.613902 20631 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.29.189:38617: connect: Connection refused (error 111)
19:18:47.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:47.618522 20680 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.29.189:38617: Network error: Client connection negotiation failed: client connection to 127.20.29.189:38617: connect: Connection refused (error 111)
19:18:47.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.668167 20680 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.29.189" port: 38617 } attempt: 1
19:18:47.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:47.672464 20680 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.29.189:38617: Network error: Client connection negotiation failed: client connection to 127.20.29.189:38617: connect: Connection refused (error 111)
19:18:47.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.740924 20680 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.29.189" port: 38617 } attempt: 2
19:18:47.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:47.745172 20680 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.29.189:38617: Network error: Client connection negotiation failed: client connection to 127.20.29.189:38617: connect: Connection refused (error 111)
19:18:47.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.836609 20680 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.29.189" port: 38617 } attempt: 3
19:18:47.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:47.840617 20680 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.29.189:38617: Network error: Client connection negotiation failed: client connection to 127.20.29.189:38617: connect: Connection refused (error 111)
19:18:47.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:47.903049 20682 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
19:18:47.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:47.903772 20682 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
19:18:47.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:47.904371 20682 flags.cc:425] Enabled unsafe flag: --never_fsync=true
19:18:47.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:47.935819 20682 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
19:18:47.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:47.936219 20682 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
19:18:47.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:47.936563 20682 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
19:18:47.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:47.936910 20682 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
19:18:47.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:47.937232 20682 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
19:18:47.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:47.937460 20682 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:36605/jwks.json
19:18:47.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.973079 20682 master_runner.cc:386] Master server non-default flags:
19:18:47.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
19:18:47.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.29.148:42177
19:18:47.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
19:18:47.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
19:18:47.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-1/data
19:18:47.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-1/wal
19:18:47.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
19:18:47.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.29.190:32997,127.20.29.189:38617,127.20.29.188:41149
19:18:47.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
19:18:47.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
19:18:47.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
19:18:47.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.29.189:38617
19:18:47.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
19:18:47.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
19:18:47.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
19:18:47.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36605/jwks.json
19:18:47.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
19:18:47.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
19:18:47.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-1/data/info.pb
19:18:47.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.29.189
19:18:47.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
19:18:47.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
19:18:47.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
19:18:47.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
19:18:47.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
19:18:47.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
19:18:47.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-1/logs
19:18:47.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
19:18:47.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
19:18:47.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)
19:18:47.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
19:18:47.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
19:18:47.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
19:18:47.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
19:18:47.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Aug 2026 17:52:48 UTC on ccycloud.quasar-oinjhi.root.comops.site
19:18:47.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4574925
19:18:47.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
19:18:47.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.974681 20682 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
19:18:47.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.976449 20682 file_cache.cc:493] Constructed file cache file cache with capacity 419430
19:18:47.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.984086 20680 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.29.189" port: 38617 } attempt: 4
19:18:47.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:47.989754 20680 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.29.189:38617: Network error: Client connection negotiation failed: client connection to 127.20.29.189:38617: connect: Connection refused (error 111)
19:18:47.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:47.995378 20695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:18:48.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:48.289162 20680 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.29.189" port: 38617 } attempt: 5
19:18:48.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:48.293910 20680 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.29.189:38617: Network error: Client connection negotiation failed: client connection to 127.20.29.189:38617: connect: Connection refused (error 111)
19:18:48.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:48.841357 20680 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.29.189" port: 38617 } attempt: 6
19:18:48.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:48.850191 20680 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.29.189:38617: Network error: Client connection negotiation failed: client connection to 127.20.29.189:38617: connect: Connection refused (error 111)
19:18:49.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:47.995384 20693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:18:49.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:47.995533 20692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:18:49.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:47.997921 20682 server_base.cc:1034] running on GCE node
19:18:49.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.231568 20682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
19:18:49.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.234324 20682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
19:18:49.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.235718 20682 hybrid_clock.cc:648] HybridClock initialized: now 1786216729235698 us; error 77 us; skew 500 ppm
19:18:49.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.236603 20682 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
19:18:49.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.243552 20682 webserver.cc:460] Webserver started at http://127.20.29.189:41017/ using document root <none> and password file <none>
19:18:49.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.244513 20682 fs_manager.cc:359] Metadata directory not provided
19:18:49.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.244765 20682 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
19:18:49.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.245316 20682 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
19:18:49.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.250252 20682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-1/data/instance:
19:18:49.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4619f3c68ad24077a64f5732bc612637"
19:18:49.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-08 19:18:49 on dist-test-slave-77v9"
19:18:49.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.251421 20682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-1/wal/instance:
19:18:49.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4619f3c68ad24077a64f5732bc612637"
19:18:49.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-08 19:18:49 on dist-test-slave-77v9"
19:18:49.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.258754 20682 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.004s
19:18:49.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.264973 20704 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
19:18:49.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.266224 20682 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
19:18:49.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.266697 20682 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-1/data,/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-1/wal
19:18:49.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4619f3c68ad24077a64f5732bc612637"
19:18:49.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-08 19:18:49 on dist-test-slave-77v9"
19:18:49.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.267066 20682 fs_report.cc:383] FS layout report
19:18:49.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
19:18:49.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-1/wal
19:18:49.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-1/wal
19:18:49.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-1/data/data
19:18:49.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
19:18:49.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
19:18:49.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
19:18:49.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
19:18:49.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
19:18:49.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
19:18:49.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
19:18:49.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
19:18:49.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
19:18:49.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
19:18:49.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
19:18:49.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.309722 20682 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
19:18:49.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.311312 20682 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
19:18:49.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.311822 20682 kserver.cc:163] Server-wide thread pool size limit: 3276
19:18:49.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.385772 20682 rpc_server.cc:307] RPC server started. Bound to: 127.20.29.189:38617
19:18:49.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.385869 20758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.29.189:38617 every 8 connection(s)
19:18:49.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.388521 20682 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-1/data/info.pb
19:18:49.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.394146 20759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
19:18:49.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.394928 20598 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu as pid 20682
19:18:49.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.395359 20598 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-1/wal/instance
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.397663 20598 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-2/wal
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-2/data
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-2/logs
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-2/data/info.pb
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.29.188:41149
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.29.188
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.29.148:42177
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
19:18:49.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
19:18:49.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.29.190:32997,127.20.29.189:38617,127.20.29.188:41149
19:18:49.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
19:18:49.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36605/jwks.json with env {}
19:18:49.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.406162 20759 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.29.190" port: 32997 } has no permanent_uuid. Determining permanent_uuid...
19:18:49.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.433314 20759 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.29.189" port: 38617 } has no permanent_uuid. Determining permanent_uuid...
19:18:49.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.451576 20759 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } has no permanent_uuid. Determining permanent_uuid...
19:18:49.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:49.454075 20709 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.29.188:41149: connect: Connection refused (error 111)
19:18:49.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:49.458854 20759 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.29.188:41149: Network error: Client connection negotiation failed: client connection to 127.20.29.188:41149: connect: Connection refused (error 111)
19:18:49.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.508543 20759 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } attempt: 1
19:18:49.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:49.512789 20759 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.29.188:41149: Network error: Client connection negotiation failed: client connection to 127.20.29.188:41149: connect: Connection refused (error 111)
19:18:49.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.581293 20759 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } attempt: 2
19:18:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:49.585119 20759 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.29.188:41149: Network error: Client connection negotiation failed: client connection to 127.20.29.188:41149: connect: Connection refused (error 111)
19:18:49.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.676623 20759 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } attempt: 3
19:18:49.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:49.680387 20759 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.29.188:41149: Network error: Client connection negotiation failed: client connection to 127.20.29.188:41149: connect: Connection refused (error 111)
19:18:49.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:49.723377 20761 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
19:18:49.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:49.723941 20761 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
19:18:49.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:49.724499 20761 flags.cc:425] Enabled unsafe flag: --never_fsync=true
19:18:49.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:49.755625 20761 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
19:18:49.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:49.755918 20761 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
19:18:49.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:49.756107 20761 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
19:18:49.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:49.756299 20761 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
19:18:49.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:49.756494 20761 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
19:18:49.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:49.756636 20761 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:36605/jwks.json
19:18:49.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.793303 20761 master_runner.cc:386] Master server non-default flags:
19:18:49.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
19:18:49.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.29.148:42177
19:18:49.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
19:18:49.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-2/data
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-2/wal
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.29.190:32997,127.20.29.189:38617,127.20.29.188:41149
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.29.188:41149
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36605/jwks.json
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-2/data/info.pb
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.29.188
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-2/logs
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Aug 2026 17:52:48 UTC on ccycloud.quasar-oinjhi.root.comops.site
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4574925
19:18:49.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
19:18:49.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.795043 20761 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
19:18:49.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.796947 20761 file_cache.cc:493] Constructed file cache file cache with capacity 419430
19:18:49.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:49.815265 20771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:18:49.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.823822 20759 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } attempt: 4
19:18:49.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:49.827688 20759 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.29.188:41149: Network error: Client connection negotiation failed: client connection to 127.20.29.188:41149: connect: Connection refused (error 111)
19:18:49.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.910691 20680 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.29.189" port: 38617 } attempt: 7
19:18:49.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.927829 20680 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } has no permanent_uuid. Determining permanent_uuid...
19:18:49.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:49.933302 20680 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.29.188:41149: Network error: Client connection negotiation failed: client connection to 127.20.29.188:41149: connect: Connection refused (error 111)
19:18:49.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.991950 20680 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } attempt: 1
19:18:49.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:49.997140 20680 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.29.188:41149: Network error: Client connection negotiation failed: client connection to 127.20.29.188:41149: connect: Connection refused (error 111)
19:18:50.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:50.078572 20680 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } attempt: 2
19:18:50.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:50.084089 20680 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.29.188:41149: Network error: Client connection negotiation failed: client connection to 127.20.29.188:41149: connect: Connection refused (error 111)
19:18:50.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:50.127123 20759 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } attempt: 5
19:18:50.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:50.131145 20759 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.29.188:41149: Network error: Client connection negotiation failed: client connection to 127.20.29.188:41149: connect: Connection refused (error 111)
19:18:50.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:50.169508 20680 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } attempt: 3
19:18:50.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:50.174515 20680 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.29.188:41149: Network error: Client connection negotiation failed: client connection to 127.20.29.188:41149: connect: Connection refused (error 111)
19:18:50.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:50.314970 20680 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } attempt: 4
19:18:50.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:50.319959 20680 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.29.188:41149: Network error: Client connection negotiation failed: client connection to 127.20.29.188:41149: connect: Connection refused (error 111)
19:18:50.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:50.603365 20680 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } attempt: 5
19:18:50.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:50.608428 20680 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.29.188:41149: Network error: Client connection negotiation failed: client connection to 127.20.29.188:41149: connect: Connection refused (error 111)
19:18:50.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:50.678869 20759 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } attempt: 6
19:18:50.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:50.687152 20759 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.29.188:41149: Network error: Client connection negotiation failed: client connection to 127.20.29.188:41149: connect: Connection refused (error 111)
19:18:51.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:49.815819 20774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:18:51.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:49.815312 20772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:18:51.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:49.816892 20761 server_base.cc:1034] running on GCE node
19:18:51.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.055639 20761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
19:18:51.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.058916 20761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
19:18:51.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.060374 20761 hybrid_clock.cc:648] HybridClock initialized: now 1786216731060323 us; error 67 us; skew 500 ppm
19:18:51.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.061328 20761 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
19:18:51.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.068511 20761 webserver.cc:460] Webserver started at http://127.20.29.188:35635/ using document root <none> and password file <none>
19:18:51.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.069509 20761 fs_manager.cc:359] Metadata directory not provided
19:18:51.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.069701 20761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
19:18:51.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.070134 20761 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
19:18:51.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.075114 20761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-2/data/instance:
19:18:51.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c60e63b43fe54ca195a53f12e07beee0"
19:18:51.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-08 19:18:51 on dist-test-slave-77v9"
19:18:51.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.076242 20761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-2/wal/instance:
19:18:51.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c60e63b43fe54ca195a53f12e07beee0"
19:18:51.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-08 19:18:51 on dist-test-slave-77v9"
19:18:51.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.083666 20761 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
19:18:51.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.090509 20785 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
19:18:51.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.091867 20761 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.004s
19:18:51.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.092167 20761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-2/data,/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-2/wal
19:18:51.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c60e63b43fe54ca195a53f12e07beee0"
19:18:51.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-08 19:18:51 on dist-test-slave-77v9"
19:18:51.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.092485 20761 fs_report.cc:383] FS layout report
19:18:51.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
19:18:51.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-2/wal
19:18:51.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-2/wal
19:18:51.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-2/data/data
19:18:51.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
19:18:51.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
19:18:51.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
19:18:51.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
19:18:51.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
19:18:51.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
19:18:51.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
19:18:51.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
19:18:51.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
19:18:51.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
19:18:51.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
19:18:51.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.129884 20761 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
19:18:51.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.131363 20761 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
19:18:51.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.131803 20761 kserver.cc:163] Server-wide thread pool size limit: 3276
19:18:51.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.160904 20680 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } attempt: 6
19:18:51.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:51.168351 20680 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.29.188:41149: Network error: Client connection negotiation failed: client connection to 127.20.29.188:41149: connect: Connection refused (error 111)
19:18:51.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.221609 20761 rpc_server.cc:307] RPC server started. Bound to: 127.20.29.188:41149
19:18:51.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.221722 20841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.29.188:41149 every 8 connection(s)
19:18:51.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.225747 20761 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-2/data/info.pb
19:18:51.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.229483 20598 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu as pid 20761
19:18:51.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.230002 20598 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/master-2/wal/instance
19:18:51.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.236990 20842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
19:18:51.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.260741 20842 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.29.190" port: 32997 } has no permanent_uuid. Determining permanent_uuid...
19:18:51.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.294709 20842 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.29.189" port: 38617 } has no permanent_uuid. Determining permanent_uuid...
19:18:51.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.307272 20842 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } has no permanent_uuid. Determining permanent_uuid...
19:18:51.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.326061 20842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0: Bootstrap starting.
19:18:51.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.332574 20842 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0: Neither blocks nor log segments found. Creating new log.
19:18:51.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.334568 20842 log.cc:824] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0: Log is configured to *not* fsync() on all Append() calls
19:18:51.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.339398 20842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0: No bootstrap required, opened a new log
19:18:51.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.361963 20842 raft_consensus.cc:348] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08cf200342944c818f47adca4a3ae3de" member_type: VOTER last_known_addr { host: "127.20.29.190" port: 32997 } } peers { permanent_uuid: "4619f3c68ad24077a64f5732bc612637" member_type: VOTER last_known_addr { host: "127.20.29.189" port: 38617 } } peers { permanent_uuid: "c60e63b43fe54ca195a53f12e07beee0" member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } }
19:18:51.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.363138 20842 raft_consensus.cc:374] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
19:18:51.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.363415 20842 raft_consensus.cc:729] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c60e63b43fe54ca195a53f12e07beee0, State: Initialized, Role: FOLLOWER
19:18:51.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.364154 20842 consensus_queue.cc:260] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08cf200342944c818f47adca4a3ae3de" member_type: VOTER last_known_addr { host: "127.20.29.190" port: 32997 } } peers { permanent_uuid: "4619f3c68ad24077a64f5732bc612637" member_type: VOTER last_known_addr { host: "127.20.29.189" port: 38617 } } peers { permanent_uuid: "c60e63b43fe54ca195a53f12e07beee0" member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } }
19:18:51.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.366629 20853 sys_catalog.cc:455] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08cf200342944c818f47adca4a3ae3de" member_type: VOTER last_known_addr { host: "127.20.29.190" port: 32997 } } peers { permanent_uuid: "4619f3c68ad24077a64f5732bc612637" member_type: VOTER last_known_addr { host: "127.20.29.189" port: 38617 } } peers { permanent_uuid: "c60e63b43fe54ca195a53f12e07beee0" member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } } }
19:18:51.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.367292 20853 sys_catalog.cc:458] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0 [sys.catalog]: This master's current role is: FOLLOWER
19:18:51.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.367877 20842 sys_catalog.cc:564] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0 [sys.catalog]: configured and running, proceeding with master startup.
19:18:51.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:51.387344 20791 tablet.cc:2369] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0: Can't schedule compaction. Clean time has not been advanced past its initial value.
19:18:51.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:51.403946 20864 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
19:18:51.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:51.404331 20864 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
19:18:51.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.392364 20761 master_runner.cc:186] Error getting master registration for 127.20.29.190:32997: OK, instance_id { permanent_uuid: "08cf200342944c818f47adca4a3ae3de" instance_seqno: 1786216727538820 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
19:18:51.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.426146 20761 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
19:18:51.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.747849 20759 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } attempt: 7
19:18:51.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.770094 20759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4619f3c68ad24077a64f5732bc612637: Bootstrap starting.
19:18:51.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.775357 20759 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4619f3c68ad24077a64f5732bc612637: Neither blocks nor log segments found. Creating new log.
19:18:51.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.777537 20759 log.cc:824] T 00000000000000000000000000000000 P 4619f3c68ad24077a64f5732bc612637: Log is configured to *not* fsync() on all Append() calls
19:18:51.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.782390 20759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4619f3c68ad24077a64f5732bc612637: No bootstrap required, opened a new log
19:18:51.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.806106 20759 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4619f3c68ad24077a64f5732bc612637 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08cf200342944c818f47adca4a3ae3de" member_type: VOTER last_known_addr { host: "127.20.29.190" port: 32997 } } peers { permanent_uuid: "4619f3c68ad24077a64f5732bc612637" member_type: VOTER last_known_addr { host: "127.20.29.189" port: 38617 } } peers { permanent_uuid: "c60e63b43fe54ca195a53f12e07beee0" member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } }
19:18:51.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.806770 20759 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4619f3c68ad24077a64f5732bc612637 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
19:18:51.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.806975 20759 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4619f3c68ad24077a64f5732bc612637 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4619f3c68ad24077a64f5732bc612637, State: Initialized, Role: FOLLOWER
19:18:51.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.807713 20759 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4619f3c68ad24077a64f5732bc612637 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08cf200342944c818f47adca4a3ae3de" member_type: VOTER last_known_addr { host: "127.20.29.190" port: 32997 } } peers { permanent_uuid: "4619f3c68ad24077a64f5732bc612637" member_type: VOTER last_known_addr { host: "127.20.29.189" port: 38617 } } peers { permanent_uuid: "c60e63b43fe54ca195a53f12e07beee0" member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } }
19:18:51.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.810446 20868 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4619f3c68ad24077a64f5732bc612637 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08cf200342944c818f47adca4a3ae3de" member_type: VOTER last_known_addr { host: "127.20.29.190" port: 32997 } } peers { permanent_uuid: "4619f3c68ad24077a64f5732bc612637" member_type: VOTER last_known_addr { host: "127.20.29.189" port: 38617 } } peers { permanent_uuid: "c60e63b43fe54ca195a53f12e07beee0" member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } } }
19:18:51.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.811314 20868 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4619f3c68ad24077a64f5732bc612637 [sys.catalog]: This master's current role is: FOLLOWER
19:18:51.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.812209 20853 raft_consensus.cc:482] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
19:18:51.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.812435 20759 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4619f3c68ad24077a64f5732bc612637 [sys.catalog]: configured and running, proceeding with master startup.
19:18:51.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.812772 20853 raft_consensus.cc:504] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08cf200342944c818f47adca4a3ae3de" member_type: VOTER last_known_addr { host: "127.20.29.190" port: 32997 } } peers { permanent_uuid: "4619f3c68ad24077a64f5732bc612637" member_type: VOTER last_known_addr { host: "127.20.29.189" port: 38617 } } peers { permanent_uuid: "c60e63b43fe54ca195a53f12e07beee0" member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } }
19:18:51.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.817330 20734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c60e63b43fe54ca195a53f12e07beee0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4619f3c68ad24077a64f5732bc612637" is_pre_election: true
19:18:51.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.818504 20734 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4619f3c68ad24077a64f5732bc612637 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c60e63b43fe54ca195a53f12e07beee0 in term 0.
19:18:51.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:51.819494 20712 tablet.cc:2369] T 00000000000000000000000000000000 P 4619f3c68ad24077a64f5732bc612637: Can't schedule compaction. Clean time has not been advanced past its initial value.
19:18:51.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.822201 20789 leader_election.cc:302] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4619f3c68ad24077a64f5732bc612637, c60e63b43fe54ca195a53f12e07beee0; no voters:
19:18:51.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.824673 20853 leader_election.cc:288] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08cf200342944c818f47adca4a3ae3de (127.20.29.190:32997), 4619f3c68ad24077a64f5732bc612637 (127.20.29.189:38617)
19:18:51.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.825276 20853 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0 [term 0 FOLLOWER]: Leader pre-election won for term 1
19:18:51.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.825599 20853 raft_consensus.cc:482] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
19:18:51.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.825896 20853 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0 [term 0 FOLLOWER]: Advancing to term 1
19:18:51.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.832489 20853 raft_consensus.cc:504] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08cf200342944c818f47adca4a3ae3de" member_type: VOTER last_known_addr { host: "127.20.29.190" port: 32997 } } peers { permanent_uuid: "4619f3c68ad24077a64f5732bc612637" member_type: VOTER last_known_addr { host: "127.20.29.189" port: 38617 } } peers { permanent_uuid: "c60e63b43fe54ca195a53f12e07beee0" member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } }
19:18:51.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.836069 20853 leader_election.cc:288] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0 [CANDIDATE]: Term 1 election: Requested vote from peers 08cf200342944c818f47adca4a3ae3de (127.20.29.190:32997), 4619f3c68ad24077a64f5732bc612637 (127.20.29.189:38617)
19:18:51.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.839697 20734 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c60e63b43fe54ca195a53f12e07beee0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4619f3c68ad24077a64f5732bc612637"
19:18:51.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.840322 20734 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4619f3c68ad24077a64f5732bc612637 [term 0 FOLLOWER]: Advancing to term 1
19:18:51.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.847076 20734 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4619f3c68ad24077a64f5732bc612637 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c60e63b43fe54ca195a53f12e07beee0 in term 1.
19:18:51.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.848212 20789 leader_election.cc:302] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4619f3c68ad24077a64f5732bc612637, c60e63b43fe54ca195a53f12e07beee0; no voters:
19:18:51.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.849617 20871 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0 [term 1 FOLLOWER]: Leader election won for term 1
19:18:51.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.850266 20871 raft_consensus.cc:686] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0 [term 1 LEADER]: Becoming Leader. State: Replica: c60e63b43fe54ca195a53f12e07beee0, State: Running, Role: LEADER
19:18:51.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.851471 20871 consensus_queue.cc:237] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08cf200342944c818f47adca4a3ae3de" member_type: VOTER last_known_addr { host: "127.20.29.190" port: 32997 } } peers { permanent_uuid: "4619f3c68ad24077a64f5732bc612637" member_type: VOTER last_known_addr { host: "127.20.29.189" port: 38617 } } peers { permanent_uuid: "c60e63b43fe54ca195a53f12e07beee0" member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } }
19:18:51.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.876739 20853 sys_catalog.cc:455] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c60e63b43fe54ca195a53f12e07beee0. Latest consensus state: current_term: 1 leader_uuid: "c60e63b43fe54ca195a53f12e07beee0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08cf200342944c818f47adca4a3ae3de" member_type: VOTER last_known_addr { host: "127.20.29.190" port: 32997 } } peers { permanent_uuid: "4619f3c68ad24077a64f5732bc612637" member_type: VOTER last_known_addr { host: "127.20.29.189" port: 38617 } } peers { permanent_uuid: "c60e63b43fe54ca195a53f12e07beee0" member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } } }
19:18:51.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.881417 20853 sys_catalog.cc:458] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0 [sys.catalog]: This master's current role is: LEADER
19:18:51.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.885406 20879 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
19:18:51.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.899516 20879 catalog_manager.cc:1484] Initializing Kudu cluster ID...
19:18:51.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:51.910893 20882 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4619f3c68ad24077a64f5732bc612637: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
19:18:51.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:51.911445 20882 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
19:18:51.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.922498 20734 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4619f3c68ad24077a64f5732bc612637 [term 1 FOLLOWER]: Refusing update from remote peer c60e63b43fe54ca195a53f12e07beee0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
19:18:51.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.924410 20853 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4619f3c68ad24077a64f5732bc612637" member_type: VOTER last_known_addr { host: "127.20.29.189" port: 38617 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
19:18:51.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.896443 20682 master_runner.cc:186] Error getting master registration for 127.20.29.190:32997: OK, instance_id { permanent_uuid: "08cf200342944c818f47adca4a3ae3de" instance_seqno: 1786216727538820 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
19:18:51.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.953230 20682 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
19:18:51.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.974104 20868 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4619f3c68ad24077a64f5732bc612637 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c60e63b43fe54ca195a53f12e07beee0. Latest consensus state: current_term: 1 leader_uuid: "c60e63b43fe54ca195a53f12e07beee0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08cf200342944c818f47adca4a3ae3de" member_type: VOTER last_known_addr { host: "127.20.29.190" port: 32997 } } peers { permanent_uuid: "4619f3c68ad24077a64f5732bc612637" member_type: VOTER last_known_addr { host: "127.20.29.189" port: 38617 } } peers { permanent_uuid: "c60e63b43fe54ca195a53f12e07beee0" member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } } }
19:18:51.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.975512 20868 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4619f3c68ad24077a64f5732bc612637 [sys.catalog]: This master's current role is: FOLLOWER
19:18:51.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.978440 20885 mvcc.cc:205] Tried to move back new op lower bound from 7316343733926551552 to 7316343733679583232. Current Snapshot: MvccSnapshot[applied={T|T < 7316343733926551552}]
19:18:51.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.981861 20879 catalog_manager.cc:1347] Generated new cluster ID: 43a92ab5b0784adebd27b8695c3e07d5
19:18:51.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.982149 20879 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
19:18:51.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.985896 20871 sys_catalog.cc:455] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c60e63b43fe54ca195a53f12e07beee0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08cf200342944c818f47adca4a3ae3de" member_type: VOTER last_known_addr { host: "127.20.29.190" port: 32997 } } peers { permanent_uuid: "4619f3c68ad24077a64f5732bc612637" member_type: VOTER last_known_addr { host: "127.20.29.189" port: 38617 } } peers { permanent_uuid: "c60e63b43fe54ca195a53f12e07beee0" member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } } }
19:18:51.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:51.986688 20871 sys_catalog.cc:458] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0 [sys.catalog]: This master's current role is: LEADER
19:18:52.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.007036 20868 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4619f3c68ad24077a64f5732bc612637 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c60e63b43fe54ca195a53f12e07beee0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08cf200342944c818f47adca4a3ae3de" member_type: VOTER last_known_addr { host: "127.20.29.190" port: 32997 } } peers { permanent_uuid: "4619f3c68ad24077a64f5732bc612637" member_type: VOTER last_known_addr { host: "127.20.29.189" port: 38617 } } peers { permanent_uuid: "c60e63b43fe54ca195a53f12e07beee0" member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } } }
19:18:52.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.008045 20868 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4619f3c68ad24077a64f5732bc612637 [sys.catalog]: This master's current role is: FOLLOWER
19:18:52.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.023102 20879 catalog_manager.cc:1370] Generated new certificate authority record
19:18:52.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.026244 20879 catalog_manager.cc:1504] Loading token signing keys...
19:18:52.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.060603 20879 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0: Generated new TSK 0
19:18:52.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.064466 20879 catalog_manager.cc:1514] Initializing in-progress tserver states...
19:18:52.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.099294 20598 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu
19:18:52.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu
19:18:52.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-0/wal
19:18:52.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-0/data
19:18:52.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
19:18:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
19:18:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
19:18:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
19:18:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
19:18:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
19:18:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-0/logs
19:18:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-0/data/info.pb
19:18:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
19:18:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
19:18:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
19:18:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
19:18:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
19:18:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
19:18:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
19:18:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
19:18:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
19:18:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
19:18:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.29.129:0
19:18:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.20.29.129
19:18:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.29.129
19:18:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
19:18:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.20.29.190:32997,127.20.29.189:38617,127.20.29.188:41149
19:18:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.29.148:42177
19:18:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
19:18:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
19:18:52.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
19:18:52.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.201886 20680 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } attempt: 7
19:18:52.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.325254 20680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08cf200342944c818f47adca4a3ae3de: Bootstrap starting.
19:18:52.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.355240 20680 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 08cf200342944c818f47adca4a3ae3de: Neither blocks nor log segments found. Creating new log.
19:18:52.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.358060 20680 log.cc:824] T 00000000000000000000000000000000 P 08cf200342944c818f47adca4a3ae3de: Log is configured to *not* fsync() on all Append() calls
19:18:52.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.376708 20680 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08cf200342944c818f47adca4a3ae3de: No bootstrap required, opened a new log
19:18:52.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.446250 20680 raft_consensus.cc:348] T 00000000000000000000000000000000 P 08cf200342944c818f47adca4a3ae3de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08cf200342944c818f47adca4a3ae3de" member_type: VOTER last_known_addr { host: "127.20.29.190" port: 32997 } } peers { permanent_uuid: "4619f3c68ad24077a64f5732bc612637" member_type: VOTER last_known_addr { host: "127.20.29.189" port: 38617 } } peers { permanent_uuid: "c60e63b43fe54ca195a53f12e07beee0" member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } }
19:18:52.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.447216 20680 raft_consensus.cc:374] T 00000000000000000000000000000000 P 08cf200342944c818f47adca4a3ae3de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
19:18:52.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.447530 20680 raft_consensus.cc:729] T 00000000000000000000000000000000 P 08cf200342944c818f47adca4a3ae3de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08cf200342944c818f47adca4a3ae3de, State: Initialized, Role: FOLLOWER
19:18:52.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.448622 20680 consensus_queue.cc:260] T 00000000000000000000000000000000 P 08cf200342944c818f47adca4a3ae3de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08cf200342944c818f47adca4a3ae3de" member_type: VOTER last_known_addr { host: "127.20.29.190" port: 32997 } } peers { permanent_uuid: "4619f3c68ad24077a64f5732bc612637" member_type: VOTER last_known_addr { host: "127.20.29.189" port: 38617 } } peers { permanent_uuid: "c60e63b43fe54ca195a53f12e07beee0" member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } }
19:18:52.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.469033 20893 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08cf200342944c818f47adca4a3ae3de [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08cf200342944c818f47adca4a3ae3de" member_type: VOTER last_known_addr { host: "127.20.29.190" port: 32997 } } peers { permanent_uuid: "4619f3c68ad24077a64f5732bc612637" member_type: VOTER last_known_addr { host: "127.20.29.189" port: 38617 } } peers { permanent_uuid: "c60e63b43fe54ca195a53f12e07beee0" member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } } }
19:18:52.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.470043 20893 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08cf200342944c818f47adca4a3ae3de [sys.catalog]: This master's current role is: FOLLOWER
19:18:52.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.473311 20680 sys_catalog.cc:564] T 00000000000000000000000000000000 P 08cf200342944c818f47adca4a3ae3de [sys.catalog]: configured and running, proceeding with master startup.
19:18:52.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.473483 20654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c60e63b43fe54ca195a53f12e07beee0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08cf200342944c818f47adca4a3ae3de"
19:18:52.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.474292 20654 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 08cf200342944c818f47adca4a3ae3de [term 0 FOLLOWER]: Advancing to term 1
19:18:52.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.477033 20655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c60e63b43fe54ca195a53f12e07beee0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08cf200342944c818f47adca4a3ae3de" is_pre_election: true
19:18:52.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.486796 20654 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 08cf200342944c818f47adca4a3ae3de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c60e63b43fe54ca195a53f12e07beee0 in term 1.
19:18:52.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.493275 20653 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 08cf200342944c818f47adca4a3ae3de [term 1 FOLLOWER]: Refusing update from remote peer c60e63b43fe54ca195a53f12e07beee0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
19:18:52.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:52.493994 20633 tablet.cc:2369] T 00000000000000000000000000000000 P 08cf200342944c818f47adca4a3ae3de: Can't schedule compaction. Clean time has not been advanced past its initial value.
19:18:52.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.503846 20853 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08cf200342944c818f47adca4a3ae3de" member_type: VOTER last_known_addr { host: "127.20.29.190" port: 32997 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
19:18:52.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.632913 20893 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08cf200342944c818f47adca4a3ae3de [sys.catalog]: SysCatalogTable state changed. Reason: New leader c60e63b43fe54ca195a53f12e07beee0. Latest consensus state: current_term: 1 leader_uuid: "c60e63b43fe54ca195a53f12e07beee0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08cf200342944c818f47adca4a3ae3de" member_type: VOTER last_known_addr { host: "127.20.29.190" port: 32997 } } peers { permanent_uuid: "4619f3c68ad24077a64f5732bc612637" member_type: VOTER last_known_addr { host: "127.20.29.189" port: 38617 } } peers { permanent_uuid: "c60e63b43fe54ca195a53f12e07beee0" member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } } }
19:18:52.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.633190 20901 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08cf200342944c818f47adca4a3ae3de [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c60e63b43fe54ca195a53f12e07beee0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08cf200342944c818f47adca4a3ae3de" member_type: VOTER last_known_addr { host: "127.20.29.190" port: 32997 } } peers { permanent_uuid: "4619f3c68ad24077a64f5732bc612637" member_type: VOTER last_known_addr { host: "127.20.29.189" port: 38617 } } peers { permanent_uuid: "c60e63b43fe54ca195a53f12e07beee0" member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } } }
19:18:52.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.634039 20893 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08cf200342944c818f47adca4a3ae3de [sys.catalog]: This master's current role is: FOLLOWER
19:18:52.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.634258 20901 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08cf200342944c818f47adca4a3ae3de [sys.catalog]: This master's current role is: FOLLOWER
19:18:52.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.677953 20914 catalog_manager.cc:1259] Loaded cluster ID: 43a92ab5b0784adebd27b8695c3e07d5
19:18:52.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.678251 20914 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 08cf200342944c818f47adca4a3ae3de: loading cluster ID for follower catalog manager: success
19:18:52.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.693389 20914 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 08cf200342944c818f47adca4a3ae3de: acquiring CA information for follower catalog manager: success
19:18:52.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.704013 20914 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 08cf200342944c818f47adca4a3ae3de: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
19:18:52.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:52.704605 20890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
19:18:52.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:52.705320 20890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
19:18:52.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:52.706193 20890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
19:18:52.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:52.770134 20890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
19:18:52.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:52.771602 20890 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.29.129
19:18:52.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.837944 20890 tablet_server_runner.cc:78] Tablet server non-default flags:
19:18:52.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
19:18:52.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.29.148:42177
19:18:52.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
19:18:52.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
19:18:52.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-0/data
19:18:52.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-0/wal
19:18:52.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
19:18:52.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
19:18:52.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.29.129:0
19:18:52.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
19:18:52.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
19:18:52.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
19:18:52.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-0/data/info.pb
19:18:52.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.29.129
19:18:52.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
19:18:52.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.20.29.190:32997,127.20.29.189:38617,127.20.29.188:41149
19:18:52.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
19:18:52.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
19:18:52.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
19:18:52.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
19:18:52.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
19:18:52.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.20.29.129
19:18:52.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-0/logs
19:18:52.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
19:18:52.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
19:18:52.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)
19:18:52.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
19:18:52.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
19:18:52.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
19:18:52.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
19:18:52.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Aug 2026 17:52:48 UTC on ccycloud.quasar-oinjhi.root.comops.site
19:18:52.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4574925
19:18:52.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
19:18:52.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.839555 20890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
19:18:52.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.841774 20890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
19:18:52.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:52.889700 20918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:18:52.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.917586 20882 catalog_manager.cc:1259] Loaded cluster ID: 43a92ab5b0784adebd27b8695c3e07d5
19:18:52.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.918108 20882 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4619f3c68ad24077a64f5732bc612637: loading cluster ID for follower catalog manager: success
19:18:52.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.927006 20882 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4619f3c68ad24077a64f5732bc612637: acquiring CA information for follower catalog manager: success
19:18:52.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:52.934816 20882 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4619f3c68ad24077a64f5732bc612637: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
19:18:53.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:53.021809 20853 sys_catalog.cc:455] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c60e63b43fe54ca195a53f12e07beee0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08cf200342944c818f47adca4a3ae3de" member_type: VOTER last_known_addr { host: "127.20.29.190" port: 32997 } } peers { permanent_uuid: "4619f3c68ad24077a64f5732bc612637" member_type: VOTER last_known_addr { host: "127.20.29.189" port: 38617 } } peers { permanent_uuid: "c60e63b43fe54ca195a53f12e07beee0" member_type: VOTER last_known_addr { host: "127.20.29.188" port: 41149 } } }
19:18:53.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:53.022614 20853 sys_catalog.cc:458] T 00000000000000000000000000000000 P c60e63b43fe54ca195a53f12e07beee0 [sys.catalog]: This master's current role is: LEADER
19:18:55.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:54.264745 20916 debug-util.cc:398] Leaking SignalData structure 0x7b0800014860 after lost signal to thread 20890
19:18:55.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:55.523339 20916 kernel_stack_watchdog.cc:198] Thread 20890 stuck at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/thread.cc:637 for 375ms:
19:18:55.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
19:18:55.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
19:18:55.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
19:18:55.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
19:18:55.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:52.893370 20917 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:18:55.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:55.525075 20890 thread.cc:636] OpenStack (cloud detector) Time spent creating pthread: real 2.637s user 1.026s sys 1.460s
19:18:55.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:55.525470 20890 thread.cc:602] OpenStack (cloud detector) Time spent starting thread: real 2.638s user 1.026s sys 1.461s
19:18:55.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.525724 20890 server_base.cc:1034] running on GCE node
19:18:55.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:55.526296 20921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:18:55.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.527987 20890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
19:18:55.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.539716 20890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
19:18:55.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.543454 20890 hybrid_clock.cc:648] HybridClock initialized: now 1786216735543365 us; error 94 us; skew 500 ppm
19:18:55.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.545003 20890 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
19:18:55.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.576288 20890 webserver.cc:460] Webserver started at http://127.20.29.129:41793/ using document root <none> and password file <none>
19:18:55.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.577829 20890 fs_manager.cc:359] Metadata directory not provided
19:18:55.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.578130 20890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
19:18:55.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.578742 20890 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
19:18:55.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.586607 20890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-0/data/instance:
19:18:55.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fd0e8e8d004543da935683b04d40407e"
19:18:55.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-08 19:18:55 on dist-test-slave-77v9"
19:18:55.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.588498 20890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-0/wal/instance:
19:18:55.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fd0e8e8d004543da935683b04d40407e"
19:18:55.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-08 19:18:55 on dist-test-slave-77v9"
19:18:55.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.605195 20890 fs_manager.cc:691] Time spent creating directory manager: real 0.016s user 0.011s sys 0.003s
19:18:55.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.621635 20931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
19:18:55.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.623711 20890 fs_manager.cc:725] Time spent opening block manager: real 0.012s user 0.005s sys 0.003s
19:18:55.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.624163 20890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-0/data,/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-0/wal
19:18:55.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fd0e8e8d004543da935683b04d40407e"
19:18:55.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-08 19:18:55 on dist-test-slave-77v9"
19:18:55.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.624635 20890 fs_report.cc:383] FS layout report
19:18:55.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
19:18:55.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-0/wal
19:18:55.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-0/wal
19:18:55.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-0/data/data
19:18:55.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
19:18:55.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
19:18:55.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
19:18:55.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
19:18:55.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
19:18:55.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
19:18:55.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
19:18:55.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
19:18:55.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
19:18:55.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
19:18:55.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
19:18:55.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.691915 20890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
19:18:55.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.694003 20890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
19:18:55.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.694593 20890 kserver.cc:163] Server-wide thread pool size limit: 3276
19:18:55.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.698313 20890 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
19:18:55.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.704285 20890 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
19:18:55.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.704566 20890 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
19:18:55.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.704900 20890 ts_tablet_manager.cc:610] Registered 0 tablets
19:18:55.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.705111 20890 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
19:18:55.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.918069 20890 rpc_server.cc:307] RPC server started. Bound to: 127.20.29.129:45745
19:18:55.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.918185 21048 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.29.129:45745 every 8 connection(s)
19:18:55.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.922248 20890 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-0/data/info.pb
19:18:55.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.932323 20598 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu as pid 20890
19:18:55.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.933033 20598 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-0/wal/instance
19:18:55.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.963477 20598 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu
19:18:55.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu
19:18:55.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-1/wal
19:18:55.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-1/data
19:18:55.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
19:18:55.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
19:18:55.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
19:18:55.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
19:18:55.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
19:18:55.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
19:18:55.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-1/logs
19:18:55.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-1/data/info.pb
19:18:55.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
19:18:55.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
19:18:55.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
19:18:55.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
19:18:55.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
19:18:55.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
19:18:55.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
19:18:55.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
19:18:55.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
19:18:55.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
19:18:55.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.29.130:0
19:18:55.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.20.29.130
19:18:55.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.29.130
19:18:55.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
19:18:55.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.20.29.190:32997,127.20.29.189:38617,127.20.29.188:41149
19:18:55.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.29.148:42177
19:18:55.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
19:18:55.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
19:18:55.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
19:18:55.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.992770 21049 heartbeater.cc:347] Connected to a master server at 127.20.29.188:41149
19:18:55.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.993389 21049 heartbeater.cc:464] Registering TS with master...
19:18:55.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.994858 21049 heartbeater.cc:511] Master 127.20.29.188:41149 requested a full tablet report, sending...
19:18:55.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:55.998762 20805 ts_manager.cc:194] Registered new tserver with Master: fd0e8e8d004543da935683b04d40407e (127.20.29.129:45745)
19:18:56.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:56.002254 20805 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.29.129:59833
19:18:56.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:56.004387 21050 heartbeater.cc:347] Connected to a master server at 127.20.29.189:38617
19:18:56.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:56.004782 21050 heartbeater.cc:464] Registering TS with master...
19:18:56.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:56.005810 21050 heartbeater.cc:511] Master 127.20.29.189:38617 requested a full tablet report, sending...
19:18:56.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:56.009333 20724 ts_manager.cc:194] Registered new tserver with Master: fd0e8e8d004543da935683b04d40407e (127.20.29.129:45745)
19:18:56.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:56.010682 21055 heartbeater.cc:347] Connected to a master server at 127.20.29.190:32997
19:18:56.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:56.011046 21055 heartbeater.cc:464] Registering TS with master...
19:18:56.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:56.011745 21055 heartbeater.cc:511] Master 127.20.29.190:32997 requested a full tablet report, sending...
19:18:56.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:56.015965 20645 ts_manager.cc:194] Registered new tserver with Master: fd0e8e8d004543da935683b04d40407e (127.20.29.129:45745)
19:18:56.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:56.380957 21059 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
19:18:56.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:56.381963 21059 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
19:18:56.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:56.382534 21059 flags.cc:425] Enabled unsafe flag: --never_fsync=true
19:18:56.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:56.420686 21059 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
19:18:56.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:56.421712 21059 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.29.130
19:18:56.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:56.465112 21059 tablet_server_runner.cc:78] Tablet server non-default flags:
19:18:56.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
19:18:56.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.29.148:42177
19:18:56.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
19:18:56.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
19:18:56.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-1/data
19:18:56.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-1/wal
19:18:56.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
19:18:56.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
19:18:56.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.29.130:0
19:18:56.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
19:18:56.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
19:18:56.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
19:18:56.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-1/data/info.pb
19:18:56.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.29.130
19:18:56.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
19:18:56.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.20.29.190:32997,127.20.29.189:38617,127.20.29.188:41149
19:18:56.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
19:18:56.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
19:18:56.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
19:18:56.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
19:18:56.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
19:18:56.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.20.29.130
19:18:56.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-1/logs
19:18:56.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
19:18:56.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
19:18:56.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)
19:18:56.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
19:18:56.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
19:18:56.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
19:18:56.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
19:18:56.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Aug 2026 17:52:48 UTC on ccycloud.quasar-oinjhi.root.comops.site
19:18:56.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4574925
19:18:56.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
19:18:56.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:56.466933 21059 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
19:18:56.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:56.469096 21059 file_cache.cc:493] Constructed file cache file cache with capacity 419430
19:18:56.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:56.493644 21068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:18:57.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:57.009526 21049 heartbeater.cc:503] Master 127.20.29.188:41149 was elected leader, sending a full tablet report...
19:18:57.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:56.494354 21070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:18:57.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:56.494519 21067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:18:57.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:56.495371 21059 server_base.cc:1034] running on GCE node
19:18:57.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:57.772078 21059 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
19:18:57.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:57.774554 21059 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
19:18:57.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:57.776072 21059 hybrid_clock.cc:648] HybridClock initialized: now 1786216737776029 us; error 41 us; skew 500 ppm
19:18:57.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:57.777001 21059 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
19:18:57.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:57.783455 21059 webserver.cc:460] Webserver started at http://127.20.29.130:33413/ using document root <none> and password file <none>
19:18:57.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:57.784451 21059 fs_manager.cc:359] Metadata directory not provided
19:18:57.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:57.784709 21059 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
19:18:57.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:57.785310 21059 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
19:18:57.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:57.790776 21059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-1/data/instance:
19:18:57.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5ca461a190dd4d3994de669f9d74acee"
19:18:57.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-08 19:18:57 on dist-test-slave-77v9"
19:18:57.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:57.791962 21059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-1/wal/instance:
19:18:57.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5ca461a190dd4d3994de669f9d74acee"
19:18:57.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-08 19:18:57 on dist-test-slave-77v9"
19:18:57.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:57.799724 21059 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
19:18:57.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:57.805572 21077 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
19:18:57.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:57.806620 21059 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.004s
19:18:57.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:57.807024 21059 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-1/data,/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-1/wal
19:18:57.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5ca461a190dd4d3994de669f9d74acee"
19:18:57.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-08 19:18:57 on dist-test-slave-77v9"
19:18:57.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:57.807371 21059 fs_report.cc:383] FS layout report
19:18:57.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
19:18:57.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-1/wal
19:18:57.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-1/wal
19:18:57.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-1/data/data
19:18:57.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
19:18:57.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
19:18:57.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
19:18:57.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
19:18:57.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
19:18:57.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
19:18:57.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
19:18:57.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
19:18:57.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
19:18:57.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
19:18:57.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
19:18:57.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:57.852138 21059 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
19:18:57.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:57.853828 21059 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
19:18:57.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:57.854378 21059 kserver.cc:163] Server-wide thread pool size limit: 3276
19:18:57.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:57.857187 21059 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
19:18:57.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:57.861985 21059 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
19:18:57.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:57.862215 21059 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
19:18:57.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:57.862591 21059 ts_tablet_manager.cc:610] Registered 0 tablets
19:18:57.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:57.862799 21059 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
19:18:58.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:58.031589 21059 rpc_server.cc:307] RPC server started. Bound to: 127.20.29.130:34181
19:18:58.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:58.031721 21193 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.29.130:34181 every 8 connection(s)
19:18:58.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:58.034320 21059 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-1/data/info.pb
19:18:58.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:58.035861 20598 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu as pid 21059
19:18:58.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:58.036388 20598 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-1/wal/instance
19:18:58.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:58.063719 20598 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu
19:18:58.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu
19:18:58.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-2/wal
19:18:58.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-2/data
19:18:58.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
19:18:58.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
19:18:58.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
19:18:58.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
19:18:58.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
19:18:58.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
19:18:58.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-2/logs
19:18:58.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-2/data/info.pb
19:18:58.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
19:18:58.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
19:18:58.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
19:18:58.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
19:18:58.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
19:18:58.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
19:18:58.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
19:18:58.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
19:18:58.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
19:18:58.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
19:18:58.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.29.131:0
19:18:58.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.20.29.131
19:18:58.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.29.131
19:18:58.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
19:18:58.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.20.29.190:32997,127.20.29.189:38617,127.20.29.188:41149
19:18:58.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.29.148:42177
19:18:58.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
19:18:58.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
19:18:58.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
19:18:58.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:58.078765 21194 heartbeater.cc:347] Connected to a master server at 127.20.29.188:41149
19:18:58.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:58.079304 21194 heartbeater.cc:464] Registering TS with master...
19:18:58.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:58.080706 21194 heartbeater.cc:511] Master 127.20.29.188:41149 requested a full tablet report, sending...
19:18:58.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:58.083709 20805 ts_manager.cc:194] Registered new tserver with Master: 5ca461a190dd4d3994de669f9d74acee (127.20.29.130:34181)
19:18:58.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:58.086090 20805 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.29.130:39853
19:18:58.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:58.099977 21195 heartbeater.cc:347] Connected to a master server at 127.20.29.189:38617
19:18:58.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:58.100355 21195 heartbeater.cc:464] Registering TS with master...
19:18:58.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:58.101092 21195 heartbeater.cc:511] Master 127.20.29.189:38617 requested a full tablet report, sending...
19:18:58.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:58.103446 20724 ts_manager.cc:194] Registered new tserver with Master: 5ca461a190dd4d3994de669f9d74acee (127.20.29.130:34181)
19:18:58.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:58.108460 21197 heartbeater.cc:347] Connected to a master server at 127.20.29.190:32997
19:18:58.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:58.108752 21197 heartbeater.cc:464] Registering TS with master...
19:18:58.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:58.109511 21197 heartbeater.cc:511] Master 127.20.29.190:32997 requested a full tablet report, sending...
19:18:58.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:58.111923 20645 ts_manager.cc:194] Registered new tserver with Master: 5ca461a190dd4d3994de669f9d74acee (127.20.29.130:34181)
19:18:58.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:58.418079 21202 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
19:18:58.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:58.418558 21202 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
19:18:58.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:58.419006 21202 flags.cc:425] Enabled unsafe flag: --never_fsync=true
19:18:58.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:58.452090 21202 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
19:18:58.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:58.452975 21202 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.29.131
19:18:58.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:58.490536 21202 tablet_server_runner.cc:78] Tablet server non-default flags:
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.29.148:42177
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-2/data
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-2/wal
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.29.131:0
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-2/data/info.pb
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.29.131
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.20.29.190:32997,127.20.29.189:38617,127.20.29.188:41149
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.20.29.131
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-2/logs
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Aug 2026 17:52:48 UTC on ccycloud.quasar-oinjhi.root.comops.site
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4574925
19:18:58.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
19:18:58.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:58.491775 21202 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
19:18:58.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:58.493688 21202 file_cache.cc:493] Constructed file cache file cache with capacity 419430
19:18:58.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:58.514387 21211 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:18:59.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:59.093070 21194 heartbeater.cc:503] Master 127.20.29.188:41149 was elected leader, sending a full tablet report...
19:18:59.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:58.514420 21210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:18:59.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:58.514424 21213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:18:59.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:18:59.739751 21212 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
19:18:59.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:59.739912 21202 server_base.cc:1029] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
19:18:59.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:59.744714 21202 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
19:18:59.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:59.747733 21202 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
19:18:59.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:59.749241 21202 hybrid_clock.cc:648] HybridClock initialized: now 1786216739749156 us; error 81 us; skew 500 ppm
19:18:59.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:59.750358 21202 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
19:18:59.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:59.757479 21202 webserver.cc:460] Webserver started at http://127.20.29.131:41767/ using document root <none> and password file <none>
19:18:59.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:59.758424 21202 fs_manager.cc:359] Metadata directory not provided
19:18:59.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:59.758633 21202 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
19:18:59.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:59.759131 21202 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
19:18:59.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:59.764647 21202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-2/data/instance:
19:18:59.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d84acd69f34547a998b7d5feac3e2069"
19:18:59.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-08 19:18:59 on dist-test-slave-77v9"
19:18:59.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:59.766175 21202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-2/wal/instance:
19:18:59.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d84acd69f34547a998b7d5feac3e2069"
19:18:59.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-08 19:18:59 on dist-test-slave-77v9"
19:18:59.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:59.774544 21202 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.004s sys 0.004s
19:18:59.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:59.780687 21221 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
19:18:59.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:59.781919 21202 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
19:18:59.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:59.782289 21202 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-2/data,/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-2/wal
19:18:59.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d84acd69f34547a998b7d5feac3e2069"
19:18:59.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-08 19:18:59 on dist-test-slave-77v9"
19:18:59.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:59.782696 21202 fs_report.cc:383] FS layout report
19:18:59.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
19:18:59.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-2/wal
19:18:59.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-2/wal
19:18:59.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-2/data/data
19:18:59.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
19:18:59.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
19:18:59.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
19:18:59.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
19:18:59.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
19:18:59.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
19:18:59.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
19:18:59.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
19:18:59.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
19:18:59.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
19:18:59.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
19:18:59.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:59.821889 21202 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
19:18:59.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:59.823457 21202 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
19:18:59.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:59.823961 21202 kserver.cc:163] Server-wide thread pool size limit: 3276
19:18:59.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:59.826807 21202 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
19:18:59.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:59.831547 21202 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
19:18:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:59.831782 21202 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
19:18:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:59.832111 21202 ts_tablet_manager.cc:610] Registered 0 tablets
19:18:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:59.832304 21202 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
19:18:59.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:59.993656 21202 rpc_server.cc:307] RPC server started. Bound to: 127.20.29.131:41927
19:18:59.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:59.993758 21337 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.29.131:41927 every 8 connection(s)
19:18:59.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:18:59.996466 21202 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-2/data/info.pb
19:19:00.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:00.001390 20598 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu as pid 21202
19:19:00.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:00.001886 20598 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster4979054930043629469/ts-2/wal/instance
19:19:00.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:00.054984 21338 heartbeater.cc:347] Connected to a master server at 127.20.29.188:41149
19:19:00.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:00.055502 21338 heartbeater.cc:464] Registering TS with master...
19:19:00.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:00.056800 21338 heartbeater.cc:511] Master 127.20.29.188:41149 requested a full tablet report, sending...
19:19:00.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:00.057156 21339 heartbeater.cc:347] Connected to a master server at 127.20.29.189:38617
19:19:00.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:00.057528 21339 heartbeater.cc:464] Registering TS with master...
19:19:00.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:00.058421 21339 heartbeater.cc:511] Master 127.20.29.189:38617 requested a full tablet report, sending...
19:19:00.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:00.059934 20805 ts_manager.cc:194] Registered new tserver with Master: d84acd69f34547a998b7d5feac3e2069 (127.20.29.131:41927)
19:19:00.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:00.060709 21340 heartbeater.cc:347] Connected to a master server at 127.20.29.190:32997
19:19:00.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:00.061149 21340 heartbeater.cc:464] Registering TS with master...
19:19:00.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:00.061980 21340 heartbeater.cc:511] Master 127.20.29.190:32997 requested a full tablet report, sending...
19:19:00.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:00.062089 20723 ts_manager.cc:194] Registered new tserver with Master: d84acd69f34547a998b7d5feac3e2069 (127.20.29.131:41927)
19:19:00.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:00.062278 20805 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.29.131:45657
19:19:00.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:00.064545 20645 ts_manager.cc:194] Registered new tserver with Master: d84acd69f34547a998b7d5feac3e2069 (127.20.29.131:41927)
19:19:00.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:00.072465 20598 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
19:19:00.084 [DEBUG - main] (MiniKuduCluster.java:195) Response:
19:19:00.084 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}
19:19:00.085 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
masters {
id {
type: MASTER
index: 0
}
bound_rpc_address {
host: "127.20.29.190"
port: 32997
}
bound_http_address {
host: "127.20.29.190"
port: 44077
}
}
masters {
id {
type: MASTER
index: 1
}
bound_rpc_address {
host: "127.20.29.189"
port: 38617
}
bound_http_address {
host: "127.20.29.189"
port: 41017
}
}
masters {
id {
type: MASTER
index: 2
}
bound_rpc_address {
host: "127.20.29.188"
port: 41149
}
bound_http_address {
host: "127.20.29.188"
port: 35635
}
}
}
19:19:00.085 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}
19:19:00.086 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
tservers {
id {
type: TSERVER
index: 0
}
bound_rpc_address {
host: "127.20.29.129"
port: 45745
}
bound_http_address {
host: "127.20.29.129"
port: 41793
}
}
tservers {
id {
type: TSERVER
index: 1
}
bound_rpc_address {
host: "127.20.29.130"
port: 34181
}
bound_http_address {
host: "127.20.29.130"
port: 33413
}
}
tservers {
id {
type: TSERVER
index: 2
}
bound_rpc_address {
host: "127.20.29.131"
port: 41927
}
bound_http_address {
host: "127.20.29.131"
port: 41767
}
}
}
19:19:00.086 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
19:19:00.087 [DEBUG - main] (SecurityUtil.java:105) Using ticketCache: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster5679001063449127220/krb5kdc/krb5cc
19:19:00.088 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication
19:19:00.089 [INFO - Time-limited test] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskHiEzcr/test-tmp
19:19:00.090 [INFO - Time-limited test] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
19:19:00.090 [INFO - Time-limited test] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskHiEzcr/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
19:19:00.092 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: create_cluster {
num_masters: 3
num_tservers: 0
enable_kerberos: true
cluster_root: "/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921"
extra_master_flags: "--authn_token_validity_seconds=10"
hms_mode: NONE
mini_kdc_options {
ticket_lifetime: "10s"
renew_lifetime: "20s"
}
principal: "kudu"
mini_oidc_options {
}
}
19:19:00.458 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response:
19:19:00.459 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: start_cluster {
}
19:19:00.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:00.462709 21350 mini_oidc.cc:152] Starting JWKS server
19:19:00.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:00.466789 21350 webserver.cc:460] Webserver started at http://127.0.0.1:39227/ using document root <none> and password file <none>
19:19:00.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:00.467233 21350 mini_oidc.cc:189] Starting OIDC Discovery server
19:19:00.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:00.469233 21350 webserver.cc:460] Webserver started at http://127.0.0.1:41341/ using document root <none> and password file <none>
19:19:00.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Loading random data
19:19:00.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Initializing database '/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/principal' for realm 'KRBTEST.COM',
19:19:00.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master key name 'K/M@KRBTEST.COM'
19:19:00.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:00 dist-test-slave-77v9 krb5kdc[21361](info): setting up network...
19:19:00.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
19:19:00.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:00 dist-test-slave-77v9 krb5kdc[21361](info): set up 2 sockets
19:19:00.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:00 dist-test-slave-77v9 krb5kdc[21361](info): commencing operation
19:19:00.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) krb5kdc: starting...
19:19:01.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:01.067466 21338 heartbeater.cc:503] Master 127.20.29.188:41149 was elected leader, sending a full tablet report...
19:19:01.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:01.693384 21350 mini_kdc.cc:121] Time spent starting KDC: real 1.198s user 0.008s sys 0.018s
19:19:01.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
19:19:01.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
19:19:01.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "test-admin@KRBTEST.COM" created.
19:19:01.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
19:19:01.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
19:19:01.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "test-user@KRBTEST.COM" created.
19:19:01.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
19:19:01.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
19:19:01.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "joe-interloper@KRBTEST.COM" created.
19:19:01.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
19:19:01.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/test-user.keytab.
19:19:01.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/test-user.keytab.
19:19:01.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:01 dist-test-slave-77v9 krb5kdc[21361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216741, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
19:19:01.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Password for test-admin@KRBTEST.COM:
19:19:01.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-08-08T19:19:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
19:19:01.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-08-08T19:19:01Z Disabled control of system clock
19:19:01.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.20.217.190@KRBTEST.COM; defaulting to no policy
19:19:01.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
19:19:01.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.20.217.190@KRBTEST.COM" created.
19:19:01.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
19:19:01.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.20.217.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/kudu_127.20.217.190.keytab.
19:19:01.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.20.217.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/kudu_127.20.217.190.keytab.
19:19:01.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:01.919658 21350 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu
19:19:01.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu
19:19:01.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-0/wal
19:19:01.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-0/data
19:19:01.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
19:19:01.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
19:19:01.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
19:19:01.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
19:19:01.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
19:19:01.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
19:19:01.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-0/logs
19:19:01.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-0/data/info.pb
19:19:01.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
19:19:01.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
19:19:01.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
19:19:01.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
19:19:01.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
19:19:01.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
19:19:01.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
19:19:01.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
19:19:01.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
19:19:01.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
19:19:01.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
19:19:01.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
19:19:01.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.217.190:34755
19:19:01.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.217.190
19:19:01.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
19:19:01.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/kudu_127.20.217.190.keytab
19:19:01.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.20.217.190
19:19:01.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
19:19:01.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
19:19:01.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
19:19:01.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.217.148:42221
19:19:01.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
19:19:01.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
19:19:01.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
19:19:01.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
19:19:01.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.217.190:34755,127.20.217.189:33117,127.20.217.188:44291
19:19:01.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
19:19:01.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39227/jwks.json
19:19:01.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --authn_token_validity_seconds=10 with env {KRB5CCNAME=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
19:19:02.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:02.269548 21374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
19:19:02.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:02.270246 21374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
19:19:02.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:02.270913 21374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
19:19:02.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:02.305233 21374 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=10
19:19:02.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:02.305480 21374 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
19:19:02.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:02.305743 21374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
19:19:02.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:02.305950 21374 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
19:19:02.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:02.306136 21374 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
19:19:02.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:02.306324 21374 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
19:19:02.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:02.306479 21374 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:39227/jwks.json
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:02.345856 21374 master_runner.cc:386] Master server non-default flags:
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.217.148:42221
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-0/data
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-0/wal
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --authn_token_validity_seconds=10
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.217.190:34755,127.20.217.189:33117,127.20.217.188:44291
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/kudu_127.20.217.190.keytab
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.20.217.190
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.217.190:34755
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39227/jwks.json
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-0/data/info.pb
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.217.190
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
19:19:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-0/logs
19:19:02.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
19:19:02.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
19:19:02.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)
19:19:02.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
19:19:02.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
19:19:02.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
19:19:02.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
19:19:02.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Aug 2026 17:52:48 UTC on ccycloud.quasar-oinjhi.root.comops.site
19:19:02.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4574925
19:19:02.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
19:19:02.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:02.347025 21374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
19:19:02.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:02.348147 21374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
19:19:02.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:02.367132 21383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:19:03.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:02.367354 21380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:19:03.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:02.368618 21381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:19:03.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:02.368884 21374 server_base.cc:1034] running on GCE node
19:19:03.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:03.669046 21374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
19:19:03.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:03.672359 21374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
19:19:03.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:03.673728 21374 hybrid_clock.cc:648] HybridClock initialized: now 1786216743673711 us; error 148 us; skew 500 ppm
19:19:03.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:03.674695 21374 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
19:19:03.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:03 dist-test-slave-77v9 krb5kdc[21361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216743, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
19:19:03.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:03.681159 21374 init.cc:377] Logged in from keytab as kudu/127.20.217.190@KRBTEST.COM (short username kudu)
19:19:03.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:03.686592 21374 webserver.cc:460] Webserver started at http://127.20.217.190:38129/ using document root <none> and password file <none>
19:19:03.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:03.687528 21374 fs_manager.cc:359] Metadata directory not provided
19:19:03.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:03.687944 21374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
19:19:03.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:03.688511 21374 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
19:19:03.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:03.694299 21374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-0/data/instance:
19:19:03.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "182ce5514aa04757aaa67a23ad426967"
19:19:03.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-08 19:19:03 on dist-test-slave-77v9"
19:19:03.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:03.695485 21374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-0/wal/instance:
19:19:03.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "182ce5514aa04757aaa67a23ad426967"
19:19:03.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-08 19:19:03 on dist-test-slave-77v9"
19:19:03.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:03.703986 21374 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.005s sys 0.004s
19:19:03.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:03.710258 21394 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
19:19:03.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:03.711906 21374 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.002s
19:19:03.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:03.712252 21374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-0/data,/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-0/wal
19:19:03.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "182ce5514aa04757aaa67a23ad426967"
19:19:03.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-08 19:19:03 on dist-test-slave-77v9"
19:19:03.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:03.712808 21374 fs_report.cc:383] FS layout report
19:19:03.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
19:19:03.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-0/wal
19:19:03.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-0/wal
19:19:03.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-0/data/data
19:19:03.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
19:19:03.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
19:19:03.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
19:19:03.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
19:19:03.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
19:19:03.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
19:19:03.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
19:19:03.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
19:19:03.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
19:19:03.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
19:19:03.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
19:19:03.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:03.762145 21374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
19:19:03.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:03.769157 21374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
19:19:03.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:03.769695 21374 kserver.cc:163] Server-wide thread pool size limit: 3276
19:19:03.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:03.846843 21374 rpc_server.cc:307] RPC server started. Bound to: 127.20.217.190:34755
19:19:03.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:03.846949 21447 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.217.190:34755 every 8 connection(s)
19:19:03.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:03.849555 21374 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-0/data/info.pb
19:19:03.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:03.855705 21449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
19:19:03.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:03.856477 21350 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu as pid 21374
19:19:03.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:03.856983 21350 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-0/wal/instance
19:19:03.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:03.868541 21449 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } has no permanent_uuid. Determining permanent_uuid...
19:19:03.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.20.217.189@KRBTEST.COM; defaulting to no policy
19:19:03.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
19:19:03.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.20.217.189@KRBTEST.COM" created.
19:19:03.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:03 dist-test-slave-77v9 krb5kdc[21361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216743, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.217.190@KRBTEST.COM for kudu/127.20.217.190@KRBTEST.COM
19:19:03.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
19:19:03.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.20.217.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/kudu_127.20.217.189.keytab.
19:19:03.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.20.217.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/kudu_127.20.217.189.keytab.
19:19:03.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:03.908900 21449 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } has no permanent_uuid. Determining permanent_uuid...
19:19:03.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:03.910455 21350 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu
19:19:03.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu
19:19:03.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-1/wal
19:19:03.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-1/data
19:19:03.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-1/logs
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-1/data/info.pb
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.217.189:33117
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.217.189
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/kudu_127.20.217.189.keytab
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.20.217.189
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.217.148:42221
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.217.190:34755,127.20.217.189:33117,127.20.217.188:44291
19:19:03.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
19:19:03.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39227/jwks.json
19:19:03.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --authn_token_validity_seconds=10 with env {KRB5CCNAME=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
19:19:03.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:03.911410 21396 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.217.189:33117: connect: Connection refused (error 111)
19:19:03.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:03.916209 21449 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.217.189:33117: Network error: Client connection negotiation failed: client connection to 127.20.217.189:33117: connect: Connection refused (error 111)
19:19:03.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:03.965754 21449 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } attempt: 1
19:19:03.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:03.969514 21449 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.217.189:33117: Network error: Client connection negotiation failed: client connection to 127.20.217.189:33117: connect: Connection refused (error 111)
19:19:04.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:04.037948 21449 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } attempt: 2
19:19:04.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:04.041929 21449 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.217.189:33117: Network error: Client connection negotiation failed: client connection to 127.20.217.189:33117: connect: Connection refused (error 111)
19:19:04.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:04.133414 21449 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } attempt: 3
19:19:04.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:04.136878 21449 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.217.189:33117: Network error: Client connection negotiation failed: client connection to 127.20.217.189:33117: connect: Connection refused (error 111)
19:19:04.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:04.262921 21456 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
19:19:04.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:04.263579 21456 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
19:19:04.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:04.264264 21456 flags.cc:425] Enabled unsafe flag: --never_fsync=true
19:19:04.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:04.280351 21449 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } attempt: 4
19:19:04.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:04.284160 21449 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.217.189:33117: Network error: Client connection negotiation failed: client connection to 127.20.217.189:33117: connect: Connection refused (error 111)
19:19:04.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:04.300238 21456 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=10
19:19:04.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:04.300480 21456 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
19:19:04.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:04.300737 21456 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
19:19:04.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:04.301015 21456 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
19:19:04.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:04.301215 21456 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
19:19:04.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:04.301460 21456 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
19:19:04.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:04.301611 21456 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:39227/jwks.json
19:19:04.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:04.340970 21456 master_runner.cc:386] Master server non-default flags:
19:19:04.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
19:19:04.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.217.148:42221
19:19:04.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
19:19:04.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
19:19:04.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-1/data
19:19:04.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-1/wal
19:19:04.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --authn_token_validity_seconds=10
19:19:04.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
19:19:04.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.217.190:34755,127.20.217.189:33117,127.20.217.188:44291
19:19:04.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/kudu_127.20.217.189.keytab
19:19:04.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.20.217.189
19:19:04.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
19:19:04.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
19:19:04.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
19:19:04.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.217.189:33117
19:19:04.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
19:19:04.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
19:19:04.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
19:19:04.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39227/jwks.json
19:19:04.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
19:19:04.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
19:19:04.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
19:19:04.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
19:19:04.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
19:19:04.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-1/data/info.pb
19:19:04.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.217.189
19:19:04.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
19:19:04.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
19:19:04.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
19:19:04.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
19:19:04.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
19:19:04.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
19:19:04.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-1/logs
19:19:04.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
19:19:04.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
19:19:04.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)
19:19:04.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
19:19:04.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
19:19:04.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
19:19:04.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
19:19:04.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Aug 2026 17:52:48 UTC on ccycloud.quasar-oinjhi.root.comops.site
19:19:04.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4574925
19:19:04.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
19:19:04.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:04.342671 21456 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
19:19:04.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:04.344010 21456 file_cache.cc:493] Constructed file cache file cache with capacity 419430
19:19:04.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:04.365170 21463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:19:04.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:04.583691 21449 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } attempt: 5
19:19:04.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:04.587571 21449 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.217.189:33117: Network error: Client connection negotiation failed: client connection to 127.20.217.189:33117: connect: Connection refused (error 111)
19:19:05.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:05.135259 21449 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } attempt: 6
19:19:05.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:05.143299 21449 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.217.189:33117: Network error: Client connection negotiation failed: client connection to 127.20.217.189:33117: connect: Connection refused (error 111)
19:19:05.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:04.367349 21456 server_base.cc:1034] running on GCE node
19:19:05.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:04.365360 21462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:19:05.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:04.365257 21465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:19:05.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:05.650230 21456 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
19:19:05.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:05.653247 21456 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
19:19:05.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:05.654680 21456 hybrid_clock.cc:648] HybridClock initialized: now 1786216745654644 us; error 48 us; skew 500 ppm
19:19:05.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:05.655588 21456 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
19:19:05.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:05 dist-test-slave-77v9 krb5kdc[21361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216745, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.217.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
19:19:05.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:05.662331 21456 init.cc:377] Logged in from keytab as kudu/127.20.217.189@KRBTEST.COM (short username kudu)
19:19:05.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:05.668112 21456 webserver.cc:460] Webserver started at http://127.20.217.189:42945/ using document root <none> and password file <none>
19:19:05.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:05.669266 21456 fs_manager.cc:359] Metadata directory not provided
19:19:05.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:05.669515 21456 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
19:19:05.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:05.670185 21456 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
19:19:05.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:05.676942 21456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-1/data/instance:
19:19:05.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b1b6d9b7da644fd5969818ed01d67ff5"
19:19:05.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-08 19:19:05 on dist-test-slave-77v9"
19:19:05.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:05.678303 21456 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-1/wal/instance:
19:19:05.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b1b6d9b7da644fd5969818ed01d67ff5"
19:19:05.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-08 19:19:05 on dist-test-slave-77v9"
19:19:05.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:05.685901 21456 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
19:19:05.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:05.692229 21480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
19:19:05.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:05.693434 21456 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
19:19:05.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:05.693729 21456 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-1/data,/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-1/wal
19:19:05.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b1b6d9b7da644fd5969818ed01d67ff5"
19:19:05.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-08 19:19:05 on dist-test-slave-77v9"
19:19:05.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:05.694056 21456 fs_report.cc:383] FS layout report
19:19:05.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
19:19:05.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-1/wal
19:19:05.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-1/wal
19:19:05.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-1/data/data
19:19:05.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
19:19:05.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
19:19:05.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
19:19:05.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
19:19:05.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
19:19:05.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
19:19:05.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
19:19:05.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
19:19:05.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
19:19:05.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
19:19:05.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
19:19:05.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:05.731727 21456 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
19:19:05.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:05.737839 21456 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
19:19:05.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:05.738260 21456 kserver.cc:163] Server-wide thread pool size limit: 3276
19:19:05.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:05.815743 21456 rpc_server.cc:307] RPC server started. Bound to: 127.20.217.189:33117
19:19:05.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:05.815827 21534 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.217.189:33117 every 8 connection(s)
19:19:05.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:05.818567 21456 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-1/data/info.pb
19:19:05.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:05.823423 21350 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu as pid 21456
19:19:05.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:05.823961 21350 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-1/wal/instance
19:19:05.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:05.824684 21535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
19:19:05.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:05.839617 21535 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } has no permanent_uuid. Determining permanent_uuid...
19:19:05.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.20.217.188@KRBTEST.COM; defaulting to no policy
19:19:05.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
19:19:05.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.20.217.188@KRBTEST.COM" created.
19:19:05.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:05 dist-test-slave-77v9 krb5kdc[21361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216745, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.217.189@KRBTEST.COM for kudu/127.20.217.190@KRBTEST.COM
19:19:05.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
19:19:05.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.20.217.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/kudu_127.20.217.188.keytab.
19:19:05.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.20.217.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/kudu_127.20.217.188.keytab.
19:19:05.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:05.881584 21350 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu
19:19:05.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu
19:19:05.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-2/wal
19:19:05.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-2/data
19:19:05.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
19:19:05.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
19:19:05.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
19:19:05.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
19:19:05.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
19:19:05.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
19:19:05.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-2/logs
19:19:05.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-2/data/info.pb
19:19:05.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
19:19:05.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
19:19:05.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
19:19:05.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
19:19:05.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
19:19:05.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
19:19:05.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
19:19:05.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
19:19:05.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
19:19:05.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
19:19:05.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
19:19:05.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
19:19:05.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.217.188:44291
19:19:05.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.217.188
19:19:05.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
19:19:05.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/kudu_127.20.217.188.keytab
19:19:05.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.20.217.188
19:19:05.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
19:19:05.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
19:19:05.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
19:19:05.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.217.148:42221
19:19:05.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
19:19:05.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
19:19:05.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
19:19:05.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
19:19:05.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.217.190:34755,127.20.217.189:33117,127.20.217.188:44291
19:19:05.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
19:19:05.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39227/jwks.json
19:19:05.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --authn_token_validity_seconds=10 with env {KRB5CCNAME=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
19:19:05.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:05.881966 21535 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } has no permanent_uuid. Determining permanent_uuid...
19:19:05.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:05 dist-test-slave-77v9 krb5kdc[21361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216745, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.217.189@KRBTEST.COM for kudu/127.20.217.189@KRBTEST.COM
19:19:05.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:05.911888 21535 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } has no permanent_uuid. Determining permanent_uuid...
19:19:05.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:05.914638 21483 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.217.188:44291: connect: Connection refused (error 111)
19:19:05.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:05.920567 21535 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.217.188:44291: Network error: Client connection negotiation failed: client connection to 127.20.217.188:44291: connect: Connection refused (error 111)
19:19:05.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:05.970152 21535 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } attempt: 1
19:19:05.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:05.974114 21535 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.217.188:44291: Network error: Client connection negotiation failed: client connection to 127.20.217.188:44291: connect: Connection refused (error 111)
19:19:06.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:06.042454 21535 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } attempt: 2
19:19:06.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:06.046276 21535 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.217.188:44291: Network error: Client connection negotiation failed: client connection to 127.20.217.188:44291: connect: Connection refused (error 111)
19:19:06.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:06.137765 21535 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } attempt: 3
19:19:06.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:06.142059 21535 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.217.188:44291: Network error: Client connection negotiation failed: client connection to 127.20.217.188:44291: connect: Connection refused (error 111)
19:19:06.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:06.203799 21449 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } attempt: 7
19:19:06.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:06 dist-test-slave-77v9 krb5kdc[21361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216743, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.217.190@KRBTEST.COM for kudu/127.20.217.189@KRBTEST.COM
19:19:06.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:06.232297 21449 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } has no permanent_uuid. Determining permanent_uuid...
19:19:06.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:06.239140 21449 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.217.188:44291: Network error: Client connection negotiation failed: client connection to 127.20.217.188:44291: connect: Connection refused (error 111)
19:19:06.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:06.239636 21542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
19:19:06.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:06.240403 21542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
19:19:06.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:06.241467 21542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
19:19:06.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:06.279510 21542 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=10
19:19:06.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:06.279762 21542 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
19:19:06.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:06.280114 21542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
19:19:06.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:06.280337 21542 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
19:19:06.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:06.280531 21542 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
19:19:06.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:06.280720 21542 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
19:19:06.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:06.280884 21542 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:39227/jwks.json
19:19:06.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:06.285526 21535 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } attempt: 4
19:19:06.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:06.289821 21535 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.217.188:44291: Network error: Client connection negotiation failed: client connection to 127.20.217.188:44291: connect: Connection refused (error 111)
19:19:06.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:06.297593 21449 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } attempt: 1
19:19:06.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:06.301287 21449 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.217.188:44291: Network error: Client connection negotiation failed: client connection to 127.20.217.188:44291: connect: Connection refused (error 111)
19:19:06.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:06.321554 21542 master_runner.cc:386] Master server non-default flags:
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.217.148:42221
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-2/data
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-2/wal
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --authn_token_validity_seconds=10
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.217.190:34755,127.20.217.189:33117,127.20.217.188:44291
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/kudu_127.20.217.188.keytab
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.20.217.188
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.217.188:44291
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39227/jwks.json
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-2/data/info.pb
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.217.188
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-2/logs
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Aug 2026 17:52:48 UTC on ccycloud.quasar-oinjhi.root.comops.site
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4574925
19:19:06.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
19:19:06.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:06.322805 21542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
19:19:06.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:06.323860 21542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
19:19:06.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:06.342087 21553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:19:06.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:06.382778 21449 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } attempt: 2
19:19:06.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:06.387398 21449 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.217.188:44291: Network error: Client connection negotiation failed: client connection to 127.20.217.188:44291: connect: Connection refused (error 111)
19:19:06.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:06.472962 21449 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } attempt: 3
19:19:06.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:06.476990 21449 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.217.188:44291: Network error: Client connection negotiation failed: client connection to 127.20.217.188:44291: connect: Connection refused (error 111)
19:19:06.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:06.589352 21535 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } attempt: 5
19:19:06.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:06.595832 21535 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.217.188:44291: Network error: Client connection negotiation failed: client connection to 127.20.217.188:44291: connect: Connection refused (error 111)
19:19:06.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:06.617735 21449 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } attempt: 4
19:19:06.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:06.623747 21449 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.217.188:44291: Network error: Client connection negotiation failed: client connection to 127.20.217.188:44291: connect: Connection refused (error 111)
19:19:06.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:06.907284 21449 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } attempt: 5
19:19:06.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:06.912089 21449 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.217.188:44291: Network error: Client connection negotiation failed: client connection to 127.20.217.188:44291: connect: Connection refused (error 111)
19:19:07.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.143478 21535 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } attempt: 6
19:19:07.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:07.152387 21535 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.217.188:44291: Network error: Client connection negotiation failed: client connection to 127.20.217.188:44291: connect: Connection refused (error 111)
19:19:07.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.464524 21449 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } attempt: 6
19:19:07.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:07.471758 21449 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.217.188:44291: Network error: Client connection negotiation failed: client connection to 127.20.217.188:44291: connect: Connection refused (error 111)
19:19:07.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:06.349519 21542 server_base.cc:1034] running on GCE node
19:19:07.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:06.342075 21555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:19:07.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:06.343526 21552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:19:07.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.648949 21542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
19:19:07.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.651957 21542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
19:19:07.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.653374 21542 hybrid_clock.cc:648] HybridClock initialized: now 1786216747653317 us; error 56 us; skew 500 ppm
19:19:07.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.654482 21542 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
19:19:07.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:07 dist-test-slave-77v9 krb5kdc[21361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216747, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.217.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
19:19:07.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.664395 21542 init.cc:377] Logged in from keytab as kudu/127.20.217.188@KRBTEST.COM (short username kudu)
19:19:07.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.670384 21542 webserver.cc:460] Webserver started at http://127.20.217.188:36961/ using document root <none> and password file <none>
19:19:07.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.671429 21542 fs_manager.cc:359] Metadata directory not provided
19:19:07.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.671649 21542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
19:19:07.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.672108 21542 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
19:19:07.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.677984 21542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-2/data/instance:
19:19:07.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "195c20c036cd49c4be4abc4869f7e664"
19:19:07.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-08 19:19:07 on dist-test-slave-77v9"
19:19:07.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.679320 21542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-2/wal/instance:
19:19:07.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "195c20c036cd49c4be4abc4869f7e664"
19:19:07.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-08 19:19:07 on dist-test-slave-77v9"
19:19:07.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.687674 21542 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.006s sys 0.003s
19:19:07.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.693986 21569 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
19:19:07.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.695353 21542 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.002s
19:19:07.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.695698 21542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-2/data,/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-2/wal
19:19:07.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "195c20c036cd49c4be4abc4869f7e664"
19:19:07.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-08 19:19:07 on dist-test-slave-77v9"
19:19:07.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.696050 21542 fs_report.cc:383] FS layout report
19:19:07.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
19:19:07.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-2/wal
19:19:07.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-2/wal
19:19:07.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-2/data/data
19:19:07.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
19:19:07.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
19:19:07.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
19:19:07.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
19:19:07.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
19:19:07.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
19:19:07.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
19:19:07.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
19:19:07.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
19:19:07.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
19:19:07.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
19:19:07.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.738891 21542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
19:19:07.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.745595 21542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
19:19:07.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.746021 21542 kserver.cc:163] Server-wide thread pool size limit: 3276
19:19:07.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.828286 21542 rpc_server.cc:307] RPC server started. Bound to: 127.20.217.188:44291
19:19:07.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.828402 21621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.217.188:44291 every 8 connection(s)
19:19:07.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.831111 21542 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-2/data/info.pb
19:19:07.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.837219 21622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
19:19:07.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.837890 21350 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu as pid 21542
19:19:07.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.838348 21350 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-2/wal/instance
19:19:07.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.854260 21622 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } has no permanent_uuid. Determining permanent_uuid...
19:19:07.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:07 dist-test-slave-77v9 krb5kdc[21361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216747, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.217.188@KRBTEST.COM for kudu/127.20.217.190@KRBTEST.COM
19:19:07.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:07 dist-test-slave-77v9 krb5kdc[21361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216741, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.217.188@KRBTEST.COM
19:19:07.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.888236 21622 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } has no permanent_uuid. Determining permanent_uuid...
19:19:07.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:07 dist-test-slave-77v9 krb5kdc[21361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216747, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.217.188@KRBTEST.COM for kudu/127.20.217.189@KRBTEST.COM
19:19:07.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:07 dist-test-slave-77v9 krb5kdc[21361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216741, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.217.189@KRBTEST.COM
19:19:07.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.923585 21622 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } has no permanent_uuid. Determining permanent_uuid...
19:19:07.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:07 dist-test-slave-77v9 krb5kdc[21361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216747, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.217.188@KRBTEST.COM for kudu/127.20.217.188@KRBTEST.COM
19:19:07.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:07 dist-test-slave-77v9 krb5kdc[21361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216741, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.217.190@KRBTEST.COM
19:19:07.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.961396 21622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664: Bootstrap starting.
19:19:07.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.964607 21350 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
19:19:07.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.969304 21622 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664: Neither blocks nor log segments found. Creating new log.
19:19:07.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.971840 21622 log.cc:824] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664: Log is configured to *not* fsync() on all Append() calls
19:19:07.976 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response:
19:19:07.976 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: get_kdc_env_vars {
}
19:19:07.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:07.977753 21622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664: No bootstrap required, opened a new log
19:19:07.978 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: get_kdc_env_vars {
env_vars {
key: "KRB5CCNAME"
value: "/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/krb5cc"
}
env_vars {
key: "KRB5_CONFIG"
value: "/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/krb5.conf"
}
env_vars {
key: "KRB5_KDC_PROFILE"
value: "/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/kdc.conf"
}
env_vars {
key: "KUDU_ENABLE_KRB5_REALM_FIX"
value: "yes"
}
}
19:19:07.978 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: get_masters {
}
19:19:07.979 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: get_masters {
masters {
id {
type: MASTER
index: 0
}
bound_rpc_address {
host: "127.20.217.190"
port: 34755
}
bound_http_address {
host: "127.20.217.190"
port: 38129
}
}
masters {
id {
type: MASTER
index: 1
}
bound_rpc_address {
host: "127.20.217.189"
port: 33117
}
bound_http_address {
host: "127.20.217.189"
port: 42945
}
}
masters {
id {
type: MASTER
index: 2
}
bound_rpc_address {
host: "127.20.217.188"
port: 44291
}
bound_http_address {
host: "127.20.217.188"
port: 36961
}
}
}
19:19:07.981 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: get_tservers {
}
19:19:07.981 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response:
19:19:07.981 [INFO - Time-limited test] (MiniKuduCluster.java:622) Running kinit for user test-admin
19:19:07.981 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: kinit {
username: "test-admin"
}
19:19:08.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.005203 21622 raft_consensus.cc:348] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } }
19:19:08.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.006048 21622 raft_consensus.cc:374] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
19:19:08.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.006317 21622 raft_consensus.cc:729] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 195c20c036cd49c4be4abc4869f7e664, State: Initialized, Role: FOLLOWER
19:19:08.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.007167 21622 consensus_queue.cc:260] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } }
19:19:08.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.010303 21634 sys_catalog.cc:455] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } } }
19:19:08.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.011205 21634 sys_catalog.cc:458] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [sys.catalog]: This master's current role is: FOLLOWER
19:19:08.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.012223 21622 sys_catalog.cc:564] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [sys.catalog]: configured and running, proceeding with master startup.
19:19:08.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:08 dist-test-slave-77v9 krb5kdc[21361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216748, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
19:19:08.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Password for test-admin@KRBTEST.COM:
19:19:08.020 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response:
19:19:08.022 [DEBUG - Time-limited test] (SecurityUtil.java:105) Using ticketCache: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/krb5cc
19:19:08.023 [DEBUG - Time-limited test] (SecurityUtil.java:119) Logged in as subject: test-admin@KRBTEST.COM
19:19:08.023 [INFO - Time-limited test] (MiniKuduCluster.java:622) Running kinit for user test-user
19:19:08.023 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: kinit {
username: "test-user"
}
19:19:08.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:08.050462 21647 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
19:19:08.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:08.050854 21647 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
19:19:08.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:08 dist-test-slave-77v9 krb5kdc[21361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216748, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
19:19:08.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Password for test-user@KRBTEST.COM:
19:19:08.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.043135 21542 master_runner.cc:186] Error getting master registration for 127.20.217.190:34755: OK, instance_id { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" instance_seqno: 1786216743825525 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
19:19:08.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.078612 21542 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
19:19:08.079 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response:
19:19:08.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.213061 21535 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } attempt: 7
19:19:08.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:08 dist-test-slave-77v9 krb5kdc[21361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216745, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.217.189@KRBTEST.COM for kudu/127.20.217.188@KRBTEST.COM
19:19:08.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:08.251672 21575 tablet.cc:2369] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664: Can't schedule compaction. Clean time has not been advanced past its initial value.
19:19:08.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.254537 21535 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5: Bootstrap starting.
19:19:08.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.261281 21535 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5: Neither blocks nor log segments found. Creating new log.
19:19:08.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.263657 21535 log.cc:824] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5: Log is configured to *not* fsync() on all Append() calls
19:19:08.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.269199 21535 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5: No bootstrap required, opened a new log
19:19:08.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.294085 21535 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } }
19:19:08.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.294703 21535 raft_consensus.cc:374] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
19:19:08.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.294970 21535 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1b6d9b7da644fd5969818ed01d67ff5, State: Initialized, Role: FOLLOWER
19:19:08.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.295678 21535 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } }
19:19:08.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.298892 21652 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } } }
19:19:08.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.299801 21652 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [sys.catalog]: This master's current role is: FOLLOWER
19:19:08.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.300750 21535 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [sys.catalog]: configured and running, proceeding with master startup.
19:19:08.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:08.332289 21663 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
19:19:08.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:08.332888 21663 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
19:19:08.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.335108 21634 raft_consensus.cc:482] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
19:19:08.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.335668 21634 raft_consensus.cc:504] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } }
19:19:08.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.341745 21510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "195c20c036cd49c4be4abc4869f7e664" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" is_pre_election: true
19:19:08.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.342741 21510 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 195c20c036cd49c4be4abc4869f7e664 in term 0.
19:19:08.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.344588 21571 leader_election.cc:302] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 195c20c036cd49c4be4abc4869f7e664, b1b6d9b7da644fd5969818ed01d67ff5; no voters:
19:19:08.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.346864 21634 leader_election.cc:288] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 182ce5514aa04757aaa67a23ad426967 (127.20.217.190:34755), b1b6d9b7da644fd5969818ed01d67ff5 (127.20.217.189:33117)
19:19:08.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.347734 21634 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [term 0 FOLLOWER]: Leader pre-election won for term 1
19:19:08.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.348506 21634 raft_consensus.cc:482] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
19:19:08.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.349450 21634 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [term 0 FOLLOWER]: Advancing to term 1
19:19:08.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.326948 21456 master_runner.cc:186] Error getting master registration for 127.20.217.190:34755: OK, instance_id { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" instance_seqno: 1786216743825525 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
19:19:08.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.366262 21456 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
19:19:08.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.371330 21634 raft_consensus.cc:504] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } }
19:19:08.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.375211 21510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "195c20c036cd49c4be4abc4869f7e664" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b1b6d9b7da644fd5969818ed01d67ff5"
19:19:08.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.375902 21510 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [term 0 FOLLOWER]: Advancing to term 1
19:19:08.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.385586 21510 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 195c20c036cd49c4be4abc4869f7e664 in term 1.
19:19:08.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.392769 21571 leader_election.cc:302] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 195c20c036cd49c4be4abc4869f7e664, b1b6d9b7da644fd5969818ed01d67ff5; no voters:
19:19:08.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.385033 21634 leader_election.cc:288] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [CANDIDATE]: Term 1 election: Requested vote from peers 182ce5514aa04757aaa67a23ad426967 (127.20.217.190:34755), b1b6d9b7da644fd5969818ed01d67ff5 (127.20.217.189:33117)
19:19:08.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.398588 21665 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [term 1 FOLLOWER]: Leader election won for term 1
19:19:08.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.403270 21665 raft_consensus.cc:686] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [term 1 LEADER]: Becoming Leader. State: Replica: 195c20c036cd49c4be4abc4869f7e664, State: Running, Role: LEADER
19:19:08.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.409286 21665 consensus_queue.cc:237] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } }
19:19:08.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.445101 21634 sys_catalog.cc:455] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 195c20c036cd49c4be4abc4869f7e664. Latest consensus state: current_term: 1 leader_uuid: "195c20c036cd49c4be4abc4869f7e664" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } } }
19:19:08.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.445902 21634 sys_catalog.cc:458] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [sys.catalog]: This master's current role is: LEADER
19:19:08.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.450502 21668 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
19:19:08.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.474649 21668 catalog_manager.cc:1484] Initializing Kudu cluster ID...
19:19:08.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:08.497288 21487 tablet.cc:2369] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5: Can't schedule compaction. Clean time has not been advanced past its initial value.
19:19:08.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.501986 21510 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [term 1 FOLLOWER]: Refusing update from remote peer 195c20c036cd49c4be4abc4869f7e664: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
19:19:08.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.504956 21634 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
19:19:08.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.506523 21449 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } attempt: 7
19:19:08.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.543538 21669 mvcc.cc:205] Tried to move back new op lower bound from 7316343801841041408 to 7316343801552453632. Current Snapshot: MvccSnapshot[applied={T|T < 7316343801841041408}]
19:19:08.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.545790 21665 sys_catalog.cc:455] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "195c20c036cd49c4be4abc4869f7e664" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } } }
19:19:08.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.546571 21665 sys_catalog.cc:458] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [sys.catalog]: This master's current role is: LEADER
19:19:08.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.551007 21652 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 195c20c036cd49c4be4abc4869f7e664. Latest consensus state: current_term: 1 leader_uuid: "195c20c036cd49c4be4abc4869f7e664" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } } }
19:19:08.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.551882 21652 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [sys.catalog]: This master's current role is: FOLLOWER
19:19:08.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.555562 21668 catalog_manager.cc:1347] Generated new cluster ID: 52603af8e27046f792abbb4a5443c049
19:19:08.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.555863 21668 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
19:19:08.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:08 dist-test-slave-77v9 krb5kdc[21361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216743, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.217.190@KRBTEST.COM for kudu/127.20.217.188@KRBTEST.COM
19:19:08.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.579037 21652 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "195c20c036cd49c4be4abc4869f7e664" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } } }
19:19:08.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.579881 21652 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [sys.catalog]: This master's current role is: FOLLOWER
19:19:08.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.595212 21449 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967: Bootstrap starting.
19:19:08.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.604220 21449 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967: Neither blocks nor log segments found. Creating new log.
19:19:08.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.607134 21449 log.cc:824] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967: Log is configured to *not* fsync() on all Append() calls
19:19:08.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.627745 21449 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967: No bootstrap required, opened a new log
19:19:08.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.651631 21668 catalog_manager.cc:1370] Generated new certificate authority record
19:19:08.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.654336 21668 catalog_manager.cc:1504] Loading token signing keys...
19:19:08.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.681841 21668 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664: Generated new TSK 0
19:19:08.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.683121 21668 catalog_manager.cc:1514] Initializing in-progress tserver states...
19:19:08.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.703253 21449 raft_consensus.cc:348] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } }
19:19:08.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.704166 21449 raft_consensus.cc:374] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
19:19:08.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.704473 21449 raft_consensus.cc:729] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 182ce5514aa04757aaa67a23ad426967, State: Initialized, Role: FOLLOWER
19:19:08.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.705417 21449 consensus_queue.cc:260] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } }
19:19:08.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.716728 21422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "195c20c036cd49c4be4abc4869f7e664" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "182ce5514aa04757aaa67a23ad426967" is_pre_election: true
19:19:08.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.717185 21678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } } }
19:19:08.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.716323 21449 sys_catalog.cc:564] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967 [sys.catalog]: configured and running, proceeding with master startup.
19:19:08.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.719848 21421 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "195c20c036cd49c4be4abc4869f7e664" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "182ce5514aa04757aaa67a23ad426967"
19:19:08.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.718924 21678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967 [sys.catalog]: This master's current role is: FOLLOWER
19:19:08.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.724524 21420 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967 [term 0 FOLLOWER]: Advancing to term 1
19:19:08.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.732594 21420 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967 [term 1 FOLLOWER]: Refusing update from remote peer 195c20c036cd49c4be4abc4869f7e664: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
19:19:08.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.734637 21634 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [LEADER]: Connected to new peer: Peer: permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
19:19:08.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.807113 21678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 195c20c036cd49c4be4abc4869f7e664. Latest consensus state: current_term: 1 leader_uuid: "195c20c036cd49c4be4abc4869f7e664" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } } }
19:19:08.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.807265 21686 sys_catalog.cc:455] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "195c20c036cd49c4be4abc4869f7e664" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } } }
19:19:08.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.807933 21678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967 [sys.catalog]: This master's current role is: FOLLOWER
19:19:08.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.808099 21686 sys_catalog.cc:458] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967 [sys.catalog]: This master's current role is: FOLLOWER
19:19:08.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.884344 21695 catalog_manager.cc:1259] Loaded cluster ID: 52603af8e27046f792abbb4a5443c049
19:19:08.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.884653 21695 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967: loading cluster ID for follower catalog manager: success
19:19:08.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.892627 21695 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967: acquiring CA information for follower catalog manager: success
19:19:08.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:08.899168 21695 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
19:19:09.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:09.207741 21634 sys_catalog.cc:455] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "195c20c036cd49c4be4abc4869f7e664" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } } }
19:19:09.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:09.208622 21634 sys_catalog.cc:458] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [sys.catalog]: This master's current role is: LEADER
19:19:09.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:09.339249 21663 catalog_manager.cc:1259] Loaded cluster ID: 52603af8e27046f792abbb4a5443c049
19:19:09.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:09.339854 21663 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5: loading cluster ID for follower catalog manager: success
19:19:09.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:09.348373 21663 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5: acquiring CA information for follower catalog manager: success
19:19:09.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:09.355810 21663 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
19:19:11.081 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.20.217.189:33117
19:19:11.082 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
id {
type: MASTER
index: 1
}
}
19:19:11.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:11.083308 21350 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu with pid 21456
19:19:11.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:11.134769 21571 connection.cc:535] client connection to 127.20.217.189:33117 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
19:19:11.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:11.135231 21571 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
19:19:11.141 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response:
19:19:11.141 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.20.217.188:44291
19:19:11.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:11.141302 21571 consensus_peers.cc:487] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 -> Peer b1b6d9b7da644fd5969818ed01d67ff5 (127.20.217.189:33117): Couldn't send request to peer b1b6d9b7da644fd5969818ed01d67ff5. Status: Network error: Client connection negotiation failed: client connection to 127.20.217.189:33117: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
19:19:11.141 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
id {
type: MASTER
index: 2
}
}
19:19:11.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:11.141987 21350 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu with pid 21542
19:19:11.183 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response:
19:19:11.183 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.20.217.190:34755
19:19:11.183 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
id {
type: MASTER
index: 0
}
}
19:19:11.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:11.184404 21350 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu with pid 21374
19:19:11.223 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response:
19:19:11.224 [INFO - Time-limited test] (MiniKuduCluster.java:380) Starting master server 127.20.217.189:33117
19:19:11.224 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: start_daemon {
id {
type: MASTER
index: 1
}
}
19:19:11.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:11.226290 21350 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu
19:19:11.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu
19:19:11.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-1/wal
19:19:11.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-1/data
19:19:11.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
19:19:11.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
19:19:11.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
19:19:11.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
19:19:11.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
19:19:11.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
19:19:11.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-1/logs
19:19:11.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-1/data/info.pb
19:19:11.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
19:19:11.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
19:19:11.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
19:19:11.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
19:19:11.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
19:19:11.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
19:19:11.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
19:19:11.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
19:19:11.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
19:19:11.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
19:19:11.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
19:19:11.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
19:19:11.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.217.189:33117
19:19:11.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.217.189
19:19:11.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=42945
19:19:11.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/kudu_127.20.217.189.keytab
19:19:11.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.20.217.189
19:19:11.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
19:19:11.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
19:19:11.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
19:19:11.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.217.148:42221
19:19:11.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
19:19:11.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
19:19:11.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
19:19:11.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
19:19:11.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.217.190:34755,127.20.217.189:33117,127.20.217.188:44291
19:19:11.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
19:19:11.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39227/jwks.json
19:19:11.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --authn_token_validity_seconds=10 with env {KRB5CCNAME=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
19:19:11.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:11.577822 21704 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
19:19:11.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:11.578609 21704 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
19:19:11.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:11.579402 21704 flags.cc:425] Enabled unsafe flag: --never_fsync=true
19:19:11.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:11.615581 21704 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=10
19:19:11.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:11.615907 21704 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
19:19:11.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:11.616357 21704 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
19:19:11.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:11.616676 21704 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
19:19:11.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:11.617015 21704 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
19:19:11.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:11.617468 21704 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
19:19:11.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:11.617843 21704 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:39227/jwks.json
19:19:11.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:11.660172 21704 master_runner.cc:386] Master server non-default flags:
19:19:11.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
19:19:11.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.217.148:42221
19:19:11.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
19:19:11.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
19:19:11.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-1/data
19:19:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-1/wal
19:19:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --authn_token_validity_seconds=10
19:19:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
19:19:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.217.190:34755,127.20.217.189:33117,127.20.217.188:44291
19:19:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/kudu_127.20.217.189.keytab
19:19:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.20.217.189
19:19:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
19:19:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
19:19:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
19:19:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.217.189:33117
19:19:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
19:19:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
19:19:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
19:19:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39227/jwks.json
19:19:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
19:19:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
19:19:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
19:19:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
19:19:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
19:19:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-1/data/info.pb
19:19:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.217.189
19:19:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=42945
19:19:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
19:19:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
19:19:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
19:19:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
19:19:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
19:19:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-1/logs
19:19:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
19:19:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
19:19:11.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)
19:19:11.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
19:19:11.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
19:19:11.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
19:19:11.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
19:19:11.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Aug 2026 17:52:48 UTC on ccycloud.quasar-oinjhi.root.comops.site
19:19:11.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4574925
19:19:11.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
19:19:11.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:11.661809 21704 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
19:19:11.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:11.663051 21704 file_cache.cc:493] Constructed file cache file cache with capacity 419430
19:19:11.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:11.681783 21710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:19:13.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:11.681836 21711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:19:13.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:11.683426 21713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:19:13.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:13.090215 21712 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1406 milliseconds
19:19:13.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.090358 21704 server_base.cc:1029] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
19:19:13.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.091801 21704 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
19:19:13.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.094605 21704 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
19:19:13.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.095988 21704 hybrid_clock.cc:648] HybridClock initialized: now 1786216753095963 us; error 40 us; skew 500 ppm
19:19:13.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.096961 21704 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
19:19:13.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:13 dist-test-slave-77v9 krb5kdc[21361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216753, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.217.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
19:19:13.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.108652 21704 init.cc:377] Logged in from keytab as kudu/127.20.217.189@KRBTEST.COM (short username kudu)
19:19:13.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.115767 21704 webserver.cc:460] Webserver started at http://127.20.217.189:42945/ using document root <none> and password file <none>
19:19:13.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.117156 21704 fs_manager.cc:359] Metadata directory not provided
19:19:13.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.117486 21704 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
19:19:13.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.131997 21704 fs_manager.cc:709] Time spent opening directory manager: real 0.010s user 0.002s sys 0.005s
19:19:13.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.138561 21722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
19:19:13.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.140120 21704 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.003s
19:19:13.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.140625 21704 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-1/data,/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-1/wal
19:19:13.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b1b6d9b7da644fd5969818ed01d67ff5"
19:19:13.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-08 19:19:05 on dist-test-slave-77v9"
19:19:13.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.144798 21704 fs_report.cc:383] FS layout report
19:19:13.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
19:19:13.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-1/wal
19:19:13.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-1/wal
19:19:13.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-1/data/data
19:19:13.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
19:19:13.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
19:19:13.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
19:19:13.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
19:19:13.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
19:19:13.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
19:19:13.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
19:19:13.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
19:19:13.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
19:19:13.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
19:19:13.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
19:19:13.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.208164 21704 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
19:19:13.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.217136 21704 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
19:19:13.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.217788 21704 kserver.cc:163] Server-wide thread pool size limit: 3276
19:19:13.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.313114 21704 rpc_server.cc:307] RPC server started. Bound to: 127.20.217.189:33117
19:19:13.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.313246 21776 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.217.189:33117 every 8 connection(s)
19:19:13.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.316392 21704 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-1/data/info.pb
19:19:13.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.321602 21350 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu as pid 21704
19:19:13.322 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response:
19:19:13.322 [INFO - Time-limited test] (MiniKuduCluster.java:380) Starting master server 127.20.217.188:44291
19:19:13.322 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: start_daemon {
id {
type: MASTER
index: 2
}
}
19:19:13.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.324333 21350 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu
19:19:13.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu
19:19:13.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-2/wal
19:19:13.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-2/data
19:19:13.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
19:19:13.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
19:19:13.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
19:19:13.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
19:19:13.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
19:19:13.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
19:19:13.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-2/logs
19:19:13.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-2/data/info.pb
19:19:13.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
19:19:13.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
19:19:13.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
19:19:13.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
19:19:13.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
19:19:13.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
19:19:13.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
19:19:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
19:19:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
19:19:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
19:19:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
19:19:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
19:19:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.217.188:44291
19:19:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.217.188
19:19:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=36961
19:19:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/kudu_127.20.217.188.keytab
19:19:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.20.217.188
19:19:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
19:19:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
19:19:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
19:19:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.217.148:42221
19:19:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
19:19:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
19:19:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
19:19:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
19:19:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.217.190:34755,127.20.217.189:33117,127.20.217.188:44291
19:19:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
19:19:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39227/jwks.json
19:19:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --authn_token_validity_seconds=10 with env {KRB5CCNAME=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
19:19:13.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.330228 21777 sys_catalog.cc:263] Verifying existing consensus state
19:19:13.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.337659 21777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5: Bootstrap starting.
19:19:13.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.382040 21777 log.cc:824] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5: Log is configured to *not* fsync() on all Append() calls
19:19:13.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.402158 21777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
19:19:13.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.403301 21777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5: Bootstrap complete.
19:19:13.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.446828 21777 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } }
19:19:13.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.449723 21777 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1b6d9b7da644fd5969818ed01d67ff5, State: Initialized, Role: FOLLOWER
19:19:13.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.450492 21777 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } }
19:19:13.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.453186 21783 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } } }
19:19:13.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.454088 21783 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [sys.catalog]: This master's current role is: FOLLOWER
19:19:13.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.454620 21777 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [sys.catalog]: configured and running, proceeding with master startup.
19:19:13.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.498246 21794 catalog_manager.cc:1259] Loaded cluster ID: 52603af8e27046f792abbb4a5443c049
19:19:13.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.498746 21794 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5: loading cluster ID for follower catalog manager: success
19:19:13.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.508327 21794 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5: acquiring CA information for follower catalog manager: success
19:19:13.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.516279 21794 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
19:19:13.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.484560 21704 master_runner.cc:186] Error getting master registration for 127.20.217.190:34755: Network error: Client connection negotiation failed: client connection to 127.20.217.190:34755: connect: Connection refused (error 111),
19:19:13.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.518642 21704 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
19:19:13.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:13.710726 21781 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
19:19:13.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:13.711519 21781 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
19:19:13.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:13.712422 21781 flags.cc:425] Enabled unsafe flag: --never_fsync=true
19:19:13.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:13.749269 21781 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=10
19:19:13.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:13.749504 21781 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
19:19:13.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:13.749763 21781 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
19:19:13.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:13.749970 21781 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
19:19:13.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:13.750160 21781 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
19:19:13.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:13.750347 21781 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
19:19:13.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:13.750487 21781 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:39227/jwks.json
19:19:13.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.793738 21781 master_runner.cc:386] Master server non-default flags:
19:19:13.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
19:19:13.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.217.148:42221
19:19:13.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
19:19:13.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
19:19:13.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-2/data
19:19:13.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-2/wal
19:19:13.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --authn_token_validity_seconds=10
19:19:13.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
19:19:13.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.217.190:34755,127.20.217.189:33117,127.20.217.188:44291
19:19:13.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/kudu_127.20.217.188.keytab
19:19:13.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.20.217.188
19:19:13.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
19:19:13.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
19:19:13.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
19:19:13.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.217.188:44291
19:19:13.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
19:19:13.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
19:19:13.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
19:19:13.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39227/jwks.json
19:19:13.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
19:19:13.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
19:19:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
19:19:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
19:19:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
19:19:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-2/data/info.pb
19:19:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.217.188
19:19:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=36961
19:19:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
19:19:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
19:19:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
19:19:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
19:19:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
19:19:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-2/logs
19:19:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
19:19:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
19:19:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)
19:19:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
19:19:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
19:19:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
19:19:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
19:19:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Aug 2026 17:52:48 UTC on ccycloud.quasar-oinjhi.root.comops.site
19:19:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4574925
19:19:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
19:19:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.795189 21781 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
19:19:13.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:13.796386 21781 file_cache.cc:493] Constructed file cache file cache with capacity 419430
19:19:13.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:13.819826 21803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:19:14.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:14.663480 21811 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
19:19:14.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:14.664114 21811 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } }
19:19:14.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:14.670357 21811 leader_election.cc:288] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 182ce5514aa04757aaa67a23ad426967 (127.20.217.190:34755), 195c20c036cd49c4be4abc4869f7e664 (127.20.217.188:44291)
19:19:14.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:14.674490 21726 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.217.190:34755: connect: Connection refused (error 111)
19:19:14.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:14.683279 21725 leader_election.cc:334] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 195c20c036cd49c4be4abc4869f7e664 (127.20.217.188:44291): Network error: Client connection negotiation failed: client connection to 127.20.217.188:44291: connect: Connection refused (error 111)
19:19:14.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:14.684175 21726 leader_election.cc:334] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 182ce5514aa04757aaa67a23ad426967 (127.20.217.190:34755): Network error: Client connection negotiation failed: client connection to 127.20.217.190:34755: connect: Connection refused (error 111)
19:19:14.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:14.684727 21726 leader_election.cc:302] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b1b6d9b7da644fd5969818ed01d67ff5; no voters: 182ce5514aa04757aaa67a23ad426967, 195c20c036cd49c4be4abc4869f7e664
19:19:14.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:14.685789 21811 raft_consensus.cc:2726] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
19:19:15.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:13.820412 21805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:19:15.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:13.821544 21802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:19:15.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:15.211055 21804 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
19:19:15.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.211242 21781 server_base.cc:1029] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
19:19:15.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.215965 21781 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
19:19:15.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.219741 21781 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
19:19:15.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.221251 21781 hybrid_clock.cc:648] HybridClock initialized: now 1786216755221199 us; error 48 us; skew 500 ppm
19:19:15.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.222517 21781 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
19:19:15.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:15 dist-test-slave-77v9 krb5kdc[21361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216755, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.217.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
19:19:15.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.231415 21781 init.cc:377] Logged in from keytab as kudu/127.20.217.188@KRBTEST.COM (short username kudu)
19:19:15.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.238425 21781 webserver.cc:460] Webserver started at http://127.20.217.188:36961/ using document root <none> and password file <none>
19:19:15.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.239661 21781 fs_manager.cc:359] Metadata directory not provided
19:19:15.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.239964 21781 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
19:19:15.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.251299 21781 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.005s sys 0.003s
19:19:15.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.257383 21820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
19:19:15.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.258780 21781 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.000s sys 0.004s
19:19:15.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.259271 21781 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-2/data,/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-2/wal
19:19:15.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "195c20c036cd49c4be4abc4869f7e664"
19:19:15.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-08 19:19:07 on dist-test-slave-77v9"
19:19:15.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.262961 21781 fs_report.cc:383] FS layout report
19:19:15.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
19:19:15.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-2/wal
19:19:15.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-2/wal
19:19:15.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-2/data/data
19:19:15.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
19:19:15.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
19:19:15.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
19:19:15.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
19:19:15.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
19:19:15.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
19:19:15.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
19:19:15.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
19:19:15.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
19:19:15.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
19:19:15.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
19:19:15.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.328166 21781 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
19:19:15.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.334363 21781 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
19:19:15.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.334911 21781 kserver.cc:163] Server-wide thread pool size limit: 3276
19:19:15.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.453163 21781 rpc_server.cc:307] RPC server started. Bound to: 127.20.217.188:44291
19:19:15.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.453233 21874 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.217.188:44291 every 8 connection(s)
19:19:15.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.456472 21781 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-2/data/info.pb
19:19:15.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.457566 21350 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu as pid 21781
19:19:15.458 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response:
19:19:15.458 [INFO - Time-limited test] (MiniKuduCluster.java:380) Starting master server 127.20.217.190:34755
19:19:15.458 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: start_daemon {
id {
type: MASTER
index: 0
}
}
19:19:15.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.460599 21350 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu
19:19:15.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu
19:19:15.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-0/wal
19:19:15.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-0/data
19:19:15.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
19:19:15.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
19:19:15.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
19:19:15.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
19:19:15.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
19:19:15.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
19:19:15.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-0/logs
19:19:15.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-0/data/info.pb
19:19:15.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
19:19:15.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
19:19:15.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
19:19:15.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
19:19:15.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
19:19:15.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
19:19:15.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
19:19:15.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
19:19:15.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
19:19:15.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
19:19:15.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
19:19:15.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
19:19:15.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.217.190:34755
19:19:15.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.217.190
19:19:15.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=38129
19:19:15.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/kudu_127.20.217.190.keytab
19:19:15.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.20.217.190
19:19:15.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
19:19:15.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
19:19:15.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
19:19:15.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.217.148:42221
19:19:15.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
19:19:15.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
19:19:15.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
19:19:15.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
19:19:15.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.217.190:34755,127.20.217.189:33117,127.20.217.188:44291
19:19:15.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
19:19:15.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39227/jwks.json
19:19:15.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --authn_token_validity_seconds=10 with env {KRB5CCNAME=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
19:19:15.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.475304 21875 sys_catalog.cc:263] Verifying existing consensus state
19:19:15.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.485268 21875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664: Bootstrap starting.
19:19:15.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.542299 21875 log.cc:824] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664: Log is configured to *not* fsync() on all Append() calls
19:19:15.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.564195 21875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
19:19:15.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.565352 21875 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664: Bootstrap complete.
19:19:15.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.610698 21875 raft_consensus.cc:348] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } }
19:19:15.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.614943 21875 raft_consensus.cc:729] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 195c20c036cd49c4be4abc4869f7e664, State: Initialized, Role: FOLLOWER
19:19:15.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.616060 21875 consensus_queue.cc:260] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } }
19:19:15.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.619444 21879 sys_catalog.cc:455] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } } }
19:19:15.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.620713 21879 sys_catalog.cc:458] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [sys.catalog]: This master's current role is: FOLLOWER
19:19:15.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.622300 21875 sys_catalog.cc:564] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [sys.catalog]: configured and running, proceeding with master startup.
19:19:15.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.659060 21891 catalog_manager.cc:1259] Loaded cluster ID: 52603af8e27046f792abbb4a5443c049
19:19:15.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.659729 21891 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664: loading cluster ID for follower catalog manager: success
19:19:15.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.673007 21891 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664: acquiring CA information for follower catalog manager: success
19:19:15.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.681164 21891 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
19:19:15.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.668051 21781 master_runner.cc:186] Error getting master registration for 127.20.217.190:34755: Network error: Client connection negotiation failed: client connection to 127.20.217.190:34755: connect: Connection refused (error 111),
19:19:15.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.700057 21781 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
19:19:15.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:15.885582 21877 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
19:19:15.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:15.886175 21877 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
19:19:15.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:15.886940 21877 flags.cc:425] Enabled unsafe flag: --never_fsync=true
19:19:15.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:15.924773 21877 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=10
19:19:15.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:15.925174 21877 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
19:19:15.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:15.925643 21877 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
19:19:15.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:15.925994 21877 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
19:19:15.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:15.926311 21877 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
19:19:15.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:15.926645 21877 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
19:19:15.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:15.927026 21877 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:39227/jwks.json
19:19:15.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.968135 21877 master_runner.cc:386] Master server non-default flags:
19:19:15.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
19:19:15.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.20.217.148:42221
19:19:15.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
19:19:15.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
19:19:15.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-0/data
19:19:15.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-0/wal
19:19:15.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --authn_token_validity_seconds=10
19:19:15.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
19:19:15.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.20.217.190:34755,127.20.217.189:33117,127.20.217.188:44291
19:19:15.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/kudu_127.20.217.190.keytab
19:19:15.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.20.217.190
19:19:15.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
19:19:15.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
19:19:15.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
19:19:15.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.20.217.190:34755
19:19:15.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
19:19:15.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
19:19:15.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
19:19:15.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:39227/jwks.json
19:19:15.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
19:19:15.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
19:19:15.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
19:19:15.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
19:19:15.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
19:19:15.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-0/data/info.pb
19:19:15.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.20.217.190
19:19:15.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=38129
19:19:15.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
19:19:15.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
19:19:15.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
19:19:15.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
19:19:15.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
19:19:15.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-0/logs
19:19:15.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
19:19:15.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
19:19:15.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)
19:19:15.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
19:19:15.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
19:19:15.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
19:19:15.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
19:19:15.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 08 Aug 2026 17:52:48 UTC on ccycloud.quasar-oinjhi.root.comops.site
19:19:15.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4574925
19:19:15.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
19:19:15.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.969659 21877 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
19:19:15.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:15.970678 21877 file_cache.cc:493] Constructed file cache file cache with capacity 419430
19:19:15.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:15.992527 21903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:19:16.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.275981 21909 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
19:19:16.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.276891 21909 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } }
19:19:16.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.287225 21909 leader_election.cc:288] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 182ce5514aa04757aaa67a23ad426967 (127.20.217.190:34755), 195c20c036cd49c4be4abc4869f7e664 (127.20.217.188:44291)
19:19:16.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:16.300279 21726 leader_election.cc:334] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 182ce5514aa04757aaa67a23ad426967 (127.20.217.190:34755): Network error: Client connection negotiation failed: client connection to 127.20.217.190:34755: connect: Connection refused (error 111)
19:19:16.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.350811 21849 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "195c20c036cd49c4be4abc4869f7e664" is_pre_election: true
19:19:16.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.352375 21849 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b1b6d9b7da644fd5969818ed01d67ff5 in term 1.
19:19:16.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.355263 21725 leader_election.cc:302] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 195c20c036cd49c4be4abc4869f7e664, b1b6d9b7da644fd5969818ed01d67ff5; no voters: 182ce5514aa04757aaa67a23ad426967
19:19:16.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.357090 21909 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [term 1 FOLLOWER]: Leader pre-election won for term 2
19:19:16.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.357623 21909 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
19:19:16.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.358121 21909 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [term 1 FOLLOWER]: Advancing to term 2
19:19:16.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.374468 21909 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } }
19:19:16.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:16.383378 21726 leader_election.cc:334] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 182ce5514aa04757aaa67a23ad426967 (127.20.217.190:34755): Network error: Client connection negotiation failed: client connection to 127.20.217.190:34755: connect: Connection refused (error 111)
19:19:16.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.386806 21849 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "195c20c036cd49c4be4abc4869f7e664"
19:19:16.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.387447 21849 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [term 1 FOLLOWER]: Advancing to term 2
19:19:16.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.396994 21909 leader_election.cc:288] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [CANDIDATE]: Term 2 election: Requested vote from peers 182ce5514aa04757aaa67a23ad426967 (127.20.217.190:34755), 195c20c036cd49c4be4abc4869f7e664 (127.20.217.188:44291)
19:19:16.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.403766 21849 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b1b6d9b7da644fd5969818ed01d67ff5 in term 2.
19:19:16.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.407101 21725 leader_election.cc:302] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 195c20c036cd49c4be4abc4869f7e664, b1b6d9b7da644fd5969818ed01d67ff5; no voters: 182ce5514aa04757aaa67a23ad426967
19:19:16.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.409307 21909 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [term 2 FOLLOWER]: Leader election won for term 2
19:19:16.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.419061 21909 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [term 2 LEADER]: Becoming Leader. State: Replica: b1b6d9b7da644fd5969818ed01d67ff5, State: Running, Role: LEADER
19:19:16.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.421620 21909 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } }
19:19:16.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.461145 21915 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1b6d9b7da644fd5969818ed01d67ff5. Latest consensus state: current_term: 2 leader_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } } }
19:19:16.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.472175 21915 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [sys.catalog]: This master's current role is: LEADER
19:19:16.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.479817 21917 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
19:19:16.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.502789 21917 catalog_manager.cc:1484] Initializing Kudu cluster ID...
19:19:16.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.521090 21917 catalog_manager.cc:1259] Loaded cluster ID: 52603af8e27046f792abbb4a5443c049
19:19:16.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.521538 21917 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
19:19:16.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.529573 21917 catalog_manager.cc:1504] Loading token signing keys...
19:19:16.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.550681 21917 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5: Loaded TSK: 0
19:19:16.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.553153 21917 catalog_manager.cc:1514] Initializing in-progress tserver states...
19:19:16.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:16.819999 21726 consensus_peers.cc:487] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 -> Peer 182ce5514aa04757aaa67a23ad426967 (127.20.217.190:34755): Couldn't send request to peer 182ce5514aa04757aaa67a23ad426967. Status: Network error: Client connection negotiation failed: client connection to 127.20.217.190:34755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
19:19:16.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.860093 21849 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [term 2 FOLLOWER]: Refusing update from remote peer b1b6d9b7da644fd5969818ed01d67ff5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
19:19:16.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.864223 21915 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
19:19:16.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.923208 21915 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } } }
19:19:16.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.923992 21915 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [sys.catalog]: This master's current role is: LEADER
19:19:16.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.926901 21918 sys_catalog.cc:455] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1b6d9b7da644fd5969818ed01d67ff5. Latest consensus state: current_term: 2 leader_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } } }
19:19:16.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.929656 21918 sys_catalog.cc:458] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [sys.catalog]: This master's current role is: FOLLOWER
19:19:16.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.935714 21922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } } }
19:19:16.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:16.937156 21922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 195c20c036cd49c4be4abc4869f7e664 [sys.catalog]: This master's current role is: FOLLOWER
19:19:17.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:15.994577 21905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:19:17.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:16.005570 21902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
19:19:17.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:17.635816 21904 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
19:19:17.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:17.635936 21877 server_base.cc:1029] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
19:19:17.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:17.637296 21877 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
19:19:17.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:17.640021 21877 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
19:19:17.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:17.641398 21877 hybrid_clock.cc:648] HybridClock initialized: now 1786216757641360 us; error 67 us; skew 500 ppm
19:19:17.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:17.642490 21877 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
19:19:17.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:17 dist-test-slave-77v9 krb5kdc[21361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216757, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
19:19:17.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:17.649329 21877 init.cc:377] Logged in from keytab as kudu/127.20.217.190@KRBTEST.COM (short username kudu)
19:19:17.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:17.655475 21877 webserver.cc:460] Webserver started at http://127.20.217.190:38129/ using document root <none> and password file <none>
19:19:17.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:17.656766 21877 fs_manager.cc:359] Metadata directory not provided
19:19:17.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:17.657083 21877 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
19:19:17.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:17.669189 21877 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.002s sys 0.004s
19:19:17.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:17.675325 21931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
19:19:17.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:17.676707 21877 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
19:19:17.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:17.677264 21877 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-0/data,/tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-0/wal
19:19:17.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "182ce5514aa04757aaa67a23ad426967"
19:19:17.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-08 19:19:03 on dist-test-slave-77v9"
19:19:17.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:17.681013 21877 fs_report.cc:383] FS layout report
19:19:17.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
19:19:17.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-0/wal
19:19:17.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-0/wal
19:19:17.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-0/data/data
19:19:17.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
19:19:17.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
19:19:17.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
19:19:17.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
19:19:17.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
19:19:17.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
19:19:17.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
19:19:17.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
19:19:17.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
19:19:17.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
19:19:17.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
19:19:17.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:17.743400 21877 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
19:19:17.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:17.752033 21877 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
19:19:17.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:17.752677 21877 kserver.cc:163] Server-wide thread pool size limit: 3276
19:19:17.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:17.848754 21877 rpc_server.cc:307] RPC server started. Bound to: 127.20.217.190:34755
19:19:17.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:17.849025 21985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.217.190:34755 every 8 connection(s)
19:19:17.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:17.852177 21877 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/master-0/data/info.pb
19:19:17.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:17.862040 21350 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu as pid 21877
19:19:17.862 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response:
19:19:17.863 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.20.217.189:33117(127.20.217.189:33117)] connecting to peer
19:19:17.865 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.20.217.188:44291(127.20.217.188:44291)] connecting to peer
19:19:17.866 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.20.217.190:34755(127.20.217.190:34755)] connecting to peer
19:19:17.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:17.868084 21986 sys_catalog.cc:263] Verifying existing consensus state
19:19:17.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:17.877398 21986 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967: Bootstrap starting.
19:19:17.884 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.217.189:33117(127.20.217.189:33117)] Successfully connected to peer
19:19:17.892 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.217.190:34755(127.20.217.190:34755)] Successfully connected to peer
19:19:17.892 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.217.188:44291(127.20.217.188:44291)] Successfully connected to peer
19:19:17.898 [DEBUG - kudu-nio-1] (SecurityContext.java:225) Refreshing Kerberos credentials...
19:19:17.899 [DEBUG - kudu-nio-1] (SecurityUtil.java:105) Using ticketCache: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/krb5cc
19:19:17.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:17 dist-test-slave-77v9 krb5kdc[21361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216748, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
19:19:17.909 [DEBUG - kudu-nio-1] (SecurityUtil.java:119) Logged in as subject: test-user@KRBTEST.COM
19:19:17.918 [ERROR - kudu-nio-1] (SecurityContext.java:249) Attempted to refresh Kerberos credentials from ticket cache but found that the new Kerberos principal test-user@KRBTEST.COM did not match the original principal test-admin@KRBTEST.COM. Ignoring.
19:19:17.920 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism GSSAPI chosen for peer 127.20.217.189
19:19:17.925 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism GSSAPI chosen for peer 127.20.217.190
19:19:17.929 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism GSSAPI chosen for peer 127.20.217.188
19:19:17.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:17.965008 21986 log.cc:824] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967: Log is configured to *not* fsync() on all Append() calls
19:19:17.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:17.995777 21986 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
19:19:17.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:17.998862 21986 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967: Bootstrap complete.
19:19:18.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:18 dist-test-slave-77v9 krb5kdc[21361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216748, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.217.190@KRBTEST.COM
19:19:18.009 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.217.188:44291(127.20.217.188:44291)] cleaning up while in state NEGOTIATING due to: Server requires Kerberos, but this client is not authenticated (missing or expired TGT)
19:19:18.010 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.188:44291: Server requires Kerberos, but this client is not authenticated (missing or expired TGT)
19:19:18.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:18.013985 21991 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:18.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:17.875028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32832 (local address 127.20.217.188:44291)
19:19:18.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:17.885499 (+ 10471us) server_negotiation.cc:206] Beginning negotiation
19:19:18.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:17.885528 (+ 29us) server_negotiation.cc:399] Waiting for connection header
19:19:18.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:17.893598 (+ 8070us) server_negotiation.cc:407] Connection header received
19:19:18.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:17.894821 (+ 1223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:18.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:17.894853 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:18.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:17.895267 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:18.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:17.895508 (+ 241us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:18.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:17.933765 (+ 38257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
19:19:18.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:17.935725 (+ 1960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
19:19:18.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:17.993541 (+ 57816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
19:19:18.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:17.994691 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
19:19:18.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:17.995008 (+ 317us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
19:19:18.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.011546 (+ 16538us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32832: BlockingRecv error: failed to read from TLS socket (remote: 127.0.0.1:32832): Cannot send after transport endpoint shutdown (error 108)
19:19:18.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":10002,"thread_start_us":10430,"threads_started":1}
19:19:18.017 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.217.189:33117(127.20.217.189:33117)] cleaning up while in state NEGOTIATING due to: Server requires Kerberos, but this client is not authenticated (missing or expired TGT)
19:19:18.018 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.217.188:44291(127.20.217.188:44291)] handling channelInactive
19:19:18.018 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.189:33117: Server requires Kerberos, but this client is not authenticated (missing or expired TGT)
19:19:18.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:18.022575 21992 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:18.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:17.875205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52934 (local address 127.20.217.189:33117)
19:19:18.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:17.886838 (+ 11633us) server_negotiation.cc:206] Beginning negotiation
19:19:18.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:17.886871 (+ 33us) server_negotiation.cc:399] Waiting for connection header
19:19:18.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:17.886933 (+ 62us) server_negotiation.cc:407] Connection header received
19:19:18.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:17.887836 (+ 903us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:18.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:17.887872 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:18.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:17.888243 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:18.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:17.888939 (+ 696us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:18.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:17.924418 (+ 35479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
19:19:18.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:17.926227 (+ 1809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
19:19:18.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:17.952987 (+ 26760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
19:19:18.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:17.954111 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
19:19:18.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:17.954424 (+ 313us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
19:19:18.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.020794 (+ 66370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52934: BlockingRecv error: failed to read from TLS socket (remote: 127.0.0.1:52934): Cannot send after transport endpoint shutdown (error 108)
19:19:18.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":11138,"thread_start_us":10808,"threads_started":1}
19:19:18.023 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.217.189:33117(127.20.217.189:33117)] handling channelInactive
19:19:18.030 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xb6d1dcd8, L:/127.0.0.1:56000 - R:/127.20.217.190:34755] using SASL/GSSAPI
19:19:18.040 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.190:34755: Catalog manager is not initialized. State: Starting
19:19:18.041 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755; will retry
19:19:18.045 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.189:33117(127.20.217.189:33117)] connecting to peer
19:19:18.046 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.188:44291(127.20.217.188:44291)] connecting to peer
19:19:18.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:18.045315 21986 raft_consensus.cc:348] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } }
19:19:18.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:18.049127 21986 raft_consensus.cc:729] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 182ce5514aa04757aaa67a23ad426967, State: Initialized, Role: FOLLOWER
19:19:18.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:18.050202 21986 consensus_queue.cc:260] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } }
19:19:18.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:18.056260 21986 sys_catalog.cc:564] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967 [sys.catalog]: configured and running, proceeding with master startup.
19:19:18.058 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.217.189:33117(127.20.217.189:33117)] Successfully connected to peer
19:19:18.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:18.060333 21996 sys_catalog.cc:455] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } } }
19:19:18.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:18.061408 21996 sys_catalog.cc:458] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967 [sys.catalog]: This master's current role is: FOLLOWER
19:19:18.063 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.190:34755: Catalog manager is not initialized. State: Starting
19:19:18.063 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.217.188:44291(127.20.217.188:44291)] Successfully connected to peer
19:19:18.064 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.217.189:33117(127.20.217.189:33117)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.064 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.189:33117: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.065 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.217.189:33117(127.20.217.189:33117)] handling channelInactive
19:19:18.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:18.067782 21992 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:18.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.048346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52946 (local address 127.20.217.189:33117)
19:19:18.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.048958 (+ 612us) server_negotiation.cc:206] Beginning negotiation
19:19:18.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.048985 (+ 27us) server_negotiation.cc:399] Waiting for connection header
19:19:18.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.059261 (+ 10276us) server_negotiation.cc:407] Connection header received
19:19:18.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.061338 (+ 2077us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:18.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.061377 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:18.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.061684 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:18.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.061886 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:18.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.066488 (+ 4602us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52946: BlockingRecv error: recv got EOF from 127.0.0.1:52946 (error 108)
19:19:18.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":145}
19:19:18.069 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.217.188:44291(127.20.217.188:44291)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.071 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.188:44291: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.071 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755; will retry
19:19:18.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:18.073321 21991 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:18.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.059262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32834 (local address 127.20.217.188:44291)
19:19:18.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.059868 (+ 606us) server_negotiation.cc:206] Beginning negotiation
19:19:18.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.059904 (+ 36us) server_negotiation.cc:399] Waiting for connection header
19:19:18.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.064609 (+ 4705us) server_negotiation.cc:407] Connection header received
19:19:18.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.064825 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:18.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.064866 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:18.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.065190 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:18.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.065418 (+ 228us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:18.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.072324 (+ 6906us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32834: BlockingRecv error: recv got EOF from 127.0.0.1:32834 (error 108)
19:19:18.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":84}
19:19:18.074 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.217.188:44291(127.20.217.188:44291)] handling channelInactive
19:19:18.084 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.189:33117(127.20.217.189:33117)] connecting to peer
19:19:18.087 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.188:44291(127.20.217.188:44291)] connecting to peer
19:19:18.089 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.217.189:33117(127.20.217.189:33117)] Successfully connected to peer
19:19:18.092 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.217.189:33117(127.20.217.189:33117)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.094 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.190:34755: Catalog manager is not initialized. State: Starting
19:19:18.094 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.217.188:44291(127.20.217.188:44291)] Successfully connected to peer
19:19:18.095 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.189:33117: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.096 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.217.189:33117(127.20.217.189:33117)] handling channelInactive
19:19:18.098 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.217.188:44291(127.20.217.188:44291)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.098 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.188:44291: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.098 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755; will retry
19:19:18.099 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.217.188:44291(127.20.217.188:44291)] handling channelInactive
19:19:18.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:18.097864 21992 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:18.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.087888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52950 (local address 127.20.217.189:33117)
19:19:18.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.088822 (+ 934us) server_negotiation.cc:206] Beginning negotiation
19:19:18.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.088861 (+ 39us) server_negotiation.cc:399] Waiting for connection header
19:19:18.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.089745 (+ 884us) server_negotiation.cc:407] Connection header received
19:19:18.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.090241 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:18.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.090302 (+ 61us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:18.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.090604 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:18.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.090821 (+ 217us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:18.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.096791 (+ 5970us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52950: BlockingRecv error: recv got EOF from 127.0.0.1:52950 (error 108)
19:19:18.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":297}
19:19:18.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:18.101238 21991 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:18.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.093016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32840 (local address 127.20.217.188:44291)
19:19:18.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.093604 (+ 588us) server_negotiation.cc:206] Beginning negotiation
19:19:18.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.093637 (+ 33us) server_negotiation.cc:399] Waiting for connection header
19:19:18.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.095185 (+ 1548us) server_negotiation.cc:407] Connection header received
19:19:18.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.095560 (+ 375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:18.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.095592 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:18.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.095821 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:18.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.096036 (+ 215us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:18.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.100100 (+ 4064us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32840: BlockingRecv error: recv got EOF from 127.0.0.1:32840 (error 108)
19:19:18.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":144}
19:19:18.103 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.189:33117(127.20.217.189:33117)] connecting to peer
19:19:18.104 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.188:44291(127.20.217.188:44291)] connecting to peer
19:19:18.108 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.217.189:33117(127.20.217.189:33117)] Successfully connected to peer
19:19:18.117 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.217.189:33117(127.20.217.189:33117)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.118 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.189:33117: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:18.119863 21992 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:18.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.108730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52956 (local address 127.20.217.189:33117)
19:19:18.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.109614 (+ 884us) server_negotiation.cc:206] Beginning negotiation
19:19:18.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.109661 (+ 47us) server_negotiation.cc:399] Waiting for connection header
19:19:18.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.113490 (+ 3829us) server_negotiation.cc:407] Connection header received
19:19:18.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.115712 (+ 2222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:18.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.115743 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:18.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.115990 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:18.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.116143 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:18.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.118884 (+ 2741us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52956: BlockingRecv error: recv got EOF from 127.0.0.1:52956 (error 108)
19:19:18.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":204}
19:19:18.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:18.117846 22007 catalog_manager.cc:1259] Loaded cluster ID: 52603af8e27046f792abbb4a5443c049
19:19:18.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:18.121003 22007 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967: loading cluster ID for follower catalog manager: success
19:19:18.123 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.217.188:44291(127.20.217.188:44291)] Successfully connected to peer
19:19:18.126 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.217.189:33117(127.20.217.189:33117)] handling channelInactive
19:19:18.127 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.217.188:44291(127.20.217.188:44291)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.127 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.188:44291: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.128 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755; will retry
19:19:18.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:18 dist-test-slave-77v9 krb5kdc[21361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216757, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.217.190@KRBTEST.COM for kudu/127.20.217.190@KRBTEST.COM
19:19:18.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:18.129868 21991 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:18.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.114403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32846 (local address 127.20.217.188:44291)
19:19:18.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.115094 (+ 691us) server_negotiation.cc:206] Beginning negotiation
19:19:18.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.115116 (+ 22us) server_negotiation.cc:399] Waiting for connection header
19:19:18.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.125510 (+ 10394us) server_negotiation.cc:407] Connection header received
19:19:18.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.125670 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:18.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.125695 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:18.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.125944 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:18.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.126117 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:18.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.128911 (+ 2794us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32846: BlockingRecv error: recv got EOF from 127.0.0.1:32846 (error 108)
19:19:18.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":134}
19:19:18.130 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.217.188:44291(127.20.217.188:44291)] handling channelInactive
19:19:18.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:18.133248 22007 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967: acquiring CA information for follower catalog manager: success
19:19:18.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:18.140442 22007 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
19:19:18.144 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.189:33117(127.20.217.189:33117)] connecting to peer
19:19:18.145 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.188:44291(127.20.217.188:44291)] connecting to peer
19:19:18.155 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.217.189:33117(127.20.217.189:33117)] Successfully connected to peer
19:19:18.162 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.217.189:33117(127.20.217.189:33117)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.163 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.189:33117: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:18.165782 21992 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:18.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.154068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52960 (local address 127.20.217.189:33117)
19:19:18.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.154620 (+ 552us) server_negotiation.cc:206] Beginning negotiation
19:19:18.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.154646 (+ 26us) server_negotiation.cc:399] Waiting for connection header
19:19:18.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.155377 (+ 731us) server_negotiation.cc:407] Connection header received
19:19:18.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.158469 (+ 3092us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:18.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.158499 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:18.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.158734 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:18.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.158901 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:18.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.163905 (+ 5004us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52960: BlockingRecv error: recv got EOF from 127.0.0.1:52960 (error 108)
19:19:18.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":141}
19:19:18.178 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.217.189:33117(127.20.217.189:33117)] handling channelInactive
19:19:18.179 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.217.188:44291(127.20.217.188:44291)] Successfully connected to peer
19:19:18.188 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.217.188:44291(127.20.217.188:44291)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.188 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.188:44291: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.189 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755; will retry
19:19:18.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:18.191912 21991 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:18.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.174071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32854 (local address 127.20.217.188:44291)
19:19:18.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.174580 (+ 509us) server_negotiation.cc:206] Beginning negotiation
19:19:18.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.174606 (+ 26us) server_negotiation.cc:399] Waiting for connection header
19:19:18.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.179631 (+ 5025us) server_negotiation.cc:407] Connection header received
19:19:18.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.180493 (+ 862us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:18.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.180521 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:18.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.181680 (+ 1159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:18.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.182503 (+ 823us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:18.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.190692 (+ 8189us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32854: BlockingRecv error: recv got EOF from 127.0.0.1:32854 (error 108)
19:19:18.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":132}
19:19:18.193 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.217.188:44291(127.20.217.188:44291)] handling channelInactive
19:19:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:18.212275 21960 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967 [term 1 FOLLOWER]: Advancing to term 2
19:19:18.225 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.189:33117(127.20.217.189:33117)] connecting to peer
19:19:18.226 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.188:44291(127.20.217.188:44291)] connecting to peer
19:19:18.232 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.217.189:33117(127.20.217.189:33117)] Successfully connected to peer
19:19:18.233 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.217.188:44291(127.20.217.188:44291)] Successfully connected to peer
19:19:18.242 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.217.189:33117(127.20.217.189:33117)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.242 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.189:33117: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.242 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.217.189:33117(127.20.217.189:33117)] handling channelInactive
19:19:18.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:18.248797 21992 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:18.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.229275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52986 (local address 127.20.217.189:33117)
19:19:18.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.229772 (+ 497us) server_negotiation.cc:206] Beginning negotiation
19:19:18.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.229798 (+ 26us) server_negotiation.cc:399] Waiting for connection header
19:19:18.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.240006 (+ 10208us) server_negotiation.cc:407] Connection header received
19:19:18.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.240181 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:18.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.240208 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:18.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.240450 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:18.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.244455 (+ 4005us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:18.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.247852 (+ 3397us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52986: BlockingRecv error: recv got EOF from 127.0.0.1:52986 (error 108)
19:19:18.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":87}
19:19:18.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:18.269008 21996 sys_catalog.cc:455] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1b6d9b7da644fd5969818ed01d67ff5. Latest consensus state: current_term: 2 leader_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } } }
19:19:18.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:18.269754 21996 sys_catalog.cc:458] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967 [sys.catalog]: This master's current role is: FOLLOWER
19:19:18.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:18.272431 22014 sys_catalog.cc:455] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } } }
19:19:18.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:18.273264 22014 sys_catalog.cc:458] T 00000000000000000000000000000000 P 182ce5514aa04757aaa67a23ad426967 [sys.catalog]: This master's current role is: FOLLOWER
19:19:18.281 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.217.188:44291(127.20.217.188:44291)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.281 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.188:44291: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.282 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755; will retry
19:19:18.282 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.217.188:44291(127.20.217.188:44291)] handling channelInactive
19:19:18.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:18.300365 22011 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:18.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.230448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32870 (local address 127.20.217.188:44291)
19:19:18.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.273690 (+ 43242us) server_negotiation.cc:206] Beginning negotiation
19:19:18.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.273715 (+ 25us) server_negotiation.cc:399] Waiting for connection header
19:19:18.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.273766 (+ 51us) server_negotiation.cc:407] Connection header received
19:19:18.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.277098 (+ 3332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:18.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.277125 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:18.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.277362 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:18.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.282813 (+ 5451us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:18.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.296147 (+ 13334us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32870: BlockingRecv error: recv got EOF from 127.0.0.1:32870 (error 108)
19:19:18.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":42416,"thread_start_us":40790,"threads_started":1}
19:19:18.344 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.189:33117(127.20.217.189:33117)] connecting to peer
19:19:18.345 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.188:44291(127.20.217.188:44291)] connecting to peer
19:19:18.352 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.217.189:33117(127.20.217.189:33117)] Successfully connected to peer
19:19:18.355 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.217.188:44291(127.20.217.188:44291)] Successfully connected to peer
19:19:18.358 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.217.189:33117(127.20.217.189:33117)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.358 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.189:33117: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.358 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.217.189:33117(127.20.217.189:33117)] handling channelInactive
19:19:18.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:18.360580 21992 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:18.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.347712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53000 (local address 127.20.217.189:33117)
19:19:18.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.348536 (+ 824us) server_negotiation.cc:206] Beginning negotiation
19:19:18.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.348562 (+ 26us) server_negotiation.cc:399] Waiting for connection header
19:19:18.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.352839 (+ 4277us) server_negotiation.cc:407] Connection header received
19:19:18.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.353003 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:18.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.353037 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:18.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.353260 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:18.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.353426 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:18.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.359592 (+ 6166us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53000: BlockingRecv error: recv got EOF from 127.0.0.1:53000 (error 108)
19:19:18.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":388}
19:19:18.361 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.217.188:44291(127.20.217.188:44291)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.362 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.188:44291: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.362 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755; will retry
19:19:18.362 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.217.188:44291(127.20.217.188:44291)] handling channelInactive
19:19:18.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:18.364513 22011 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:18.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.351011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32880 (local address 127.20.217.188:44291)
19:19:18.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.351530 (+ 519us) server_negotiation.cc:206] Beginning negotiation
19:19:18.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.351556 (+ 26us) server_negotiation.cc:399] Waiting for connection header
19:19:18.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.356103 (+ 4547us) server_negotiation.cc:407] Connection header received
19:19:18.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.356259 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:18.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.356285 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:18.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.356529 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:18.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.356712 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:18.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.363566 (+ 6854us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32880: BlockingRecv error: recv got EOF from 127.0.0.1:32880 (error 108)
19:19:18.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":122}
19:19:18.464 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.189:33117(127.20.217.189:33117)] connecting to peer
19:19:18.465 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.188:44291(127.20.217.188:44291)] connecting to peer
19:19:18.469 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.217.189:33117(127.20.217.189:33117)] Successfully connected to peer
19:19:18.470 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.217.188:44291(127.20.217.188:44291)] Successfully connected to peer
19:19:18.475 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.217.188:44291(127.20.217.188:44291)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.475 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.188:44291: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.476 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.217.188:44291(127.20.217.188:44291)] handling channelInactive
19:19:18.477 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.217.189:33117(127.20.217.189:33117)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.477 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.189:33117: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.477 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755; will retry
19:19:18.478 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.217.189:33117(127.20.217.189:33117)] handling channelInactive
19:19:18.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:18.480146 21992 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:18.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.468302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53010 (local address 127.20.217.189:33117)
19:19:18.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.468990 (+ 688us) server_negotiation.cc:206] Beginning negotiation
19:19:18.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.469016 (+ 26us) server_negotiation.cc:399] Waiting for connection header
19:19:18.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.472877 (+ 3861us) server_negotiation.cc:407] Connection header received
19:19:18.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.473029 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:18.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.473057 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:18.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.473315 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:18.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.473504 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:18.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.479082 (+ 5578us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53010: BlockingRecv error: recv got EOF from 127.0.0.1:53010 (error 108)
19:19:18.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":235}
19:19:18.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:18.482929 22011 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:18.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.469925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32884 (local address 127.20.217.188:44291)
19:19:18.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.471858 (+ 1933us) server_negotiation.cc:206] Beginning negotiation
19:19:18.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.471884 (+ 26us) server_negotiation.cc:399] Waiting for connection header
19:19:18.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.471931 (+ 47us) server_negotiation.cc:407] Connection header received
19:19:18.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.472065 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:18.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.472091 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:18.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.472304 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:18.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.472484 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:18.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.476778 (+ 4294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32884: BlockingRecv error: recv got EOF from 127.0.0.1:32884 (error 108)
19:19:18.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":1522}
19:19:18.604 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.189:33117(127.20.217.189:33117)] connecting to peer
19:19:18.605 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.188:44291(127.20.217.188:44291)] connecting to peer
19:19:18.607 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.217.189:33117(127.20.217.189:33117)] Successfully connected to peer
19:19:18.609 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.217.188:44291(127.20.217.188:44291)] Successfully connected to peer
19:19:18.612 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.217.189:33117(127.20.217.189:33117)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.613 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.217.188:44291(127.20.217.188:44291)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.613 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.189:33117: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.613 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.188:44291: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.614 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755; will retry
19:19:18.614 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.217.188:44291(127.20.217.188:44291)] handling channelInactive
19:19:18.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:18.615312 21992 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:18.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.606596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53032 (local address 127.20.217.189:33117)
19:19:18.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.607167 (+ 571us) server_negotiation.cc:206] Beginning negotiation
19:19:18.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.607193 (+ 26us) server_negotiation.cc:399] Waiting for connection header
19:19:18.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.608323 (+ 1130us) server_negotiation.cc:407] Connection header received
19:19:18.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.608498 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:18.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.608525 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:18.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.608755 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:18.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.609682 (+ 927us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:18.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.614308 (+ 4626us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53032: BlockingRecv error: recv got EOF from 127.0.0.1:53032 (error 108)
19:19:18.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":133}
19:19:18.613 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.217.189:33117(127.20.217.189:33117)] handling channelInactive
19:19:18.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:18.616361 22011 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:18.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.609573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32900 (local address 127.20.217.188:44291)
19:19:18.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.610445 (+ 872us) server_negotiation.cc:206] Beginning negotiation
19:19:18.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.610472 (+ 27us) server_negotiation.cc:399] Waiting for connection header
19:19:18.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.610517 (+ 45us) server_negotiation.cc:407] Connection header received
19:19:18.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.610655 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:18.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.610686 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:18.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.610904 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:18.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.611071 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:18.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.615372 (+ 4301us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:32900: BlockingRecv error: recv got EOF from 127.0.0.1:32900 (error 108)
19:19:18.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":437}
19:19:18.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:18.808454 21909 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ce5514aa04757aaa67a23ad426967" member_type: VOTER last_known_addr { host: "127.20.217.190" port: 34755 } } peers { permanent_uuid: "b1b6d9b7da644fd5969818ed01d67ff5" member_type: VOTER last_known_addr { host: "127.20.217.189" port: 33117 } } peers { permanent_uuid: "195c20c036cd49c4be4abc4869f7e664" member_type: VOTER last_known_addr { host: "127.20.217.188" port: 44291 } } }
19:19:18.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:18.809692 21909 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1b6d9b7da644fd5969818ed01d67ff5 [sys.catalog]: This master's current role is: LEADER
19:19:18.984 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.189:33117(127.20.217.189:33117)] connecting to peer
19:19:18.985 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.188:44291(127.20.217.188:44291)] connecting to peer
19:19:18.986 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.217.189:33117(127.20.217.189:33117)] Successfully connected to peer
19:19:18.989 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.217.189:33117(127.20.217.189:33117)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.989 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.189:33117: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.989 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.217.189:33117(127.20.217.189:33117)] handling channelInactive
19:19:18.991 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.217.188:44291(127.20.217.188:44291)] Successfully connected to peer
19:19:18.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:18.991195 21992 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:18.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.985956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34022 (local address 127.20.217.189:33117)
19:19:18.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.986475 (+ 519us) server_negotiation.cc:206] Beginning negotiation
19:19:18.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.986501 (+ 26us) server_negotiation.cc:399] Waiting for connection header
19:19:18.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.987434 (+ 933us) server_negotiation.cc:407] Connection header received
19:19:18.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.987603 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:18.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.987631 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:18.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.987867 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:18.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.988064 (+ 197us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:18.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.990254 (+ 2190us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34022: BlockingRecv error: recv got EOF from 127.0.0.1:34022 (error 108)
19:19:18.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":100}
19:19:18.992 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.217.188:44291(127.20.217.188:44291)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.993 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.188:44291: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:18.993 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755; will retry
19:19:18.993 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.217.188:44291(127.20.217.188:44291)] handling channelInactive
19:19:18.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:18.994627 22011 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:18.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.990348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51440 (local address 127.20.217.188:44291)
19:19:18.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.990931 (+ 583us) server_negotiation.cc:206] Beginning negotiation
19:19:18.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.990958 (+ 27us) server_negotiation.cc:399] Waiting for connection header
19:19:18.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.991747 (+ 789us) server_negotiation.cc:407] Connection header received
19:19:18.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.991898 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:18.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.991937 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:18.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.992162 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:18.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.992348 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:18.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:18.993928 (+ 1580us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51440: BlockingRecv error: recv got EOF from 127.0.0.1:51440 (error 108)
19:19:18.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":162}
19:19:19.764 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.189:33117(127.20.217.189:33117)] connecting to peer
19:19:19.765 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.188:44291(127.20.217.188:44291)] connecting to peer
19:19:19.770 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.217.188:44291(127.20.217.188:44291)] Successfully connected to peer
19:19:19.771 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.217.189:33117(127.20.217.189:33117)] Successfully connected to peer
19:19:19.771 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.217.188:44291(127.20.217.188:44291)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:19.772 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.188:44291: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:19.772 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.217.188:44291(127.20.217.188:44291)] handling channelInactive
19:19:19.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:19.774670 22022 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:19.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:19.768499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51444 (local address 127.20.217.188:44291)
19:19:19.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:19.770748 (+ 2249us) server_negotiation.cc:206] Beginning negotiation
19:19:19.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:19.770772 (+ 24us) server_negotiation.cc:399] Waiting for connection header
19:19:19.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:19.770812 (+ 40us) server_negotiation.cc:407] Connection header received
19:19:19.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:19.770929 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:19.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:19.770947 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:19.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:19.771120 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:19.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:19.771334 (+ 214us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:19.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:19.773178 (+ 1844us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51444: BlockingRecv error: recv got EOF from 127.0.0.1:51444 (error 108)
19:19:19.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":1838,"thread_start_us":3310,"threads_started":1}
19:19:19.776 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.217.189:33117(127.20.217.189:33117)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:19.776 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.189:33117: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:19.776 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755; will retry
19:19:19.777 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.217.189:33117(127.20.217.189:33117)] handling channelInactive
19:19:19.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:19.778849 22021 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:19.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:19.767045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34028 (local address 127.20.217.189:33117)
19:19:19.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:19.769536 (+ 2491us) server_negotiation.cc:206] Beginning negotiation
19:19:19.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:19.769559 (+ 23us) server_negotiation.cc:399] Waiting for connection header
19:19:19.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:19.774877 (+ 5318us) server_negotiation.cc:407] Connection header received
19:19:19.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:19.775046 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:19.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:19.775074 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:19.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:19.775293 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:19.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:19.776962 (+ 1669us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:19.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:19.777799 (+ 837us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34028: BlockingRecv error: recv got EOF from 127.0.0.1:34028 (error 108)
19:19:19.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":1982,"thread_start_us":1710,"threads_started":1}
19:19:21.764 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.189:33117(127.20.217.189:33117)] connecting to peer
19:19:21.766 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.188:44291(127.20.217.188:44291)] connecting to peer
19:19:21.767 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.217.189:33117(127.20.217.189:33117)] Successfully connected to peer
19:19:21.768 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.217.188:44291(127.20.217.188:44291)] Successfully connected to peer
19:19:21.771 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.217.188:44291(127.20.217.188:44291)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:21.771 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.188:44291: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:21.772 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.217.188:44291(127.20.217.188:44291)] handling channelInactive
19:19:21.774 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.217.189:33117(127.20.217.189:33117)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:21.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:21.773666 22031 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:21.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:21.768302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51456 (local address 127.20.217.188:44291)
19:19:21.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:21.770321 (+ 2019us) server_negotiation.cc:206] Beginning negotiation
19:19:21.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:21.770338 (+ 17us) server_negotiation.cc:399] Waiting for connection header
19:19:21.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:21.770378 (+ 40us) server_negotiation.cc:407] Connection header received
19:19:21.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:21.770503 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:21.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:21.770561 (+ 58us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:21.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:21.770764 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:21.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:21.770972 (+ 208us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:21.774 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.189:33117: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:21.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:21.772428 (+ 1456us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51456: BlockingRecv error: recv got EOF from 127.0.0.1:51456 (error 108)
19:19:21.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":1676,"thread_start_us":1394,"threads_started":1}
19:19:21.774 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755; will retry
19:19:21.775 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.217.189:33117(127.20.217.189:33117)] handling channelInactive
19:19:21.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:21.776492 22030 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:21.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:21.767363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34034 (local address 127.20.217.189:33117)
19:19:21.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:21.772563 (+ 5200us) server_negotiation.cc:206] Beginning negotiation
19:19:21.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:21.772595 (+ 32us) server_negotiation.cc:399] Waiting for connection header
19:19:21.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:21.772664 (+ 69us) server_negotiation.cc:407] Connection header received
19:19:21.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:21.773046 (+ 382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:21.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:21.773067 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:21.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:21.773363 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:21.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:21.773610 (+ 247us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:21.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:21.775445 (+ 1835us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34034: BlockingRecv error: recv got EOF from 127.0.0.1:34034 (error 108)
19:19:21.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":4589,"thread_start_us":4146,"threads_started":1}
19:19:22.943 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.189:33117(127.20.217.189:33117)] connecting to peer
19:19:22.945 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.188:44291(127.20.217.188:44291)] connecting to peer
19:19:22.946 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.217.189:33117(127.20.217.189:33117)] Successfully connected to peer
19:19:22.947 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.217.188:44291(127.20.217.188:44291)] Successfully connected to peer
19:19:22.949 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.217.189:33117(127.20.217.189:33117)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:22.950 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.189:33117: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:22.950 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.217.189:33117(127.20.217.189:33117)] handling channelInactive
19:19:22.951 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.217.188:44291(127.20.217.188:44291)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:22.951 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.188:44291: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:22.951 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755; will retry
19:19:22.952 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.217.188:44291(127.20.217.188:44291)] handling channelInactive
19:19:22.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:22.951947 22033 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:22.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:22.946416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34040 (local address 127.20.217.189:33117)
19:19:22.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:22.948024 (+ 1608us) server_negotiation.cc:206] Beginning negotiation
19:19:22.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:22.948042 (+ 18us) server_negotiation.cc:399] Waiting for connection header
19:19:22.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:22.948115 (+ 73us) server_negotiation.cc:407] Connection header received
19:19:22.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:22.948297 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:22.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:22.948327 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:22.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:22.948597 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:22.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:22.949663 (+ 1066us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:22.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:22.950888 (+ 1225us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34040: BlockingRecv error: recv got EOF from 127.0.0.1:34040 (error 108)
19:19:22.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":1100,"thread_start_us":764,"threads_started":1}
19:19:22.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:22.953501 22034 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:22.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:22.948157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51468 (local address 127.20.217.188:44291)
19:19:22.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:22.950042 (+ 1885us) server_negotiation.cc:206] Beginning negotiation
19:19:22.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:22.950062 (+ 20us) server_negotiation.cc:399] Waiting for connection header
19:19:22.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:22.950111 (+ 49us) server_negotiation.cc:407] Connection header received
19:19:22.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:22.950257 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:22.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:22.950282 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:22.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:22.950516 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:22.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:22.951718 (+ 1202us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:22.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:22.952456 (+ 738us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51468: BlockingRecv error: recv got EOF from 127.0.0.1:51468 (error 108)
19:19:22.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":1460,"thread_start_us":1199,"threads_started":1}
19:19:23.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:23 dist-test-slave-77v9 krb5kdc[21361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216763, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.217.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
19:19:23.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:23.114045 21718 init.cc:295] Successfully reacquired a new kerberos TGT
19:19:24.903 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.189:33117(127.20.217.189:33117)] connecting to peer
19:19:24.904 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.188:44291(127.20.217.188:44291)] connecting to peer
19:19:24.905 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.217.189:33117(127.20.217.189:33117)] Successfully connected to peer
19:19:24.909 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.217.188:44291(127.20.217.188:44291)] Successfully connected to peer
19:19:24.910 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.217.189:33117(127.20.217.189:33117)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:24.910 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.189:33117: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:24.911 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.217.189:33117(127.20.217.189:33117)] handling channelInactive
19:19:24.911 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.217.188:44291(127.20.217.188:44291)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:24.911 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.188:44291: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:24.911 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755; will retry
19:19:24.912 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.217.188:44291(127.20.217.188:44291)] handling channelInactive
19:19:24.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:24.913044 22036 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:24.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:24.905942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34048 (local address 127.20.217.189:33117)
19:19:24.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:24.907520 (+ 1578us) server_negotiation.cc:206] Beginning negotiation
19:19:24.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:24.907544 (+ 24us) server_negotiation.cc:399] Waiting for connection header
19:19:24.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:24.907609 (+ 65us) server_negotiation.cc:407] Connection header received
19:19:24.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:24.907896 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:24.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:24.907926 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:24.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:24.908192 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:24.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:24.908781 (+ 589us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:24.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:24.911754 (+ 2973us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34048: BlockingRecv error: recv got EOF from 127.0.0.1:34048 (error 108)
19:19:24.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":1086,"thread_start_us":715,"threads_started":1}
19:19:24.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:24.913987 22037 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:24.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:24.908203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51470 (local address 127.20.217.188:44291)
19:19:24.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:24.910073 (+ 1870us) server_negotiation.cc:206] Beginning negotiation
19:19:24.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:24.910109 (+ 36us) server_negotiation.cc:399] Waiting for connection header
19:19:24.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:24.910183 (+ 74us) server_negotiation.cc:407] Connection header received
19:19:24.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:24.910423 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:24.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:24.910449 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:24.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:24.910716 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:24.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:24.910972 (+ 256us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:24.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:24.912656 (+ 1684us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51470: BlockingRecv error: recv got EOF from 127.0.0.1:51470 (error 108)
19:19:24.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":1248,"thread_start_us":1339,"threads_started":1}
19:19:25.204 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.189:33117(127.20.217.189:33117)] connecting to peer
19:19:25.205 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.188:44291(127.20.217.188:44291)] connecting to peer
19:19:25.206 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.217.189:33117(127.20.217.189:33117)] Successfully connected to peer
19:19:25.208 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.217.189:33117(127.20.217.189:33117)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:25.208 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.189:33117: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:25.209 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.217.188:44291(127.20.217.188:44291)] Successfully connected to peer
19:19:25.210 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.217.189:33117(127.20.217.189:33117)] handling channelInactive
19:19:25.212 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.217.188:44291(127.20.217.188:44291)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:25.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:25.211869 22036 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:25.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:25.205851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34050 (local address 127.20.217.189:33117)
19:19:25.212 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.188:44291: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:25.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:25.206418 (+ 567us) server_negotiation.cc:206] Beginning negotiation
19:19:25.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:25.206464 (+ 46us) server_negotiation.cc:399] Waiting for connection header
19:19:25.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:25.207143 (+ 679us) server_negotiation.cc:407] Connection header received
19:19:25.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:25.207339 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:25.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:25.207370 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:25.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:25.207628 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:25.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:25.208963 (+ 1335us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:25.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:25.210886 (+ 1923us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34050: BlockingRecv error: recv got EOF from 127.0.0.1:34050 (error 108)
19:19:25.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":100}
19:19:25.212 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755; will retry
19:19:25.213 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.217.188:44291(127.20.217.188:44291)] handling channelInactive
19:19:25.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:25.213953 22037 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:25.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:25.208550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51482 (local address 127.20.217.188:44291)
19:19:25.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:25.210884 (+ 2334us) server_negotiation.cc:206] Beginning negotiation
19:19:25.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:25.210909 (+ 25us) server_negotiation.cc:399] Waiting for connection header
19:19:25.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:25.210955 (+ 46us) server_negotiation.cc:407] Connection header received
19:19:25.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:25.211093 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:25.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:25.211124 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:25.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:25.211367 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:25.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:25.211579 (+ 212us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:25.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:25.213251 (+ 1672us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51482: BlockingRecv error: recv got EOF from 127.0.0.1:51482 (error 108)
19:19:25.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":1910}
19:19:25.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:25 dist-test-slave-77v9 krb5kdc[21361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216765, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.217.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
19:19:25.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:25.237265 21816 init.cc:295] Successfully reacquired a new kerberos TGT
19:19:27.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:27 dist-test-slave-77v9 krb5kdc[21361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216767, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
19:19:27.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:27.653762 21927 init.cc:295] Successfully reacquired a new kerberos TGT
19:19:28.804 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.189:33117(127.20.217.189:33117)] connecting to peer
19:19:28.805 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.188:44291(127.20.217.188:44291)] connecting to peer
19:19:28.805 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.217.189:33117(127.20.217.189:33117)] Successfully connected to peer
19:19:28.806 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.217.188:44291(127.20.217.188:44291)] Successfully connected to peer
19:19:28.809 [DEBUG - kudu-nio-1] (SecurityContext.java:225) Refreshing Kerberos credentials...
19:19:28.809 [DEBUG - kudu-nio-1] (SecurityUtil.java:105) Using ticketCache: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/krb5cc
19:19:28.810 [DEBUG - kudu-nio-1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication
19:19:28.810 [WARN - kudu-nio-1] (SecurityContext.java:234) Tried to refresh Kerberos credentials but was unable to re-login from ticket cache
19:19:28.811 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.217.189:33117(127.20.217.189:33117)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:28.811 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.217.188:44291(127.20.217.188:44291)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:28.811 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.189:33117: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:28.811 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.188:44291: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:28.811 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.217.189:33117(127.20.217.189:33117)] handling channelInactive
19:19:28.811 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.217.188:44291(127.20.217.188:44291)] handling channelInactive
19:19:28.812 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755; will retry
19:19:28.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:28.813153 22046 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:28.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:28.807487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51486 (local address 127.20.217.188:44291)
19:19:28.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:28.809085 (+ 1598us) server_negotiation.cc:206] Beginning negotiation
19:19:28.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:28.809106 (+ 21us) server_negotiation.cc:399] Waiting for connection header
19:19:28.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:28.809158 (+ 52us) server_negotiation.cc:407] Connection header received
19:19:28.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:28.809300 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:28.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:28.809325 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:28.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:28.809550 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:28.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:28.809752 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:28.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:28.811856 (+ 2104us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51486: BlockingRecv error: recv got EOF from 127.0.0.1:51486 (error 108)
19:19:28.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":1019,"thread_start_us":771,"threads_started":1}
19:19:28.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:28.813876 22045 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:28.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:28.806153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34060 (local address 127.20.217.189:33117)
19:19:28.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:28.807898 (+ 1745us) server_negotiation.cc:206] Beginning negotiation
19:19:28.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:28.807945 (+ 47us) server_negotiation.cc:399] Waiting for connection header
19:19:28.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:28.808018 (+ 73us) server_negotiation.cc:407] Connection header received
19:19:28.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:28.808243 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:28.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:28.808273 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:28.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:28.808517 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:28.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:28.808788 (+ 271us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:28.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:28.812216 (+ 3428us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34060: BlockingRecv error: recv got EOF from 127.0.0.1:34060 (error 108)
19:19:28.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":1189,"thread_start_us":847,"threads_started":1}
19:19:29.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:29.697850 20755 debug-util.cc:398] Leaking SignalData structure 0x7b08000a1d00 after lost signal to thread 20686
19:19:29.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:29.698649 20755 debug-util.cc:398] Leaking SignalData structure 0x7b0800067ae0 after lost signal to thread 20758
19:19:30.044 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.189:33117(127.20.217.189:33117)] connecting to peer
19:19:30.045 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.188:44291(127.20.217.188:44291)] connecting to peer
19:19:30.045 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.217.189:33117(127.20.217.189:33117)] Successfully connected to peer
19:19:30.046 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.217.188:44291(127.20.217.188:44291)] Successfully connected to peer
19:19:30.069 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.217.188:44291(127.20.217.188:44291)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:30.069 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.217.189:33117(127.20.217.189:33117)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:30.069 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.189:33117: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:30.069 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.217.189:33117(127.20.217.189:33117)] handling channelInactive
19:19:30.069 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.188:44291: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:30.070 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755; will retry
19:19:30.071 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.217.188:44291(127.20.217.188:44291)] handling channelInactive
19:19:30.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:30.072559 22048 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:30.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:30.047132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38424 (local address 127.20.217.189:33117)
19:19:30.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:30.067742 (+ 20610us) server_negotiation.cc:206] Beginning negotiation
19:19:30.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:30.067766 (+ 24us) server_negotiation.cc:399] Waiting for connection header
19:19:30.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:30.067819 (+ 53us) server_negotiation.cc:407] Connection header received
19:19:30.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:30.067969 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:30.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:30.068000 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:30.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:30.068247 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:30.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:30.070396 (+ 2149us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:30.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:30.071362 (+ 966us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38424: BlockingRecv error: recv got EOF from 127.0.0.1:38424 (error 108)
19:19:30.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":19830,"thread_start_us":19510,"threads_started":1}
19:19:30.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:30.072611 22049 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:30.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:30.047799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43878 (local address 127.20.217.188:44291)
19:19:30.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:30.067475 (+ 19676us) server_negotiation.cc:206] Beginning negotiation
19:19:30.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:30.067508 (+ 33us) server_negotiation.cc:399] Waiting for connection header
19:19:30.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:30.067574 (+ 66us) server_negotiation.cc:407] Connection header received
19:19:30.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:30.067745 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:30.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:30.067784 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:30.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:30.068114 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:30.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:30.069673 (+ 1559us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:30.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:30.071542 (+ 1869us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43878: BlockingRecv error: recv got EOF from 127.0.0.1:43878 (error 108)
19:19:30.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":19135,"thread_start_us":19438,"threads_started":1}
19:19:33.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:33 dist-test-slave-77v9 krb5kdc[21361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216773, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.217.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
19:19:33.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:33.116535 21718 init.cc:295] Successfully reacquired a new kerberos TGT
19:19:33.804 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.189:33117(127.20.217.189:33117)] connecting to peer
19:19:33.805 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.188:44291(127.20.217.188:44291)] connecting to peer
19:19:33.806 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.217.189:33117(127.20.217.189:33117)] Successfully connected to peer
19:19:33.807 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.217.188:44291(127.20.217.188:44291)] Successfully connected to peer
19:19:33.811 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.217.188:44291(127.20.217.188:44291)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:33.812 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.217.189:33117(127.20.217.189:33117)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:33.812 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.189:33117: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:33.812 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.188:44291: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:33.812 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755; will retry
19:19:33.812 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.217.189:33117(127.20.217.189:33117)] handling channelInactive
19:19:33.812 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.217.188:44291(127.20.217.188:44291)] handling channelInactive
19:19:33.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:33.814327 22056 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:33.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:33.808505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38426 (local address 127.20.217.189:33117)
19:19:33.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:33.810898 (+ 2393us) server_negotiation.cc:206] Beginning negotiation
19:19:33.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:33.810930 (+ 32us) server_negotiation.cc:399] Waiting for connection header
19:19:33.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:33.811015 (+ 85us) server_negotiation.cc:407] Connection header received
19:19:33.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:33.811262 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:33.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:33.811292 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:33.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:33.811579 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:33.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:33.811804 (+ 225us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:33.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:33.813013 (+ 1209us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38426: BlockingRecv error: recv got EOF from 127.0.0.1:38426 (error 108)
19:19:33.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":1782,"thread_start_us":1213,"threads_started":1}
19:19:33.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:33.814378 22055 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:33.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:33.808496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43888 (local address 127.20.217.188:44291)
19:19:33.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:33.810419 (+ 1923us) server_negotiation.cc:206] Beginning negotiation
19:19:33.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:33.810457 (+ 38us) server_negotiation.cc:399] Waiting for connection header
19:19:33.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:33.810537 (+ 80us) server_negotiation.cc:407] Connection header received
19:19:33.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:33.810865 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:33.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:33.810897 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:33.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:33.811215 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:33.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:33.811500 (+ 285us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:33.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:33.813266 (+ 1766us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43888: BlockingRecv error: recv got EOF from 127.0.0.1:43888 (error 108)
19:19:33.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":1287,"thread_start_us":845,"threads_started":1}
19:19:35.024 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.189:33117(127.20.217.189:33117)] connecting to peer
19:19:35.024 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.188:44291(127.20.217.188:44291)] connecting to peer
19:19:35.025 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.217.189:33117(127.20.217.189:33117)] Successfully connected to peer
19:19:35.026 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.217.188:44291(127.20.217.188:44291)] Successfully connected to peer
19:19:35.028 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.217.189:33117(127.20.217.189:33117)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:35.028 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.189:33117: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:35.028 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.217.189:33117(127.20.217.189:33117)] handling channelInactive
19:19:35.030 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.217.188:44291(127.20.217.188:44291)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:35.030 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.188:44291: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:35.030 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755; will retry
19:19:35.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:35.030519 22057 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:35.031 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.217.188:44291(127.20.217.188:44291)] handling channelInactive
19:19:35.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:35.025409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38440 (local address 127.20.217.189:33117)
19:19:35.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:35.026713 (+ 1304us) server_negotiation.cc:206] Beginning negotiation
19:19:35.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:35.026735 (+ 22us) server_negotiation.cc:399] Waiting for connection header
19:19:35.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:35.026782 (+ 47us) server_negotiation.cc:407] Connection header received
19:19:35.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:35.026933 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:35.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:35.026971 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:35.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:35.027205 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:35.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:35.028204 (+ 999us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:35.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:35.029422 (+ 1218us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38440: BlockingRecv error: recv got EOF from 127.0.0.1:38440 (error 108)
19:19:35.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":871,"thread_start_us":587,"threads_started":1}
19:19:35.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:35.032801 22058 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:35.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:35.026647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43902 (local address 127.20.217.188:44291)
19:19:35.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:35.029056 (+ 2409us) server_negotiation.cc:206] Beginning negotiation
19:19:35.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:35.029087 (+ 31us) server_negotiation.cc:399] Waiting for connection header
19:19:35.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:35.029138 (+ 51us) server_negotiation.cc:407] Connection header received
19:19:35.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:35.029381 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:35.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:35.029404 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:35.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:35.029577 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:35.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:35.029791 (+ 214us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:35.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:35.031801 (+ 2010us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43902: BlockingRecv error: recv got EOF from 127.0.0.1:43902 (error 108)
19:19:35.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":1668,"thread_start_us":1258,"threads_started":1}
19:19:35.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:35 dist-test-slave-77v9 krb5kdc[21361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216775, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.217.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
19:19:35.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:35.240373 21816 init.cc:295] Successfully reacquired a new kerberos TGT
19:19:37.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:37 dist-test-slave-77v9 krb5kdc[21361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216777, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.217.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
19:19:37.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:37.656479 21927 init.cc:295] Successfully reacquired a new kerberos TGT
19:19:37.684 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.189:33117(127.20.217.189:33117)] connecting to peer
19:19:37.685 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.188:44291(127.20.217.188:44291)] connecting to peer
19:19:37.685 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.217.189:33117(127.20.217.189:33117)] Successfully connected to peer
19:19:37.686 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.217.188:44291(127.20.217.188:44291)] Successfully connected to peer
19:19:37.690 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.217.189:33117(127.20.217.189:33117)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:37.690 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.189:33117: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:37.690 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.217.189:33117(127.20.217.189:33117)] handling channelInactive
19:19:37.690 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.217.188:44291(127.20.217.188:44291)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:37.691 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.188:44291: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:37.691 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755; will retry
19:19:37.692 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.217.188:44291(127.20.217.188:44291)] handling channelInactive
19:19:37.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:37.692598 22064 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:37.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:37.686036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38452 (local address 127.20.217.189:33117)
19:19:37.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:37.688618 (+ 2582us) server_negotiation.cc:206] Beginning negotiation
19:19:37.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:37.688635 (+ 17us) server_negotiation.cc:399] Waiting for connection header
19:19:37.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:37.688678 (+ 43us) server_negotiation.cc:407] Connection header received
19:19:37.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:37.688871 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:37.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:37.688903 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:37.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:37.689165 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:37.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:37.689495 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:37.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:37.691124 (+ 1629us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38452: BlockingRecv error: recv got EOF from 127.0.0.1:38452 (error 108)
19:19:37.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":1935,"thread_start_us":1583,"threads_started":1}
19:19:37.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:37.693665 22065 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:37.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:37.687560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43912 (local address 127.20.217.188:44291)
19:19:37.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:37.689045 (+ 1485us) server_negotiation.cc:206] Beginning negotiation
19:19:37.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:37.689068 (+ 23us) server_negotiation.cc:399] Waiting for connection header
19:19:37.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:37.689128 (+ 60us) server_negotiation.cc:407] Connection header received
19:19:37.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:37.689296 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:37.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:37.689326 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:37.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:37.689591 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:37.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:37.689783 (+ 192us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:37.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:37.692250 (+ 2467us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43912: BlockingRecv error: recv got EOF from 127.0.0.1:43912 (error 108)
19:19:37.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":959,"thread_start_us":657,"threads_started":1}
19:19:40.043 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.189:33117(127.20.217.189:33117)] connecting to peer
19:19:40.044 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.188:44291(127.20.217.188:44291)] connecting to peer
19:19:40.045 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.217.189:33117(127.20.217.189:33117)] Successfully connected to peer
19:19:40.045 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.217.188:44291(127.20.217.188:44291)] Successfully connected to peer
19:19:40.049 [DEBUG - kudu-nio-1] (SecurityContext.java:225) Refreshing Kerberos credentials...
19:19:40.049 [DEBUG - kudu-nio-1] (SecurityUtil.java:105) Using ticketCache: /tmp/dist-test-taskHiEzcr/test-tmp/mini-kudu-cluster7214399185131027921/krb5kdc/krb5cc
19:19:40.051 [DEBUG - kudu-nio-1] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication
19:19:40.051 [WARN - kudu-nio-1] (SecurityContext.java:234) Tried to refresh Kerberos credentials but was unable to re-login from ticket cache
19:19:40.051 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.217.188:44291(127.20.217.188:44291)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:40.051 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.217.189:33117(127.20.217.189:33117)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:40.051 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.189:33117: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:40.051 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.188:44291: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:40.051 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755; will retry
19:19:40.051 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.217.189:33117(127.20.217.189:33117)] handling channelInactive
19:19:40.052 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.217.188:44291(127.20.217.188:44291)] handling channelInactive
19:19:40.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:40.053380 22069 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:40.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:40.045580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44080 (local address 127.20.217.189:33117)
19:19:40.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:40.048425 (+ 2845us) server_negotiation.cc:206] Beginning negotiation
19:19:40.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:40.048446 (+ 21us) server_negotiation.cc:399] Waiting for connection header
19:19:40.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:40.048497 (+ 51us) server_negotiation.cc:407] Connection header received
19:19:40.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:40.048641 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:40.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:40.048670 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:40.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:40.048943 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:40.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:40.049161 (+ 218us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:40.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:40.052202 (+ 3041us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44080: BlockingRecv error: recv got EOF from 127.0.0.1:44080 (error 108)
19:19:40.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":2402,"thread_start_us":2068,"threads_started":1}
19:19:40.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:40.053664 22070 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:40.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:40.047937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40590 (local address 127.20.217.188:44291)
19:19:40.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:40.049506 (+ 1569us) server_negotiation.cc:206] Beginning negotiation
19:19:40.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:40.049613 (+ 107us) server_negotiation.cc:399] Waiting for connection header
19:19:40.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:40.049677 (+ 64us) server_negotiation.cc:407] Connection header received
19:19:40.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:40.049830 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:40.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:40.049855 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:40.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:40.050080 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:40.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:40.050267 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:40.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:40.052550 (+ 2283us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40590: BlockingRecv error: recv got EOF from 127.0.0.1:40590 (error 108)
19:19:40.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":1112,"thread_start_us":813,"threads_started":1}
19:19:43.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:43 dist-test-slave-77v9 krb5kdc[21361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216783, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.217.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
19:19:43.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:43.119400 21718 init.cc:295] Successfully reacquired a new kerberos TGT
19:19:43.143 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.189:33117(127.20.217.189:33117)] connecting to peer
19:19:43.144 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.188:44291(127.20.217.188:44291)] connecting to peer
19:19:43.144 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.217.189:33117(127.20.217.189:33117)] Successfully connected to peer
19:19:43.145 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.217.188:44291(127.20.217.188:44291)] Successfully connected to peer
19:19:43.148 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.217.189:33117(127.20.217.189:33117)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:43.149 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.189:33117: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:43.149 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.217.189:33117(127.20.217.189:33117)] handling channelInactive
19:19:43.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:43.151525 22074 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:43.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.145391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44088 (local address 127.20.217.189:33117)
19:19:43.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.147141 (+ 1750us) server_negotiation.cc:206] Beginning negotiation
19:19:43.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.147173 (+ 32us) server_negotiation.cc:399] Waiting for connection header
19:19:43.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.147258 (+ 85us) server_negotiation.cc:407] Connection header received
19:19:43.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.147508 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:43.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.147537 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:43.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.147839 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:43.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.149688 (+ 1849us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:43.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.150575 (+ 887us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44088: BlockingRecv error: recv got EOF from 127.0.0.1:44088 (error 108)
19:19:43.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":1167,"thread_start_us":704,"threads_started":1}
19:19:43.153 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.217.188:44291(127.20.217.188:44291)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:43.153 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.188:44291: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:43.154 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755; will retry
19:19:43.154 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.217.188:44291(127.20.217.188:44291)] handling channelInactive
19:19:43.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:43.155673 22075 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:43.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.146832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40596 (local address 127.20.217.188:44291)
19:19:43.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.152192 (+ 5360us) server_negotiation.cc:206] Beginning negotiation
19:19:43.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.152215 (+ 23us) server_negotiation.cc:399] Waiting for connection header
19:19:43.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.152261 (+ 46us) server_negotiation.cc:407] Connection header received
19:19:43.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.152400 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:43.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.152425 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:43.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.152668 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:43.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.152899 (+ 231us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:43.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.154744 (+ 1845us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40596: BlockingRecv error: recv got EOF from 127.0.0.1:40596 (error 108)
19:19:43.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":4916,"thread_start_us":4640,"threads_started":1}
19:19:43.185 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.189:33117(127.20.217.189:33117)] connecting to peer
19:19:43.185 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.188:44291(127.20.217.188:44291)] connecting to peer
19:19:43.186 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.217.189:33117(127.20.217.189:33117)] Successfully connected to peer
19:19:43.187 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.217.188:44291(127.20.217.188:44291)] Successfully connected to peer
19:19:43.188 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.217.189:33117(127.20.217.189:33117)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:43.189 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.189:33117: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:43.189 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.217.189:33117(127.20.217.189:33117)] handling channelInactive
19:19:43.190 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.217.188:44291(127.20.217.188:44291)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:43.191 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.188:44291: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:43.191 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755; will retry
19:19:43.191 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.217.188:44291(127.20.217.188:44291)] handling channelInactive
19:19:43.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:43.192502 22074 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:43.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.186372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44098 (local address 127.20.217.189:33117)
19:19:43.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.187104 (+ 732us) server_negotiation.cc:206] Beginning negotiation
19:19:43.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.187139 (+ 35us) server_negotiation.cc:399] Waiting for connection header
19:19:43.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.187198 (+ 59us) server_negotiation.cc:407] Connection header received
19:19:43.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.187416 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:43.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.187461 (+ 45us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:43.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.187819 (+ 358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:43.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.189780 (+ 1961us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:43.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.190594 (+ 814us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44098: BlockingRecv error: recv got EOF from 127.0.0.1:44098 (error 108)
19:19:43.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":191}
19:19:43.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:43.192679 22075 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:43.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.188639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40600 (local address 127.20.217.188:44291)
19:19:43.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.189237 (+ 598us) server_negotiation.cc:206] Beginning negotiation
19:19:43.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.189269 (+ 32us) server_negotiation.cc:399] Waiting for connection header
19:19:43.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.189321 (+ 52us) server_negotiation.cc:407] Connection header received
19:19:43.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.189468 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:43.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.189495 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:43.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.189753 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:43.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.190053 (+ 300us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:43.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:43.191920 (+ 1867us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40600: BlockingRecv error: recv got EOF from 127.0.0.1:40600 (error 108)
19:19:43.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":172}
19:19:44.484 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.189:33117(127.20.217.189:33117)] connecting to peer
19:19:44.484 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.188:44291(127.20.217.188:44291)] connecting to peer
19:19:44.485 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.217.189:33117(127.20.217.189:33117)] Successfully connected to peer
19:19:44.486 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.217.188:44291(127.20.217.188:44291)] Successfully connected to peer
19:19:44.488 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.217.189:33117(127.20.217.189:33117)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:44.489 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.189:33117: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:44.490 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.217.189:33117(127.20.217.189:33117)] handling channelInactive
19:19:44.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:44.491313 22078 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:44.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:44.485422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44108 (local address 127.20.217.189:33117)
19:19:44.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:44.487155 (+ 1733us) server_negotiation.cc:206] Beginning negotiation
19:19:44.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:44.487179 (+ 24us) server_negotiation.cc:399] Waiting for connection header
19:19:44.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:44.487228 (+ 49us) server_negotiation.cc:407] Connection header received
19:19:44.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:44.487379 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:44.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:44.487411 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:44.492 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.217.188:44291(127.20.217.188:44291)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:44.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:44.487660 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:44.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:44.489327 (+ 1667us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:44.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:44.490128 (+ 801us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44108: BlockingRecv error: recv got EOF from 127.0.0.1:44108 (error 108)
19:19:44.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":1202,"thread_start_us":788,"threads_started":1}
19:19:44.492 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.188:44291: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:44.493 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755; will retry
19:19:44.493 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.217.188:44291(127.20.217.188:44291)] handling channelInactive
19:19:44.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:44.494904 22079 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:44.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:44.487231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40612 (local address 127.20.217.188:44291)
19:19:44.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:44.491046 (+ 3815us) server_negotiation.cc:206] Beginning negotiation
19:19:44.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:44.491071 (+ 25us) server_negotiation.cc:399] Waiting for connection header
19:19:44.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:44.491127 (+ 56us) server_negotiation.cc:407] Connection header received
19:19:44.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:44.491307 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:44.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:44.491324 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:44.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:44.491587 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:44.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:44.492066 (+ 479us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:44.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:44.493739 (+ 1673us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40612: BlockingRecv error: recv got EOF from 127.0.0.1:40612 (error 108)
19:19:44.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":3281,"thread_start_us":2918,"threads_started":1}
19:19:45.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Aug 08 19:19:45 dist-test-slave-77v9 krb5kdc[21361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786216785, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.217.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
19:19:45.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:45.243165 21816 init.cc:295] Successfully reacquired a new kerberos TGT
19:19:46.804 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.189:33117(127.20.217.189:33117)] connecting to peer
19:19:46.804 [DEBUG - pool-48-thread-1] (Connection.java:748) [peer master-127.20.217.188:44291(127.20.217.188:44291)] connecting to peer
19:19:46.805 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.20.217.189:33117(127.20.217.189:33117)] Successfully connected to peer
19:19:46.806 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.20.217.188:44291(127.20.217.188:44291)] Successfully connected to peer
19:19:46.808 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.20.217.189:33117(127.20.217.189:33117)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:46.809 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.189:33117: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:46.809 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.20.217.189:33117(127.20.217.189:33117)] handling channelInactive
19:19:46.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:46.811836 22084 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:46.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:46.805516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44120 (local address 127.20.217.189:33117)
19:19:46.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:46.807218 (+ 1702us) server_negotiation.cc:206] Beginning negotiation
19:19:46.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:46.807238 (+ 20us) server_negotiation.cc:399] Waiting for connection header
19:19:46.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:46.807293 (+ 55us) server_negotiation.cc:407] Connection header received
19:19:46.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:46.807468 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:46.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:46.807498 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:46.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:46.807872 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:46.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:46.809995 (+ 2123us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:46.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:46.810763 (+ 768us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44120: BlockingRecv error: recv got EOF from 127.0.0.1:44120 (error 108)
19:19:46.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":1218,"thread_start_us":917,"threads_started":1}
19:19:46.812 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.217.188:44291(127.20.217.188:44291)] cleaning up while in state NEGOTIATING due to: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:46.812 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.20.217.188:44291: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
19:19:46.813 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755; will retry
19:19:46.815 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1887) Cannot continue with RPC because of: Timed out: cannot complete before timeout: KuduRpc(method=ListTabletServers, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28950), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [146ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Configuration error: Server requires Kerberos, but this client is not authenticated (missing or expired TGT), [155ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Configuration error: Server requires Kerberos, but this client is not authenticated (missing or expired TGT), [177ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [178ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: Server requires Kerberos, but this client is not authenticated (missing or expired TGT),org.apache.kudu.client.NonRecoverableException: Server requires Kerberos, but this client is not authenticated (missing or expired TGT),org.apache.kudu.client.RecoverableException: Catalog manager is not initialized. State: Starting, [181ms] refreshing cache from master, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [200ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [201ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [208ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [208ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Catalog manager is not initialized. State: Starting,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [220ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [225ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [230ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [232ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [235ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [235ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Catalog manager is not initialized. State: Starting,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [255ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [260ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: OK, [264ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [265ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [300ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [314ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: OK, [325ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [326ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [362ms] refreshing cache from master, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [379ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [408ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: OK, [418ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [419ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [480ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [492ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: OK, [495ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [498ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [499ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [612ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [612ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: OK, [614ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [615ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [740ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [749ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: OK, [749ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [750ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [751ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [1120ms] refreshing cache from master, [1120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [1122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [1122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [1126ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [1128ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: OK, [1129ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [1130ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [1900ms] refreshing cache from master, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [1902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [1902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [1908ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: OK, [1908ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [1913ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [1913ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [3901ms] refreshing cache from master, [3901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [3902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [3903ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [3908ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [3909ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: OK, [3911ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [3911ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [5080ms] refreshing cache from master, [5080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [5081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [5082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [5086ms] too many traces: truncated at 100 traces, deferred=Deferred@1402014232(state=PENDING, result=null, callback=(continuation of Deferred@1608198561 after retry RPC after error@1866959470) -> (continuation of Deferred@1699089845 after retry RPC after error@1054608079) -> (continuation of Deferred@944552596 after retry RPC after error@1804292873) -> (continuation of Deferred@1056292968 after retry RPC after error@1621176075) -> (continuation of Deferred@1030005137 after retry RPC after error@214347311) -> (continuation of Deferred@471910751 after retry RPC after error@1972401319) -> (continuation of Deferred@1843407789 after retry RPC after error@1424906216) -> (continuation of Deferred@1310590491 after retry RPC after error@945645107) -> (continuation of Deferred@1410109398 after retry RPC after error@1920713640) -> (continuation of Deferred@1282096418 after retry RPC after error@525641314) -> (continuation of Deferred@790030433 after retry RPC after error@64751784) -> (continuation of Deferred@374061020 after retry RPC after error@748057793) -> (continuation of Deferred@878429394 after retry RPC after error@1470170041) -> (continuation of Deferred@480230342 after retry RPC after error@53540072) -> (continuation of Deferred@1764216072 after retry RPC after error@910468958) -> (continuation of Deferred@1474587611 after retry RPC after error@1400328827) -> (continuation of Deferred@82807440 after retry RPC after error@394437380) -> (continuation of Deferred@1674356892 after retry RPC after error@172087828) -> (continuation of Deferred@1921153734 after retry RPC after error@1880784145) -> (continuation of Deferred@1981064134 after retry RPC after error@1912686186) -> (continuation of Deferred@330581670 after retry RPC after error@811942708) -> (continuation of Deferred@1673321581 after retry RPC after error@460776550) -> (continuation of Deferred@709234904 after retry RPC after error@807443015) -> (continuation of Deferred@897214362 after retry RPC after error@428077191), errback=(continuation of Deferred@1608198561 after retry RPC after error@1866959470) -> (continuation of Deferred@1699089845 after retry RPC after error@1054608079) -> (continuation of Deferred@944552596 after retry RPC after error@1804292873) -> (continuation of Deferred@1056292968 after retry RPC after error@1621176075) -> (continuation of Deferred@1030005137 after retry RPC after error@214347311) -> (continuation of Deferred@471910751 after retry RPC after error@1972401319) -> (continuation of Deferred@1843407789 after retry RPC after error@1424906216) -> (continuation of Deferred@1310590491 after retry RPC after error@945645107) -> (continuation of Deferred@1410109398 after retry RPC after error@1920713640) -> (continuation of Deferred@1282096418 after retry RPC after error@525641314) -> (continuation of Deferred@790030433 after retry RPC after error@64751784) -> (continuation of Deferred@374061020 after retry RPC after error@748057793) -> (continuation of Deferred@878429394 after retry RPC after error@1470170041) -> (continuation of Deferred@480230342 after retry RPC after error@53540072) -> (continuation of Deferred@1764216072 after retry RPC after error@910468958) -> (continuation of Deferred@1474587611 after retry RPC after error@1400328827) -> (continuation of Deferred@82807440 after retry RPC after error@394437380) -> (continuation of Deferred@1674356892 after retry RPC after error@172087828) -> (continuation of Deferred@1921153734 after retry RPC after error@1880784145) -> (continuation of Deferred@1981064134 after retry RPC after error@1912686186) -> (continuation of Deferred@330581670 after retry RPC after error@811942708) -> (continuation of Deferred@1673321581 after retry RPC after error@460776550) -> (continuation of Deferred@709234904 after retry RPC after error@807443015) -> (continuation of Deferred@897214362 after retry RPC after error@428077191)))
19:19:46.817 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.217.188:44291(127.20.217.188:44291)] handling channelInactive
19:19:46.818 [DEBUG - main] (Connection.java:575) [peer master-127.20.217.190:34755(127.20.217.190:34755)] disconnecting while in state READY
19:19:46.818 [DEBUG - main] (Connection.java:575) [peer master-127.20.217.188:44291(127.20.217.188:44291)] disconnecting while in state TERMINATED
19:19:46.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:46.818563 22085 negotiation.cc:337] Failed RPC negotiation. Trace:
19:19:46.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:46.807202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40622 (local address 127.20.217.188:44291)
19:19:46.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:46.811090 (+ 3888us) server_negotiation.cc:206] Beginning negotiation
19:19:46.818 [DEBUG - main] (Connection.java:575) [peer master-127.20.217.189:33117(127.20.217.189:33117)] disconnecting while in state TERMINATED
19:19:46.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:46.811157 (+ 67us) server_negotiation.cc:399] Waiting for connection header
19:19:46.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:46.811244 (+ 87us) server_negotiation.cc:407] Connection header received
19:19:46.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:46.811442 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
19:19:46.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:46.811596 (+ 154us) server_negotiation.cc:461] Received NEGOTIATE request from client
19:19:46.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:46.811879 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
19:19:46.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:46.812844 (+ 965us) server_negotiation.cc:226] Negotiated authn=SASL
19:19:46.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0808 19:19:46.817521 (+ 4677us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40622: BlockingRecv error: recv got EOF from 127.0.0.1:40622 (error 108)
19:19:46.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":3257,"thread_start_us":2943,"threads_started":1}
19:19:46.820 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
19:19:46.821 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.20.217.190:34755(127.20.217.190:34755)] handling channelInactive
19:19:46.821 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.20.217.190:34755(127.20.217.190:34755)] cleaning up while in state READY due to: connection closed
19:19:46.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:46.823725 21350 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu with pid 21877
19:19:46.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:46.855065 21350 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu with pid 21704
19:19:46.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:46.888652 21350 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu with pid 21781
19:19:47.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:47.355732 21334 debug-util.cc:398] Leaking SignalData structure 0x7b08000bc640 after lost signal to thread 21205
19:19:47.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:47.356622 21334 debug-util.cc:398] Leaking SignalData structure 0x7b08000afa60 after lost signal to thread 21337
19:19:48.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-08-08T19:19:48Z chronyd exiting
19:19:49.264 [DEBUG - main] (AsyncKuduClient.java:2704) Releasing all remaining resources
19:19:49.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:49.265750 20598 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu with pid 20890
19:19:49.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:49.300518 20598 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu with pid 21059
19:19:49.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:49.334678 20707 connection.cc:535] server connection from 127.20.29.130:35761 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
19:19:49.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:49.334682 20627 connection.cc:535] server connection from 127.20.29.130:41029 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
19:19:49.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260808 19:19:49.334741 20787 connection.cc:535] server connection from 127.20.29.130:39853 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
19:19:49.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:49.335692 20598 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu with pid 21202
19:19:49.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:49.373512 20598 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu with pid 20610
19:19:49.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:49.413385 20598 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu with pid 20682
19:19:49.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260808 19:19:49.458732 20598 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskHiEzcr/build/tsan/bin/kudu with pid 20761
19:19:50.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-08-08T19:19:50Z chronyd exiting
19:19:51.715 [ERROR - main] (RetryRule.java:206) org.apache.kudu.client.TestSecurity.testDoNotSwitchPrincipalsInExistingClient: failed attempt 1
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=ListTabletServers, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28950), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [146ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Configuration error: Server requires Kerberos, but this client is not authenticated (missing or expired TGT), [155ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Configuration error: Server requires Kerberos, but this client is not authenticated (missing or expired TGT), [177ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [178ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: Server requires Kerberos, but this client is not authenticated (missing or expired TGT),org.apache.kudu.client.NonRecoverableException: Server requires Kerberos, but this client is not authenticated (missing or expired TGT),org.apache.kudu.client.RecoverableException: Catalog manager is not initialized. State: Starting, [181ms] refreshing cache from master, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [200ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [201ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [208ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [208ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Catalog manager is not initialized. State: Starting,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [220ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [225ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [230ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [232ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [235ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [235ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Catalog manager is not initialized. State: Starting,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [255ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [260ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: OK, [264ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [265ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [300ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [314ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: OK, [325ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [326ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [362ms] refreshing cache from master, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [379ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [408ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: OK, [418ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [419ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [480ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [492ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: OK, [495ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [498ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [499ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [612ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [612ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: OK, [614ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [615ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [740ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [749ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: OK, [749ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [750ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [751ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [1120ms] refreshing cache from master, [1120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [1122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [1122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [1126ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [1128ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: OK, [1129ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [1130ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [1900ms] refreshing cache from master, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [1902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [1902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [1908ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: OK, [1908ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [1913ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [1913ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [3901ms] refreshing cache from master, [3901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [3902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [3903ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [3908ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [3909ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: OK, [3911ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [3911ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [5080ms] refreshing cache from master, [5080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [5081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [5082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [5086ms] too many traces: truncated at 100 traces, deferred=Deferred@1402014232(state=PENDING, result=null, callback=(continuation of Deferred@1608198561 after retry RPC after error@1866959470) -> (continuation of Deferred@1699089845 after retry RPC after error@1054608079) -> (continuation of Deferred@944552596 after retry RPC after error@1804292873) -> (continuation of Deferred@1056292968 after retry RPC after error@1621176075) -> (continuation of Deferred@1030005137 after retry RPC after error@214347311) -> (continuation of Deferred@471910751 after retry RPC after error@1972401319) -> (continuation of Deferred@1843407789 after retry RPC after error@1424906216) -> (continuation of Deferred@1310590491 after retry RPC after error@945645107) -> (continuation of Deferred@1410109398 after retry RPC after error@1920713640) -> (continuation of Deferred@1282096418 after retry RPC after error@525641314) -> (continuation of Deferred@790030433 after retry RPC after error@64751784) -> (continuation of Deferred@374061020 after retry RPC after error@748057793) -> (continuation of Deferred@878429394 after retry RPC after error@1470170041) -> (continuation of Deferred@480230342 after retry RPC after error@53540072) -> (continuation of Deferred@1764216072 after retry RPC after error@910468958) -> (continuation of Deferred@1474587611 after retry RPC after error@1400328827) -> (continuation of Deferred@82807440 after retry RPC after error@394437380) -> (continuation of Deferred@1674356892 after retry RPC after error@172087828) -> (continuation of Deferred@1921153734 after retry RPC after error@1880784145) -> (continuation of Deferred@1981064134 after retry RPC after error@1912686186) -> (continuation of Deferred@330581670 after retry RPC after error@811942708) -> (continuation of Deferred@1673321581 after retry RPC after error@460776550) -> (continuation of Deferred@709234904 after retry RPC after error@807443015) -> (continuation of Deferred@897214362 after retry RPC after error@428077191), errback=(continuation of Deferred@1608198561 after retry RPC after error@1866959470) -> (continuation of Deferred@1699089845 after retry RPC after error@1054608079) -> (continuation of Deferred@944552596 after retry RPC after error@1804292873) -> (continuation of Deferred@1056292968 after retry RPC after error@1621176075) -> (continuation of Deferred@1030005137 after retry RPC after error@214347311) -> (continuation of Deferred@471910751 after retry RPC after error@1972401319) -> (continuation of Deferred@1843407789 after retry RPC after error@1424906216) -> (continuation of Deferred@1310590491 after retry RPC after error@945645107) -> (continuation of Deferred@1410109398 after retry RPC after error@1920713640) -> (continuation of Deferred@1282096418 after retry RPC after error@525641314) -> (continuation of Deferred@790030433 after retry RPC after error@64751784) -> (continuation of Deferred@374061020 after retry RPC after error@748057793) -> (continuation of Deferred@878429394 after retry RPC after error@1470170041) -> (continuation of Deferred@480230342 after retry RPC after error@53540072) -> (continuation of Deferred@1764216072 after retry RPC after error@910468958) -> (continuation of Deferred@1474587611 after retry RPC after error@1400328827) -> (continuation of Deferred@82807440 after retry RPC after error@394437380) -> (continuation of Deferred@1674356892 after retry RPC after error@172087828) -> (continuation of Deferred@1921153734 after retry RPC after error@1880784145) -> (continuation of Deferred@1981064134 after retry RPC after error@1912686186) -> (continuation of Deferred@330581670 after retry RPC after error@811942708) -> (continuation of Deferred@1673321581 after retry RPC after error@460776550) -> (continuation of Deferred@709234904 after retry RPC after error@807443015) -> (continuation of Deferred@897214362 after retry RPC after error@428077191)))
at org.apache.kudu.client.KuduException.transformException(KuduException.java:110) ~[main/:?]
at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564) ~[main/:?]
at org.apache.kudu.client.KuduClient.listTabletServers(KuduClient.java:263) ~[main/:?]
at org.apache.kudu.client.TestSecurity$3.get(TestSecurity.java:386) ~[test/:?]
at org.apache.kudu.test.junit.AssertHelpers.assertEventuallyTrue(AssertHelpers.java:40) ~[kudu-test-utils-1.18.0-SNAPSHOT-unshaded.jar:1.18.0-SNAPSHOT]
at org.apache.kudu.client.TestSecurity.assertEventualAuthenticationFailure(TestSecurity.java:378) ~[test/:?]
at org.apache.kudu.client.TestSecurity.testDoNotSwitchPrincipalsInExistingClient(TestSecurity.java:366) ~[test/:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_362]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_362]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_362]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_362]
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) ~[junit-4.13.2.jar:4.13.2]
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) ~[junit-4.13.2.jar:4.13.2]
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) ~[junit-4.13.2.jar:4.13.2]
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) ~[junit-4.13.2.jar:4.13.2]
at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) ~[junit-4.13.2.jar:4.13.2]
at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) ~[junit-4.13.2.jar:4.13.2]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_362]
at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_362]
Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889) ~[main/:?]
at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337) ~[main/:?]
at org.apache.kudu.client.AsyncKuduClient.access$1500(AsyncKuduClient.java:299) ~[main/:?]
at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520) ~[main/:?]
at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510) ~[main/:?]
at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280) ~[async-1.4.1.jar:?]
at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259) ~[async-1.4.1.jar:?]
at com.stumbleupon.async.Deferred.callback(Deferred.java:1002) ~[async-1.4.1.jar:?]
at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313) ~[main/:?]
at org.apache.kudu.client.ConnectToCluster.access$000(ConnectToCluster.java:51) ~[main/:?]
at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387) ~[main/:?]
at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376) ~[main/:?]
at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280) ~[async-1.4.1.jar:?]
at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259) ~[async-1.4.1.jar:?]
at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315) ~[async-1.4.1.jar:?]
at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286) ~[async-1.4.1.jar:?]
at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259) ~[async-1.4.1.jar:?]
at com.stumbleupon.async.Deferred.callback(Deferred.java:1002) ~[async-1.4.1.jar:?]
at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277) ~[main/:?]
at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331) ~[main/:?]
at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:256) ~[main/:?]
at org.apache.kudu.client.RpcProxy.access$000(RpcProxy.java:64) ~[main/:?]
at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158) ~[main/:?]
at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154) ~[main/:?]
at org.apache.kudu.client.Connection.cleanup(Connection.java:737) ~[main/:?]
at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455) ~[main/:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:346) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:325) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireExceptionCaught(AbstractChannelHandlerContext.java:317) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.ChannelInboundHandlerAdapter.exceptionCaught(ChannelInboundHandlerAdapter.java:143) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:346) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:447) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) ~[netty-handler-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) ~[netty-codec-4.1.94.Final.jar:4.1.94.Final]
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) ~[netty-codec-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) ~[netty-codec-4.1.94.Final.jar:4.1.94.Final]
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) ~[netty-codec-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) ~[netty-common-4.1.94.Final.jar:4.1.94.Final]
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[netty-common-4.1.94.Final.jar:4.1.94.Final]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_362]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_362]
at java.lang.Thread.run(Thread.java:750) ~[?:1.8.0_362]
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311) ~[main/:?]
at org.apache.kudu.client.ConnectToCluster.access$000(ConnectToCluster.java:51) ~[main/:?]
at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387) ~[main/:?]
at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376) ~[main/:?]
at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280) ~[async-1.4.1.jar:?]
at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259) ~[async-1.4.1.jar:?]
at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315) ~[async-1.4.1.jar:?]
at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286) ~[async-1.4.1.jar:?]
at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259) ~[async-1.4.1.jar:?]
at com.stumbleupon.async.Deferred.callback(Deferred.java:1002) ~[async-1.4.1.jar:?]
at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277) ~[main/:?]
at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331) ~[main/:?]
at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:256) ~[main/:?]
at org.apache.kudu.client.RpcProxy.access$000(RpcProxy.java:64) ~[main/:?]
at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158) ~[main/:?]
at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154) ~[main/:?]
at org.apache.kudu.client.Connection.cleanup(Connection.java:737) ~[main/:?]
at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455) ~[main/:?]
at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:346) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:325) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireExceptionCaught(AbstractChannelHandlerContext.java:317) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.ChannelInboundHandlerAdapter.exceptionCaught(ChannelInboundHandlerAdapter.java:143) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:346) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:447) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) ~[netty-handler-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) ~[netty-codec-4.1.94.Final.jar:4.1.94.Final]
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) ~[netty-codec-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) ~[netty-codec-4.1.94.Final.jar:4.1.94.Final]
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) ~[netty-codec-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) ~[netty-common-4.1.94.Final.jar:4.1.94.Final]
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[netty-common-4.1.94.Final.jar:4.1.94.Final]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_362]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_362]
... 1 more
Caused by: org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
at org.apache.kudu.client.Negotiator.chooseAndInitializeSaslMech(Negotiator.java:565) ~[main/:?]
at org.apache.kudu.client.Negotiator.handleNegotiateResponse(Negotiator.java:433) ~[main/:?]
at org.apache.kudu.client.Negotiator.channelRead0(Negotiator.java:367) ~[main/:?]
at org.apache.kudu.client.Negotiator.channelRead0(Negotiator.java:94) ~[main/:?]
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) ~[netty-handler-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) ~[netty-codec-4.1.94.Final.jar:4.1.94.Final]
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) ~[netty-codec-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) ~[netty-codec-4.1.94.Final.jar:4.1.94.Final]
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) ~[netty-codec-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) ~[netty-transport-4.1.94.Final.jar:4.1.94.Final]
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) ~[netty-common-4.1.94.Final.jar:4.1.94.Final]
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[netty-common-4.1.94.Final.jar:4.1.94.Final]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_362]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_362]
... 1 more
org.apache.kudu.client.NonRecoverableException: cannot complete before timeout: KuduRpc(method=ListTabletServers, tablet=null, attempt=25, TimeoutTracker(timeout=30000, elapsed=28950), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [146ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Configuration error: Server requires Kerberos, but this client is not authenticated (missing or expired TGT), [155ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Configuration error: Server requires Kerberos, but this client is not authenticated (missing or expired TGT), [177ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [178ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: Server requires Kerberos, but this client is not authenticated (missing or expired TGT),org.apache.kudu.client.NonRecoverableException: Server requires Kerberos, but this client is not authenticated (missing or expired TGT),org.apache.kudu.client.RecoverableException: Catalog manager is not initialized. State: Starting, [181ms] refreshing cache from master, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [183ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [184ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [200ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [201ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [208ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [208ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Catalog manager is not initialized. State: Starting,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [220ms] refreshing cache from master, [221ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [224ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [225ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [230ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [232ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [235ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [235ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Catalog manager is not initialized. State: Starting,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [255ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [260ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: OK, [264ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [265ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [300ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [314ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: OK, [325ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [326ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [362ms] refreshing cache from master, [362ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [363ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [364ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [379ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [408ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: OK, [418ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [419ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [480ms] refreshing cache from master, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [492ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: OK, [495ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [498ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [499ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [601ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [612ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [612ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: OK, [614ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [615ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [740ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [742ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [749ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: OK, [749ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [750ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [751ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [1120ms] refreshing cache from master, [1120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [1122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [1122ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [1126ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [1128ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: OK, [1129ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [1130ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [1900ms] refreshing cache from master, [1901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [1902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [1902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [1908ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: OK, [1908ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [1913ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [1913ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [3901ms] refreshing cache from master, [3901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [3902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [3903ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [3908ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.188:44291: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [3909ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.190:34755: OK, [3911ms] Sub RPC ConnectToMaster: received response from server master-127.20.217.189:33117: Not authorized: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [3911ms] delaying RPC due to: Service unavailable: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available, [5080ms] refreshing cache from master, [5080ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.189:33117, [5081ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.188:44291, [5082ms] Sub RPC ConnectToMaster: sending RPC to server master-127.20.217.190:34755, [5086ms] too many traces: truncated at 100 traces, deferred=Deferred@1402014232(state=PENDING, result=null, callback=(continuation of Deferred@1608198561 after retry RPC after error@1866959470) -> (continuation of Deferred@1699089845 after retry RPC after error@1054608079) -> (continuation of Deferred@944552596 after retry RPC after error@1804292873) -> (continuation of Deferred@1056292968 after retry RPC after error@1621176075) -> (continuation of Deferred@1030005137 after retry RPC after error@214347311) -> (continuation of Deferred@471910751 after retry RPC after error@1972401319) -> (continuation of Deferred@1843407789 after retry RPC after error@1424906216) -> (continuation of Deferred@1310590491 after retry RPC after error@945645107) -> (continuation of Deferred@1410109398 after retry RPC after error@1920713640) -> (continuation of Deferred@1282096418 after retry RPC after error@525641314) -> (continuation of Deferred@790030433 after retry RPC after error@64751784) -> (continuation of Deferred@374061020 after retry RPC after error@748057793) -> (continuation of Deferred@878429394 after retry RPC after error@1470170041) -> (continuation of Deferred@480230342 after retry RPC after error@53540072) -> (continuation of Deferred@1764216072 after retry RPC after error@910468958) -> (continuation of Deferred@1474587611 after retry RPC after error@1400328827) -> (continuation of Deferred@82807440 after retry RPC after error@394437380) -> (continuation of Deferred@1674356892 after retry RPC after error@172087828) -> (continuation of Deferred@1921153734 after retry RPC after error@1880784145) -> (continuation of Deferred@1981064134 after retry RPC after error@1912686186) -> (continuation of Deferred@330581670 after retry RPC after error@811942708) -> (continuation of Deferred@1673321581 after retry RPC after error@460776550) -> (continuation of Deferred@709234904 after retry RPC after error@807443015) -> (continuation of Deferred@897214362 after retry RPC after error@428077191), errback=(continuation of Deferred@1608198561 after retry RPC after error@1866959470) -> (continuation of Deferred@1699089845 after retry RPC after error@1054608079) -> (continuation of Deferred@944552596 after retry RPC after error@1804292873) -> (continuation of Deferred@1056292968 after retry RPC after error@1621176075) -> (continuation of Deferred@1030005137 after retry RPC after error@214347311) -> (continuation of Deferred@471910751 after retry RPC after error@1972401319) -> (continuation of Deferred@1843407789 after retry RPC after error@1424906216) -> (continuation of Deferred@1310590491 after retry RPC after error@945645107) -> (continuation of Deferred@1410109398 after retry RPC after error@1920713640) -> (continuation of Deferred@1282096418 after retry RPC after error@525641314) -> (continuation of Deferred@790030433 after retry RPC after error@64751784) -> (continuation of Deferred@374061020 after retry RPC after error@748057793) -> (continuation of Deferred@878429394 after retry RPC after error@1470170041) -> (continuation of Deferred@480230342 after retry RPC after error@53540072) -> (continuation of Deferred@1764216072 after retry RPC after error@910468958) -> (continuation of Deferred@1474587611 after retry RPC after error@1400328827) -> (continuation of Deferred@82807440 after retry RPC after error@394437380) -> (continuation of Deferred@1674356892 after retry RPC after error@172087828) -> (continuation of Deferred@1921153734 after retry RPC after error@1880784145) -> (continuation of Deferred@1981064134 after retry RPC after error@1912686186) -> (continuation of Deferred@330581670 after retry RPC after error@811942708) -> (continuation of Deferred@1673321581 after retry RPC after error@460776550) -> (continuation of Deferred@709234904 after retry RPC after error@807443015) -> (continuation of Deferred@897214362 after retry RPC after error@428077191)))
at org.apache.kudu.client.KuduException.transformException(KuduException.java:110)
at org.apache.kudu.client.KuduClient.joinAndHandleException(KuduClient.java:564)
at org.apache.kudu.client.KuduClient.listTabletServers(KuduClient.java:263)
at org.apache.kudu.client.TestSecurity$3.get(TestSecurity.java:386)
at org.apache.kudu.test.junit.AssertHelpers.assertEventuallyTrue(AssertHelpers.java:40)
at org.apache.kudu.client.TestSecurity.assertEventualAuthenticationFailure(TestSecurity.java:378)
at org.apache.kudu.client.TestSecurity.testDoNotSwitchPrincipalsInExistingClient(TestSecurity.java:366)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.lang.Thread.run(Thread.java:750)
Suppressed: org.apache.kudu.client.KuduException$OriginalException: Original asynchronous stack trace
at org.apache.kudu.client.AsyncKuduClient.tooManyAttemptsOrTimeout(AsyncKuduClient.java:1889)
at org.apache.kudu.client.AsyncKuduClient.delayedSendRpcToTablet(AsyncKuduClient.java:2337)
at org.apache.kudu.client.AsyncKuduClient.access$1500(AsyncKuduClient.java:299)
at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1520)
at org.apache.kudu.client.AsyncKuduClient$RetryRpcErrback.call(AsyncKuduClient.java:1510)
at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:313)
at org.apache.kudu.client.ConnectToCluster.access$000(ConnectToCluster.java:51)
at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:256)
at org.apache.kudu.client.RpcProxy.access$000(RpcProxy.java:64)
at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:346)
at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:325)
at io.netty.channel.AbstractChannelHandlerContext.fireExceptionCaught(AbstractChannelHandlerContext.java:317)
at io.netty.channel.ChannelInboundHandlerAdapter.exceptionCaught(ChannelInboundHandlerAdapter.java:143)
at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:346)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:447)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
... 1 more
Caused by: org.apache.kudu.client.NoLeaderFoundException: Master config (127.20.217.189:33117,127.20.217.188:44291,127.20.217.190:34755) has no leader. Exceptions received: org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available,org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
at org.apache.kudu.client.ConnectToCluster.incrementCountAndCheckExhausted(ConnectToCluster.java:311)
at org.apache.kudu.client.ConnectToCluster.access$000(ConnectToCluster.java:51)
at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:387)
at org.apache.kudu.client.ConnectToCluster$ConnectToMasterErrCB.call(ConnectToCluster.java:376)
at com.stumbleupon.async.Deferred.doCall(Deferred.java:1280)
at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
at com.stumbleupon.async.Deferred.handleContinuation(Deferred.java:1315)
at com.stumbleupon.async.Deferred.doCall(Deferred.java:1286)
at com.stumbleupon.async.Deferred.runCallbacks(Deferred.java:1259)
at com.stumbleupon.async.Deferred.callback(Deferred.java:1002)
at org.apache.kudu.client.KuduRpc.handleCallback(KuduRpc.java:277)
at org.apache.kudu.client.KuduRpc.errback(KuduRpc.java:331)
at org.apache.kudu.client.RpcProxy.responseReceived(RpcProxy.java:256)
at org.apache.kudu.client.RpcProxy.access$000(RpcProxy.java:64)
at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:158)
at org.apache.kudu.client.RpcProxy$1.call(RpcProxy.java:154)
at org.apache.kudu.client.Connection.cleanup(Connection.java:737)
at org.apache.kudu.client.Connection.exceptionCaught(Connection.java:455)
at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:346)
at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:325)
at io.netty.channel.AbstractChannelHandlerContext.fireExceptionCaught(AbstractChannelHandlerContext.java:317)
at io.netty.channel.ChannelInboundHandlerAdapter.exceptionCaught(ChannelInboundHandlerAdapter.java:143)
at io.netty.channel.AbstractChannelHandlerContext.invokeExceptionCaught(AbstractChannelHandlerContext.java:346)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:447)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)
at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346)
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412)
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420)
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166)
at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788)
at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724)
at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562)
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997)
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
... 1 more
Caused by: org.apache.kudu.client.NonRecoverableException: server requires authentication, but client does not have Kerberos credentials (tgt). Authentication tokens were not used because no token is available
at org.apache.kudu.client.Negotiator.chooseAndInitializeSaslMech(Negotiator.java:565)
at org.apache.kudu.client.Negotiator.handleNegotiateResponse(Negotiator.java:433)
at org.apache.kudu.client.Negotiator.channelRead0(Negotiator.java:367)
at org.apache.kudu.client.Negotiator.channelRead0(Negotiator.java:94)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444)
... 30 more