TableKeyRangeTest.TestGetTableKeyRange: /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: Timeout exceeded waiting to connect
W20260619 18:45:39.189235 12461 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.648257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35734)
0619 18:45:36.705840 (+3057583us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:36.882240 (+176400us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":2901999,"thread_start_us":2977880,"threads_started":1}
W20260619 18:45:39.190084 12438 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.510339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:33720)
0619 18:45:35.532628 (+2022289us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:35.532739 (+ 111us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:35.533408 (+ 669us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:35.620789 (+ 87381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:35.647212 (+ 26423us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:35.679584 (+ 32372us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:36.512914 (+833330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:36.525882 (+ 12968us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:36.618143 (+ 92261us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":2021418,"mutex_wait_us":784,"thread_start_us":2362717,"threads_started":1}
W20260619 18:45:39.168941 12217 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.767s user 0.000s sys 0.003s
W20260619 18:45:39.180317 12182 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.585395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35606 (local address 127.6.120.254:36501)
0619 18:45:36.972714 (+387319us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:36.972756 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:36.972836 (+ 80us) server_negotiation.cc:407] Connection header received
0619 18:45:36.973026 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:36.973059 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:36.973438 (+ 379us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:36.973687 (+ 249us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:38.386560 (+1412873us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35606: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"mutex_wait_us":1143836,"server-negotiator.queue_time_us":386768,"thread_start_us":1703062,"threads_started":1}
W20260619 18:45:39.208143 12490 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.793598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35594 (local address 127.6.120.254:36501)
0619 18:45:38.217732 (+1424134us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:38.264277 (+ 46545us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:38.449398 (+185121us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35594: BlockingRecv error: recv got EOF from 127.0.0.1:35594 (error 108)
Metrics: {"server-negotiator.queue_time_us":1025711,"thread_start_us":2208255,"threads_started":1}
W20260619 18:45:39.210258 12490 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.176005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35618 (local address 127.6.120.254:36501)
0619 18:45:39.209098 (+ 33093us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.209136 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.209510 (+ 374us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35618: BlockingRecv error: recv got EOF from 127.0.0.1:35618 (error 108)
Metrics: {"server-negotiator.queue_time_us":28904}
W20260619 18:45:39.211318 12187 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.569385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35564 (local address 127.6.120.254:36501)
0619 18:45:36.982061 (+412676us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:36.982098 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.053301 (+2071203us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35564: BlockingRecv error: recv got EOF from 127.0.0.1:35564 (error 108)
Metrics: {"mutex_wait_us":28815,"server-negotiator.queue_time_us":395558,"thread_start_us":172313,"threads_started":1}
W20260619 18:45:39.097761 12221 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.085s user 0.042s sys 0.068s
I20260619 18:45:39.191186 12051 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:39.283208 12051 scanner-internal.cc:458] Time spent opening tablet: real 6.792s user 0.001s sys 0.013s
I20260619 18:45:39.283692 12017 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:39.284320 12017 scanner-internal.cc:458] Time spent opening tablet: real 7.924s user 0.023s sys 0.010s
I20260619 18:45:39.284940 12010 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:39.285490 12010 scanner-internal.cc:458] Time spent opening tablet: real 7.657s user 0.025s sys 0.022s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: Timeout exceeded waiting to connect
W20260619 18:45:39.287926 12182 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.272434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35686 (local address 127.6.120.254:36501)
0619 18:45:39.284288 (+ 11854us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.284323 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.284628 (+ 305us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35686: BlockingRecv error: recv got EOF from 127.0.0.1:35686 (error 108)
Metrics: {"server-negotiator.queue_time_us":8767}
W20260619 18:45:39.270323 12468 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:35.660991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33734 (local address 127.6.120.193:37901)
0619 18:45:36.674982 (+1013991us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:36.675018 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:38.638012 (+1962994us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:33734: received 0 of 7 requested bytes
Metrics: {"server-negotiator.queue_time_us":1005059,"thread_start_us":2833422,"threads_started":1}
W20260619 18:45:39.297076 12091 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.781716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35636 (local address 127.6.120.254:36501)
0619 18:45:33.817782 (+ 36066us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:33.817843 (+ 61us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:36.939342 (+3121499us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35636: received 0 of 7 requested bytes
Metrics: {"server-negotiator.queue_time_us":35179}
W20260619 18:45:39.270752 12218 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 64288.4us
W20260619 18:45:39.339164 12247 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.184s user 0.046s sys 0.084s
W20260619 18:45:39.356555 12247 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.216s user 0.046s sys 0.085s
W20260619 18:45:39.271514 12246 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 109573us
W20260619 18:45:39.344868 12318 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.719498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35756)
0619 18:45:33.725141 (+ 5643us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:33.725213 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:33.725568 (+ 355us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:37.596428 (+3870860us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":4971}
W20260619 18:45:39.359006 12014 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.294571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35624 (local address 127.6.120.254:36501)
0619 18:45:38.952621 (+658050us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:38.959425 (+ 6804us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:38.963266 (+ 3841us) server_negotiation.cc:407] Connection header received
0619 18:45:38.986991 (+ 23725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:38.988330 (+ 1339us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:38.995126 (+ 6796us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.025837 (+ 30711us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35624: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"server-negotiator.queue_time_us":244856}
W20260619 18:45:39.381538 12462 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.709704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35736)
0619 18:45:38.367167 (+4657463us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:38.470610 (+103443us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":4176878,"thread_start_us":2846593,"threads_started":1}
W20260619 18:45:39.358718 12058 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.339525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35600 (local address 127.6.120.254:36501)
0619 18:45:33.476980 (+137455us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:33.477021 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:36.937915 (+3460894us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35600: received 0 of 7 requested bytes
Metrics: {"server-negotiator.queue_time_us":136825,"thread_start_us":2423432,"threads_started":1}
W20260619 18:45:39.369830 12194 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.466306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35606)
0619 18:45:33.507704 (+ 41398us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:33.507755 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:33.508866 (+ 1111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:37.013495 (+3504629us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":40810,"mutex_wait_us":40350}
W20260619 18:45:39.394832 12419 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.196264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35564)
0619 18:45:38.996490 (+5800226us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.053159 (+ 56669us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":5366142,"thread_start_us":2489625,"threads_started":1}
W20260619 18:45:39.370215 12185 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.479109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35624)
0619 18:45:33.618713 (+139604us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:33.618779 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:33.619094 (+ 315us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:36.937265 (+3318171us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":124563,"mutex_wait_us":27484}
W20260619 18:45:39.370437 12459 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.614459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35710)
0619 18:45:37.849275 (+4234816us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:37.849559 (+ 284us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":4228432,"thread_start_us":3049455,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: Timeout exceeded waiting to connect
W20260619 18:45:39.397658 12464 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.717346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35752)
0619 18:45:36.685560 (+2968214us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:36.706112 (+ 20552us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:36.813222 (+107110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:36.939681 (+126459us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":2735241,"thread_start_us":2382119,"threads_started":1}
W20260619 18:45:39.410394 12483 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.451931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35772)
0619 18:45:38.050024 (+1598093us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:38.073000 (+ 22976us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:38.238802 (+165802us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.384754 (+1145952us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1397803,"thread_start_us":2533207,"threads_started":1}
W20260619 18:45:39.406973 12431 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.327428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35594)
0619 18:45:37.642122 (+4314694us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:37.778597 (+136475us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":4033257,"thread_start_us":3266686,"threads_started":1}
W20260619 18:45:39.408180 12455 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.554002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35708)
0619 18:45:36.669302 (+3115300us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:36.716591 (+ 47289us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":3045969,"thread_start_us":3067466,"threads_started":1}
W20260619 18:45:39.415349 12405 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.037823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35548)
0619 18:45:37.863258 (+4825435us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:37.863611 (+ 353us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":4719390,"thread_start_us":2067397,"threads_started":1}
W20260619 18:45:39.402034 10949 thread.cc:602] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.516s user 0.011s sys 0.021s
W20260619 18:45:39.470528 12208 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 477806us
W20260619 18:45:39.458822 12432 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.359333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35600)
0619 18:45:37.686209 (+4326876us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:37.686547 (+ 338us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":4083920,"thread_start_us":3175946,"threads_started":1}
W20260619 18:45:39.471601 12502 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.416311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35734 (local address 127.6.120.254:36501)
0619 18:45:39.470370 (+ 54059us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.470416 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.470783 (+ 367us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35734: BlockingRecv error: recv got EOF from 127.0.0.1:35734 (error 108)
Metrics: {"mutex_wait_us":41213,"server-negotiator.queue_time_us":44850}
W20260619 18:45:39.504981 12480 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.345048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33764 (local address 127.6.120.193:37901)
0619 18:45:37.838224 (+1493176us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:37.838270 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.325235 (+1486965us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:33764: received 0 of 7 requested bytes
Metrics: {"server-negotiator.queue_time_us":1360955,"thread_start_us":1957060,"threads_started":1}
W20260619 18:45:39.499315 12467 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.794023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33724 (local address 127.6.120.193:37901)
0619 18:45:35.047611 (+1253588us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:35.049864 (+ 2253us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:36.804697 (+1754833us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:33724: received 0 of 7 requested bytes
Metrics: {"server-negotiator.queue_time_us":964061,"thread_start_us":90497,"threads_started":1}
W20260619 18:45:39.509124 12441 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.527404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35636)
0619 18:45:39.481878 (+5954474us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.482197 (+ 319us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":5925604,"thread_start_us":2297528,"threads_started":1}
W20260619 18:45:39.472131 12241 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 49592.1us
W20260619 18:45:39.509807 12406 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:32.936589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35544)
0619 18:45:35.695325 (+2758736us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:35.695423 (+ 98us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:35.695860 (+ 437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:35.741401 (+ 45541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:35.741444 (+ 43us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:35.741641 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:35.757577 (+ 15936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:35.757807 (+ 230us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:35.816551 (+ 58744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:35.846259 (+ 29708us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:36.711066 (+864807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:36.711161 (+ 95us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:36.717635 (+ 6474us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":2732871,"thread_start_us":2082700,"threads_started":1}
W20260619 18:45:39.531778 12492 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.438047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35770)
0619 18:45:37.857344 (+1419297us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:37.857409 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:37.857769 (+ 360us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.270902 (+1413133us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1394725,"thread_start_us":2445540,"threads_started":1}
W20260619 18:45:39.512003 12081 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.386264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35662 (local address 127.6.120.254:36501)
0619 18:45:39.329820 (+943556us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.339166 (+ 9346us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.388967 (+ 49801us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35662: BlockingRecv error: recv got EOF from 127.0.0.1:35662 (error 108)
Metrics: {"server-negotiator.queue_time_us":758817,"thread_start_us":651831,"threads_started":1}
W20260619 18:45:39.516942 12450 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.543717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35702)
0619 18:45:36.935758 (+3392041us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:36.936235 (+ 477us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":3230064,"thread_start_us":3071708,"threads_started":1}
W20260619 18:45:39.479961 12200 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 46077.3us
W20260619 18:45:39.497325 12220 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 44144.6us
W20260619 18:45:39.509493 12235 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 47978us
W20260619 18:45:39.573907 12410 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.097213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35586)
0619 18:45:35.961138 (+2863925us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:35.961219 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:35.986108 (+ 24889us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:36.026738 (+ 40630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:36.026786 (+ 48us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:36.026991 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:36.040608 (+ 13617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:36.040702 (+ 94us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:36.043858 (+ 3156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:36.043905 (+ 47us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:36.046899 (+ 2994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:36.046977 (+ 78us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:36.101034 (+ 54057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:36.161112 (+ 60078us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:36.528646 (+367534us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:36.678454 (+149808us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:36.681083 (+ 2629us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:36.685253 (+ 4170us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:36.778947 (+ 93694us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:37.765651 (+986704us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":2748713,"mutex_wait_us":7003,"thread_start_us":2022206,"threads_started":1}
W20260619 18:45:39.591481 12468 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.642938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33740 (local address 127.6.120.193:37901)
0619 18:45:39.437672 (+794734us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.451490 (+ 13818us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.481095 (+ 29605us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33740: BlockingRecv error: recv got EOF from 127.0.0.1:33740 (error 108)
Metrics: {"mutex_wait_us":18233,"server-negotiator.queue_time_us":674122}
W20260619 18:45:39.542094 12193 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 50766.4us
W20260619 18:45:39.610466 12444 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.532437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35648)
0619 18:45:39.501662 (+5969225us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.501900 (+ 238us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":5968654,"thread_start_us":3024236,"threads_started":1}
W20260619 18:45:39.613075 12500 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.872s user 0.005s sys 0.009s
W20260619 18:45:39.612466 12091 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.364153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35726 (local address 127.6.120.254:36501)
0619 18:45:39.468886 (+104733us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.472833 (+ 3947us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.507525 (+ 34692us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35726: BlockingRecv error: recv got EOF from 127.0.0.1:35726 (error 108)
Metrics: {"server-negotiator.queue_time_us":4075}
W20260619 18:45:39.621295 12087 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.326053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35648 (local address 127.6.120.254:36501)
0619 18:45:39.318205 (+992152us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.320125 (+ 1920us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.521177 (+201052us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35648: BlockingRecv error: recv got EOF from 127.0.0.1:35648 (error 108)
Metrics: {"server-negotiator.queue_time_us":780180}
W20260619 18:45:39.622009 12500 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.984s user 0.006s sys 0.009s
W20260619 18:45:39.631399 12486 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:35.833150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:33740)
0619 18:45:39.450517 (+3617367us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.454296 (+ 3779us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":3528224,"thread_start_us":2973905,"threads_started":1}
W20260619 18:45:39.642561 12484 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:35.961537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:33750)
0619 18:45:39.516166 (+3554629us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.516468 (+ 302us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":3396176,"thread_start_us":2590336,"threads_started":1}
W20260619 18:45:39.635221 12216 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.557s user 0.001s sys 0.014s
W20260619 18:45:39.669255 12493 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.519078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:33764)
0619 18:45:39.453717 (+2934639us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.472216 (+ 18499us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":2722658,"thread_start_us":2397781,"threads_started":1}
W20260619 18:45:39.665231 12216 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.673s user 0.001s sys 0.016s
I20260619 18:45:39.650955 12088 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
I20260619 18:45:39.665343 12033 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:39.688051 12088 scanner-internal.cc:458] Time spent opening tablet: real 6.792s user 0.013s sys 0.016s
I20260619 18:45:39.673534 12028 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:39.695266 12413 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.550680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35786 (local address 127.6.120.254:36501)
0619 18:45:36.974390 (+423710us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:36.974428 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.620361 (+2645933us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35786: BlockingRecv error: recv got EOF from 127.0.0.1:35786 (error 108)
Metrics: {"server-negotiator.queue_time_us":335587,"thread_start_us":1886343,"threads_started":1}
W20260619 18:45:39.705519 12028 scanner-internal.cc:458] Time spent opening tablet: real 6.807s user 0.026s sys 0.035s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: Timeout exceeded waiting to connect
W20260619 18:45:39.699154 12033 scanner-internal.cc:458] Time spent opening tablet: real 6.860s user 0.027s sys 0.067s
W20260619 18:45:39.713254 12506 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.550148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33768 (local address 127.6.120.193:37901)
0619 18:45:37.863726 (+1313578us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:37.863766 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:37.866554 (+ 2788us) server_negotiation.cc:407] Connection header received
0619 18:45:37.964008 (+ 97454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:37.970734 (+ 6726us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:38.098416 (+127682us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:38.142685 (+ 44269us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:38.993281 (+850596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:39.204260 (+210979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:39.604271 (+400011us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:33768: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":149,"server-negotiator.queue_time_us":1312996,"thread_start_us":2000063,"threads_started":1}
W20260619 18:45:39.708407 12081 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.572362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35702 (local address 127.6.120.254:36501)
0619 18:45:39.631619 (+ 59257us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.633915 (+ 2296us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.649835 (+ 15920us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35702: BlockingRecv error: recv got EOF from 127.0.0.1:35702 (error 108)
Metrics: {"server-negotiator.queue_time_us":479}
W20260619 18:45:39.714691 12485 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.530761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35786)
0619 18:45:39.594432 (+3063671us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.620424 (+ 25992us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":2892921,"thread_start_us":2484311,"threads_started":1}
W20260619 18:45:39.735399 12516 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.580614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35762 (local address 127.6.120.254:36501)
0619 18:45:39.660191 (+ 79577us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.663281 (+ 3090us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.684181 (+ 20900us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35762: BlockingRecv error: recv got EOF from 127.0.0.1:35762 (error 108)
Metrics: {"mutex_wait_us":4477,"server-negotiator.queue_time_us":8570}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: Timeout exceeded waiting to connect
W20260619 18:45:39.744802 12491 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.529393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35670 (local address 127.6.120.254:36501)
0619 18:45:39.631328 (+101935us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.633812 (+ 2484us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.667920 (+ 34108us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35670: BlockingRecv error: recv got EOF from 127.0.0.1:35670 (error 108)
Metrics: {"server-negotiator.queue_time_us":3568}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: Timeout exceeded waiting to connect
W20260619 18:45:39.746776 12501 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.787927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35800)
0619 18:45:39.693855 (+2905928us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.696579 (+ 2724us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.716605 (+ 20026us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.745421 (+ 28816us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":2830943,"thread_start_us":2244176,"threads_started":1}
W20260619 18:45:39.751505 12182 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.586815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35710 (local address 127.6.120.254:36501)
0619 18:45:39.665720 (+ 78905us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.668260 (+ 2540us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.685807 (+ 17547us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35710: BlockingRecv error: recv got EOF from 127.0.0.1:35710 (error 108)
Metrics: {"mutex_wait_us":11461,"server-negotiator.queue_time_us":26736}
W20260619 18:45:39.796761 12503 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.652118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:33768)
0619 18:45:37.857625 (+1205507us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:37.857679 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:37.865288 (+ 7609us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:38.157787 (+292499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:38.233320 (+ 75533us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:38.233408 (+ 88us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:38.971853 (+738445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:38.986758 (+ 14905us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:39.247365 (+260607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:39.255057 (+ 7692us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:39.710612 (+455555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:39.716940 (+ 6328us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:39.789387 (+ 72447us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1196373,"mutex_wait_us":69001,"thread_start_us":1855335,"threads_started":1}
W20260619 18:45:39.798700 12087 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.629581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35766 (local address 127.6.120.254:36501)
0619 18:45:39.695733 (+ 66152us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.697908 (+ 2175us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.698335 (+ 427us) server_negotiation.cc:407] Connection header received
0619 18:45:39.705213 (+ 6878us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.709533 (+ 4320us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.736981 (+ 27448us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.756422 (+ 19441us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35766: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":365,"server-negotiator.queue_time_us":7818}
W20260619 18:45:39.808470 12535 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.635451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35770 (local address 127.6.120.254:36501)
0619 18:45:39.713265 (+ 77814us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.713311 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.713360 (+ 49us) server_negotiation.cc:407] Connection header received
0619 18:45:39.713917 (+ 557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.716027 (+ 2110us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.739637 (+ 23610us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.789836 (+ 50199us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35770: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":5070,"server-negotiator.queue_time_us":65134}
I20260619 18:45:39.810118 12104 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:39.828605 12104 scanner-internal.cc:458] Time spent opening tablet: real 6.863s user 0.019s sys 0.050s
W20260619 18:45:39.829490 12187 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.614522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35756 (local address 127.6.120.254:36501)
0619 18:45:39.675560 (+ 61038us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.679431 (+ 3871us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.684699 (+ 5268us) server_negotiation.cc:407] Connection header received
0619 18:45:39.692439 (+ 7740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.695177 (+ 2738us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.714203 (+ 19026us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.740719 (+ 26516us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35756: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":7351,"server-negotiator.queue_time_us":9514}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:39.833868 12535 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.819843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35804 (local address 127.6.120.254:36501)
0619 18:45:39.829970 (+ 10127us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.830001 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.830080 (+ 79us) server_negotiation.cc:407] Connection header received
0619 18:45:39.830244 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.830281 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.830568 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.831038 (+ 470us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35804: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"server-negotiator.queue_time_us":75}
W20260619 18:45:39.834435 12182 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.746474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35800 (local address 127.6.120.254:36501)
0619 18:45:39.831011 (+ 84537us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.831047 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.831097 (+ 50us) server_negotiation.cc:407] Connection header received
0619 18:45:39.831447 (+ 350us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35800: BlockingRecv error: recv got EOF from 127.0.0.1:35800 (error 108)
Metrics: {"mutex_wait_us":37003,"server-negotiator.queue_time_us":47923}
W20260619 18:45:39.835176 12495 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.690819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35804)
0619 18:45:39.145167 (+2454348us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.162064 (+ 16897us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.207258 (+ 45194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.748843 (+541585us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":2296220,"thread_start_us":2334060,"threads_started":1}
W20260619 18:45:39.835853 12363 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.777107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33786 (local address 127.6.120.193:37901)
0619 18:45:38.990363 (+2213256us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:38.990981 (+ 618us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.598973 (+607992us) server_negotiation.cc:407] Connection header received
0619 18:45:39.638461 (+ 39488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.644063 (+ 5602us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.674117 (+ 30054us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.685688 (+ 11571us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:39.743670 (+ 57982us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:33786: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":32078,"server-negotiator.queue_time_us":1906901}
W20260619 18:45:39.890991 12070 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.496s user 0.009s sys 0.022s
W20260619 18:45:39.905033 12070 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.527s user 0.009s sys 0.022s
W20260619 18:45:40.109390 12091 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.621986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35772 (local address 127.6.120.254:36501)
0619 18:45:39.878639 (+256653us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b1800194680. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f138cce98b1 00007f138ccf6661 00007f1383e56638 00007f1383e59b11 00007f1383e59ac9 00007f1383e59a59 00007f1383e59a21 00007f1383e58d1d 00007f138d0ae204 00007f138d0ae039 00007f1383e38dc6
0619 18:45:39.883422 (+ 4783us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.884969 (+ 1547us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.886326 (+ 1357us) server_negotiation.cc:407] Connection header received
0619 18:45:39.892050 (+ 5724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.893543 (+ 1493us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.923961 (+ 30418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.023830 (+ 99869us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35772: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":152,"server-negotiator.queue_time_us":5973,"spinlock_wait_cycles":5479296,"thread_start_us":59028,"threads_started":1}
W20260619 18:45:40.132328 12488 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.443224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33772 (local address 127.6.120.193:37901)
0619 18:45:39.131389 (+688165us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.131433 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.131535 (+ 102us) server_negotiation.cc:407] Connection header received
0619 18:45:39.131761 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.131814 (+ 53us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.135396 (+ 3582us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.141791 (+ 6395us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:39.142539 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:39.483122 (+340583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:39.919947 (+436825us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33772: BlockingRecv error: recv got EOF from 127.0.0.1:33772 (error 108)
Metrics: {"mutex_wait_us":10867,"server-negotiator.queue_time_us":687588,"thread_start_us":656314,"threads_started":1}
W20260619 18:45:40.214905 12498 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.772264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:33772)
0619 18:45:38.359751 (+1587487us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:38.359821 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:38.360288 (+ 467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.136297 (+776009us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:39.136346 (+ 49us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:39.136420 (+ 74us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:39.137634 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:39.137700 (+ 66us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:39.511667 (+373967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:39.517528 (+ 5861us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:39.877440 (+359912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:39.877496 (+ 56us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:39.887326 (+ 9830us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1092545,"mutex_wait_us":127805,"thread_start_us":2229538,"threads_started":1}
I20260619 18:45:40.220055 12025 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:40.238343 12025 scanner-internal.cc:458] Time spent opening tablet: real 6.796s user 0.011s sys 0.027s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:40.466950 12465 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.574s user 0.002s sys 0.003s
W20260619 18:45:40.476364 12465 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.588s user 0.002s sys 0.003s
W20260619 18:45:40.488689 12191 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.690s user 0.000s sys 0.023s
W20260619 18:45:40.489111 12191 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.691s user 0.000s sys 0.024s
W20260619 18:45:40.497902 12369 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.882s user 0.005s sys 0.016s
W20260619 18:45:40.506929 12369 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.902s user 0.006s sys 0.016s
W20260619 18:45:40.526320 12505 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.779117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:33786)
0619 18:45:39.592188 (+2813071us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.594396 (+ 2208us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.628062 (+ 33666us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.687128 (+ 59066us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:39.689792 (+ 2664us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:39.694514 (+ 4722us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:40.218891 (+524377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.218966 (+ 75us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.519458 (+300492us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":2590028,"mutex_wait_us":704583,"thread_start_us":2075410,"threads_started":1}
I20260619 18:45:40.527040 12042 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:40.527542 12042 scanner-internal.cc:458] Time spent opening tablet: real 7.574s user 0.008s sys 0.030s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:40.538990 12507 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:37.596121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49746)
0619 18:45:38.990174 (+1394053us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:38.990828 (+ 654us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:38.998771 (+ 7943us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.453093 (+454322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:39.454805 (+ 1712us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:39.482545 (+ 27740us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:39.721384 (+238839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:39.721439 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:39.861351 (+139912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:39.862241 (+ 890us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:40.067130 (+204889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.067230 (+ 100us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.535764 (+468534us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":955316,"mutex_wait_us":117022,"thread_start_us":183115,"threads_started":1}
W20260619 18:45:40.648671 12411 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.699661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49746 (local address 127.6.120.254:36501)
0619 18:45:39.360098 (+660437us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.363553 (+ 3455us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.375595 (+ 12042us) server_negotiation.cc:407] Connection header received
0619 18:45:39.396457 (+ 20862us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.399081 (+ 2624us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.420396 (+ 21315us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.451664 (+ 31268us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:39.721733 (+270069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:39.847714 (+125981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:40.067957 (+220243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.530865 (+462908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:40.644697 (+113832us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:40.645777 (+ 1080us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49746: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"mutex_wait_us":611859,"server-negotiator.queue_time_us":447022,"thread_start_us":579375,"threads_started":1}
W20260619 18:45:40.683095 12243 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.872s user 0.028s sys 0.030s
W20260619 18:45:40.683600 12243 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.881s user 0.028s sys 0.031s
W20260619 18:45:40.838356 12513 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:37.958707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49748)
0619 18:45:39.482222 (+1523515us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.482277 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.521228 (+ 38951us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.666419 (+145191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:39.670235 (+ 3816us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:39.683876 (+ 13641us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.191790 (+507914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.191861 (+ 71us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.836676 (+644815us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 1179 requested bytes
Metrics: {"client-negotiator.queue_time_us":1390909,"mutex_wait_us":306781,"thread_start_us":952027,"threads_started":1}
W20260619 18:45:40.841147 12502 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.509948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49748 (local address 127.6.120.254:36501)
0619 18:45:39.615918 (+105970us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.617931 (+ 2013us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.619878 (+ 1947us) server_negotiation.cc:407] Connection header received
0619 18:45:39.624717 (+ 4839us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.627665 (+ 2948us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.647750 (+ 20085us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.663556 (+ 15806us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.192189 (+528633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.790916 (+598727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:40.839628 (+ 48712us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49748: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"mutex_wait_us":261572,"server-negotiator.queue_time_us":197}
W20260619 18:45:40.939337 12544 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.845268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49778 (local address 127.6.120.254:36501)
0619 18:45:39.862247 (+ 16979us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.862278 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.862338 (+ 60us) server_negotiation.cc:407] Connection header received
0619 18:45:39.862499 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.862528 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.862838 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.865127 (+ 2289us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.527294 (+662167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.917395 (+390101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:40.936803 (+ 19408us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49778: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":739723,"server-negotiator.queue_time_us":680}
W20260619 18:45:40.942979 12512 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:37.962981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49762)
0619 18:45:39.495952 (+1532971us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.499652 (+ 3700us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.549062 (+ 49410us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.631932 (+ 82870us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:39.634281 (+ 2349us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:39.650008 (+ 15727us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:39.834140 (+184132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:39.834200 (+ 60us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.854710 (+1020510us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1368122,"mutex_wait_us":113466,"thread_start_us":1201927,"threads_started":1}
W20260619 18:45:40.954587 12511 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:37.874284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38296 (local address 127.6.120.193:37901)
0619 18:45:39.297269 (+1422985us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.318096 (+ 20827us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.423126 (+105030us) server_negotiation.cc:407] Connection header received
0619 18:45:39.501174 (+ 78048us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.501213 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.501576 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.501805 (+ 229us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:39.872988 (+371183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.778160 (+905172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:40.906246 (+128086us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:38296: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":859650,"server-negotiator.queue_time_us":1140612,"thread_start_us":60554,"threads_started":1}
W20260619 18:45:40.953424 12497 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:37.799563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49762 (local address 127.6.120.254:36501)
0619 18:45:37.857519 (+ 57956us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:37.857556 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.503608 (+1646052us) server_negotiation.cc:407] Connection header received
0619 18:45:39.594506 (+ 90898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.597188 (+ 2682us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.622148 (+ 24960us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.630304 (+ 8156us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.159772 (+529468us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.335944 (+176172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.789414 (+453470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:40.825748 (+ 36334us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:49762: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":535701,"server-negotiator.queue_time_us":57424,"spinlock_wait_cycles":9446656}
W20260619 18:45:40.962359 12509 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:37.843046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49786)
0619 18:45:38.442243 (+599197us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:38.442323 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:38.556081 (+113758us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.119972 (+1563891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.131427 (+ 11455us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.158271 (+ 26844us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.688180 (+529909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.688277 (+ 97us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.917421 (+229144us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":589262,"mutex_wait_us":541636,"thread_start_us":136379,"threads_started":1}
W20260619 18:45:40.998942 12523 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.613278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49800 (local address 127.6.120.254:36501)
0619 18:45:39.697829 (+ 84551us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.698262 (+ 433us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.700733 (+ 2471us) server_negotiation.cc:407] Connection header received
0619 18:45:39.716376 (+ 15643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.717651 (+ 1275us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.748508 (+ 30857us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.750992 (+ 2484us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.275794 (+524802us) spinlock_profiling.cc:243] Waited 5.34 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.531422 (+255628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.819124 (+287702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:40.975375 (+156251us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49800: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"mutex_wait_us":375843,"server-negotiator.queue_time_us":10685,"spinlock_wait_cycles":12281728}
W20260619 18:45:41.016986 12517 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.042911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49810)
0619 18:45:39.456403 (+1413492us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.458487 (+ 2084us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.502807 (+ 44320us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.784452 (+281645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:39.786617 (+ 2165us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:39.809084 (+ 22467us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.544675 (+735591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.544737 (+ 62us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.916631 (+371894us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1224494,"mutex_wait_us":209465,"thread_start_us":806111,"threads_started":1}
W20260619 18:45:41.078693 12508 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:37.805590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49778)
0619 18:45:39.345803 (+1540213us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.353807 (+ 8004us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.397915 (+ 44108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.864303 (+466388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:39.868283 (+ 3980us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:39.868434 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.520628 (+652194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.521847 (+ 1219us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.888981 (+367134us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1290883,"mutex_wait_us":526016,"thread_start_us":200813,"threads_started":1}
W20260619 18:45:41.088033 12553 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.135090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:38304)
0619 18:45:39.873674 (+1738584us) spinlock_profiling.cc:243] Waited 8.08 ms on lock 0x7b4400023f4c. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383d68a95 00007f1383d694b2 00007f138a346511 00007f138a341e1a 00007f1383e385fe 00007f138cc63a39 00007f1383e558bb 00007f1383e53cbf 00007f1383e55e22 00007f138892cc48
0619 18:45:40.093615 (+219941us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:40.095150 (+ 1535us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:40.140762 (+ 45612us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.238643 (+ 97881us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.238674 (+ 31us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.238740 (+ 66us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:40.658172 (+419432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.658238 (+ 66us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.018612 (+360374us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1763971,"mutex_wait_us":387791,"spinlock_wait_cycles":18589568,"thread_start_us":1545529,"threads_started":1}
I20260619 18:45:41.095160 12047 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:41.097188 12047 scanner-internal.cc:458] Time spent opening tablet: real 8.176s user 0.030s sys 0.032s
W20260619 18:45:41.090297 12515 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:37.865314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49800)
0619 18:45:39.653457 (+1788143us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.661002 (+ 7545us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.684454 (+ 23452us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.754582 (+ 70128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:39.757547 (+ 2965us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:39.790368 (+ 32821us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.528989 (+738621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.529077 (+ 88us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.974842 (+445765us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 1179 requested bytes
Metrics: {"client-negotiator.queue_time_us":1647342,"mutex_wait_us":729716,"thread_start_us":1216075,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:45:41.312937 12516 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.733238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49810 (local address 127.6.120.254:36501)
0619 18:45:39.764557 (+ 31319us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.764587 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.764638 (+ 51us) server_negotiation.cc:407] Connection header received
0619 18:45:39.764770 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.764799 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.765095 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.773223 (+ 8128us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.567872 (+794649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.013957 (+446085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.131058 (+117101us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49810: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":544452,"server-negotiator.queue_time_us":17195}
W20260619 18:45:41.316846 12014 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.580998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49786 (local address 127.6.120.254:36501)
0619 18:45:39.611330 (+ 30332us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.611370 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.611417 (+ 47us) server_negotiation.cc:407] Connection header received
0619 18:45:39.611546 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.611582 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.111091 (+499509us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:40.111419 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.119556 (+ 8137us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.688685 (+569129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.089897 (+401212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.137059 (+ 47162us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49786: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":609128,"server-negotiator.queue_time_us":7814,"spinlock_wait_cycles":6247168}
W20260619 18:45:41.317533 12480 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.145773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38304 (local address 127.6.120.193:37901)
0619 18:45:39.505912 (+360139us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.505943 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.097325 (+591382us) server_negotiation.cc:407] Connection header received
0619 18:45:40.163895 (+ 66570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.168799 (+ 4904us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.212878 (+ 44079us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.220853 (+ 7975us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:40.679791 (+458938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.029938 (+350147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.141472 (+111534us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38304: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":684205,"server-negotiator.queue_time_us":359685}
W20260619 18:45:41.431453 12205 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 413701us
W20260619 18:45:41.449051 12519 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.589681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:38316)
0619 18:45:39.751656 (+1161975us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.754531 (+ 2875us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.795272 (+ 40741us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.835009 (+ 39737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:39.835057 (+ 48us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:39.835113 (+ 56us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:39.920759 (+ 85646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:39.924287 (+ 3528us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.810755 (+886468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:40.812048 (+ 1293us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:41.359900 (+547852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.360012 (+ 112us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.404127 (+ 44115us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1068824,"mutex_wait_us":466693,"thread_start_us":369033,"threads_started":1}
I20260619 18:45:41.454789 12061 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:41.458964 12061 scanner-internal.cc:458] Time spent opening tablet: real 7.164s user 0.027s sys 0.056s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:45:41.521246 12510 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:37.863308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:38296)
0619 18:45:39.417579 (+1554271us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.419780 (+ 2201us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.479096 (+ 59316us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.506525 (+ 27429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:39.509942 (+ 3417us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:39.516908 (+ 6966us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:39.870121 (+353213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:39.870173 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.787421 (+917248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:40.789356 (+ 1935us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:41.395281 (+605925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.395340 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.426439 (+ 31099us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1312098,"mutex_wait_us":611735,"thread_start_us":185475,"threads_started":1}
I20260619 18:45:41.527288 12080 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:41.531425 12080 scanner-internal.cc:458] Time spent opening tablet: real 8.582s user 0.020s sys 0.025s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:41.689532 12466 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.698472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49818 (local address 127.6.120.254:36501)
0619 18:45:39.353728 (+655256us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.353774 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.704691 (+350917us) server_negotiation.cc:407] Connection header received
0619 18:45:39.738778 (+ 34087us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.741137 (+ 2359us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.765814 (+ 24677us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.786712 (+ 20898us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.519712 (+733000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.904078 (+384366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.395070 (+490992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.619055 (+223985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.656386 (+ 37331us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:41.688042 (+ 31656us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:49818: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":684741,"server-negotiator.queue_time_us":475271}
W20260619 18:45:41.853571 12478 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.510293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38316 (local address 127.6.120.193:37901)
0619 18:45:39.604501 (+ 94208us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.606091 (+ 1590us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.760355 (+154264us) server_negotiation.cc:407] Connection header received
0619 18:45:39.818755 (+ 58400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.820397 (+ 1642us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.834340 (+ 13943us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.834528 (+ 188us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:39.959992 (+125464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.796853 (+836861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.360344 (+563491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.709890 (+349546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.802801 (+ 92911us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38316: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":975947,"server-negotiator.queue_time_us":16588}
W20260619 18:45:41.914573 12524 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.970900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49818)
0619 18:45:39.698044 (+727144us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.701151 (+ 3107us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.728873 (+ 27722us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.791323 (+ 62450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:39.791433 (+ 110us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:39.791652 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.518755 (+727103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.518823 (+ 68us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.909809 (+390986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:40.910804 (+ 995us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:41.393977 (+483173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.394051 (+ 74us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.647086 (+253035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.648210 (+ 1124us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:41.722472 (+ 74262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:41.807297 (+ 84825us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:41.807335 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:41.807403 (+ 68us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:41.807552 (+ 149us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:41.851149 (+ 43597us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":679351,"mutex_wait_us":978968,"thread_start_us":227620,"threads_started":1}
W20260619 18:45:42.006526 12521 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.943375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49824)
0619 18:45:39.706866 (+763491us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.706920 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.707226 (+ 306us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.259993 (+552767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.264427 (+ 4434us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.294324 (+ 29897us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.655009 (+360685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.655088 (+ 79us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.808611 (+153523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:40.810860 (+ 2249us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:41.401002 (+590142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.404176 (+ 3174us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.004625 (+600449us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":686599,"mutex_wait_us":670718,"thread_start_us":179612,"threads_started":1}
W20260619 18:45:42.052311 12533 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.991523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49852)
0619 18:45:39.675241 (+683718us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.675298 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.704177 (+ 28879us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.885099 (+180922us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:39.886431 (+ 1332us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:39.900415 (+ 13984us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.586097 (+685682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.586181 (+ 84us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.286217 (+700036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.291216 (+ 4999us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:41.713209 (+421993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.713274 (+ 65us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.029381 (+316107us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":677581,"mutex_wait_us":963950,"thread_start_us":684214,"threads_started":1}
W20260619 18:45:42.111866 12525 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.999200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49864)
0619 18:45:39.721507 (+722307us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.721556 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.721823 (+ 267us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.505872 (+784049us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.509384 (+ 3512us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.511002 (+ 1618us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.817528 (+306526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.817597 (+ 69us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.136885 (+319288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.136922 (+ 37us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:41.581300 (+444378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.581361 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.018365 (+437004us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":657920,"mutex_wait_us":561208,"thread_start_us":337147,"threads_started":1}
W20260619 18:45:42.146443 12536 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.720647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49846 (local address 127.6.120.254:36501)
0619 18:45:39.822073 (+101426us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.824536 (+ 2463us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.828513 (+ 3977us) server_negotiation.cc:407] Connection header received
0619 18:45:39.830329 (+ 1816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.830362 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.830611 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.830805 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.259752 (+428947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.948930 (+689178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.469460 (+520530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.059906 (+590446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.130000 (+ 70094us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49846: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1199513,"server-negotiator.queue_time_us":28590}
W20260619 18:45:42.203917 12003 scanner-internal.cc:458] Time spent opening tablet: real 9.246s user 0.012s sys 0.027s
W20260619 18:45:42.213537 12530 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.985488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49846)
0619 18:45:39.716474 (+730986us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.717807 (+ 1333us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.743627 (+ 25820us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.833447 (+ 89820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:39.834595 (+ 1148us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:39.834724 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.257627 (+422903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.259377 (+ 1750us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.950553 (+691176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:40.950588 (+ 35us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:41.468926 (+518338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.469005 (+ 79us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.068332 (+599327us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":644074,"mutex_wait_us":608290,"thread_start_us":469557,"threads_started":1}
W20260619 18:45:42.224867 12535 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.849346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49852 (local address 127.6.120.254:36501)
0619 18:45:39.873473 (+ 24127us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.873506 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.873558 (+ 52us) server_negotiation.cc:407] Connection header received
0619 18:45:39.873698 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.873721 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.877436 (+ 3715us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.877649 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.587970 (+710321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.211706 (+623736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.714828 (+503122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.095393 (+380565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.179700 (+ 84307us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49852: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":925646,"server-negotiator.queue_time_us":10410}
W20260619 18:45:42.225445 12563 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.897325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49864 (local address 127.6.120.254:36501)
0619 18:45:40.385840 (+488515us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.386839 (+ 999us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.387341 (+ 502us) server_negotiation.cc:407] Connection header received
0619 18:45:40.410399 (+ 23058us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.414264 (+ 3865us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.489844 (+ 75580us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.504541 (+ 14697us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.577541 (+ 73000us) spinlock_profiling.cc:243] Waited 6.35 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.693895 (+116354us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.740160 (+ 46265us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.820800 (+ 80640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.130587 (+309787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.586898 (+456311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.042117 (+455219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.065555 (+ 23438us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49864: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":744854,"server-negotiator.queue_time_us":311501,"spinlock_wait_cycles":58197632,"thread_start_us":83081,"threads_started":1}
W20260619 18:45:42.417366 12551 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.855168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49824 (local address 127.6.120.254:36501)
0619 18:45:40.090244 (+235076us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.137801 (+ 47557us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.157188 (+ 19387us) server_negotiation.cc:407] Connection header received
0619 18:45:40.176377 (+ 19189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.180010 (+ 3633us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.214041 (+ 34031us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.257543 (+ 43502us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.655803 (+398260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.797231 (+141428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.409061 (+611830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.979566 (+570505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.050499 (+ 70933us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:42.249700 (+199201us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49824: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"mutex_wait_us":1064111,"server-negotiator.queue_time_us":61478,"thread_start_us":27258,"threads_started":1}
W20260619 18:45:42.447759 12463 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.138810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49886)
0619 18:45:39.139839 (+ 1029us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.139898 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.140208 (+ 310us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.511752 (+1371544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.512494 (+ 742us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.519778 (+ 7284us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.665962 (+146184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.667057 (+ 1095us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.392741 (+725684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.392789 (+ 48us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.104291 (+711502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.107615 (+ 3324us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.327648 (+220033us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":448,"mutex_wait_us":763447}
W20260619 18:45:42.455286 12239 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 304775us
W20260619 18:45:42.480655 12477 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.137503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49882)
0619 18:45:39.142183 (+ 4680us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.142241 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.142493 (+ 252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.220288 (+1077795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.220325 (+ 37us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.220457 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.802421 (+581964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.804867 (+ 2446us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.169462 (+364595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.171201 (+ 1739us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.029535 (+858334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.029605 (+ 70us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.444304 (+414699us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":4092,"mutex_wait_us":1565326}
W20260619 18:45:42.552284 12471 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.498340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49960)
0619 18:45:39.608154 (+109814us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.612183 (+ 4029us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.631762 (+ 19579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.853361 (+1221599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.854316 (+ 955us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.892666 (+ 38350us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.297847 (+405181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.300676 (+ 2829us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.683355 (+382679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.683433 (+ 78us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.165153 (+481720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.168026 (+ 2873us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.519423 (+351397us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":463,"mutex_wait_us":667018}
W20260619 18:45:42.559909 12448 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.139569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49902)
0619 18:45:39.140973 (+ 1404us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.141035 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.141414 (+ 379us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.526966 (+1385552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.526996 (+ 30us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.527115 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.791693 (+264578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.794152 (+ 2459us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.424693 (+630541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.426828 (+ 2135us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.219341 (+792513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.219401 (+ 60us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.557271 (+337870us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":817,"mutex_wait_us":1028748}
W20260619 18:45:42.593092 12209 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 105379us
W20260619 18:45:42.620886 12446 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.283418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49918)
0619 18:45:39.285400 (+ 1982us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.285454 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.285759 (+ 305us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.604949 (+1319190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.605671 (+ 722us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.636496 (+ 30825us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.813078 (+176582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.815653 (+ 2575us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.364802 (+549149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.364840 (+ 38us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.108596 (+743756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.110930 (+ 2334us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.567538 (+456608us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1538,"mutex_wait_us":992813}
W20260619 18:45:42.623445 12572 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.467929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49946)
0619 18:45:40.112099 (+644170us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b4400023f4c. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383d68a95 00007f1383d694b2 00007f138a346511 00007f138a341e1a 00007f1383e385fe 00007f138cc63a39 00007f1383e558bb 00007f1383e53cbf 00007f1383e55e22 00007f138892cc48
0619 18:45:40.494337 (+382238us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:40.495399 (+ 1062us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:40.495897 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.497151 (+ 1254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.497183 (+ 32us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.497320 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.532674 (+ 35354us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b180028bb80. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f138cce98b1 00007f138ccf6661 00007f138a34282c 00007f1383e389dc 00007f138cc63a39 00007f1383e558bb 00007f1383e53cbf 00007f1383e55e22 00007f138892cc48 00007f138892d6a1 00007f138892d266
0619 18:45:40.803534 (+270860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.805540 (+ 2006us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.392958 (+587418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.393002 (+ 44us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.186920 (+793918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.190025 (+ 3105us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.545437 (+355412us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1011372,"mutex_wait_us":975647,"spinlock_wait_cycles":14292096,"thread_start_us":908419,"threads_started":1}
W20260619 18:45:42.642536 12518 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.723741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49814)
0619 18:45:39.722452 (+998711us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.722504 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.722756 (+ 252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.364889 (+642133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.364929 (+ 40us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.365076 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.806378 (+441302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.806445 (+ 67us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.352077 (+545632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.353550 (+ 1473us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.216602 (+863052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.216663 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.636544 (+419881us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":921454,"mutex_wait_us":1415177,"thread_start_us":328704,"threads_started":1}
W20260619 18:45:42.678371 12460 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.518842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49968)
0619 18:45:39.532633 (+ 13791us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.532695 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.533422 (+ 727us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.035460 (+1502038us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.035506 (+ 46us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.035682 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.525913 (+490231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.526618 (+ 705us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.029196 (+502578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.029259 (+ 63us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.515304 (+486045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.515373 (+ 69us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.599244 (+ 83871us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":10147,"mutex_wait_us":808908}
W20260619 18:45:42.689268 12532 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.403135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49944)
0619 18:45:39.611177 (+208042us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.611225 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.611467 (+ 242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.833632 (+1222165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.833673 (+ 41us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.833868 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.302500 (+468632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.304931 (+ 2431us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.822722 (+517791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.823779 (+ 1057us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.440470 (+616691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.441718 (+ 1248us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.558761 (+117043us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":204951,"mutex_wait_us":853293,"thread_start_us":99871,"threads_started":1}
W20260619 18:45:42.822353 12584 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.802735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50196)
0619 18:45:40.218904 (+416169us) spinlock_profiling.cc:243] Waited 3.4 ms on lock 0x7b4400023f4c. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383d68a95 00007f1383d694b2 00007f138a346511 00007f138a341e1a 00007f1383e385fe 00007f138cc63a39 00007f1383e558bb 00007f1383e53cbf 00007f1383e55e22 00007f138892cc48
0619 18:45:40.830457 (+611553us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:40.830543 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:40.830872 (+ 329us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:42.820715 (+1989843us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1010531,"spinlock_wait_cycles":7811328,"thread_start_us":880911,"threads_started":1}
W20260619 18:45:42.853554 12678 net_util.cc:251] Time spent resolve address for 127.6.120.193: real 0.261s user 0.000s sys 0.000s
W20260619 18:45:42.866902 12118 meta_cache.cc:1097] Time spent processing table locations response: real 0.186s user 0.001s sys 0.007s
W20260619 18:45:42.870760 12171 meta_cache.cc:1261] Time spent looking up entry by key: real 0.233s user 0.001s sys 0.009s
W20260619 18:45:42.873749 12243 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 50471.3us
W20260619 18:45:42.875584 12369 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 245133us
W20260619 18:45:42.926757 12459 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.645320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50056)
0619 18:45:39.652406 (+ 7086us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.652454 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.652765 (+ 311us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.037662 (+1384897us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.037701 (+ 39us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.037828 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.514971 (+477143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.515040 (+ 69us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.856487 (+341447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.857356 (+ 869us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.216755 (+359399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.216839 (+ 84us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.924830 (+707991us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":3009,"mutex_wait_us":842153}
W20260619 18:45:42.925865 12091 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.875025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49882 (local address 127.6.120.254:36501)
0619 18:45:40.163739 (+288714us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.168350 (+ 4611us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.173324 (+ 4974us) server_negotiation.cc:407] Connection header received
0619 18:45:40.186953 (+ 13629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.188720 (+ 1767us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.219341 (+ 30621us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:40.219563 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.219791 (+ 228us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.539020 (+319229us) spinlock_profiling.cc:243] Waited 973 us on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.642472 (+103452us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1ec6c 00007f1383e1ebd6 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.811972 (+169500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.156263 (+344291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.031394 (+875131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.489255 (+457861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.921180 (+431925us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49882: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1386738,"server-negotiator.queue_time_us":287665,"spinlock_wait_cycles":11358720,"thread_start_us":135905,"threads_started":1}
W20260619 18:45:42.944356 12197 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 66284.7us
W20260619 18:45:42.986987 12566 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.923227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50264)
0619 18:45:40.304097 (+380870us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:40.323813 (+ 19716us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:40.364760 (+ 40947us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:42.968389 (+2603629us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 34 requested bytes
Metrics: {"client-negotiator.queue_time_us":249152,"thread_start_us":118223,"threads_started":1}
W20260619 18:45:42.979532 12219 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 754675us
W20260619 18:45:43.001271 12490 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.041376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49902 (local address 127.6.120.254:36501)
0619 18:45:40.525880 (+484504us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.525924 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.525985 (+ 61us) server_negotiation.cc:407] Connection header received
0619 18:45:40.526145 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.526181 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.526516 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.526710 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.800692 (+273982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.414192 (+613500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.949731 (+1535539us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49902: BlockingRecv error: recv got EOF from 127.0.0.1:49902 (error 108)
Metrics: {"mutex_wait_us":1112627,"server-negotiator.queue_time_us":475542,"thread_start_us":323164,"threads_started":1}
W20260619 18:45:43.027807 12531 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.401650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49938)
0619 18:45:39.747638 (+345988us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.747716 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.748036 (+ 320us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.657443 (+909407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.658926 (+ 1483us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.667478 (+ 8552us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.980877 (+313399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.983225 (+ 2348us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.410194 (+426969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.411907 (+ 1713us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.103137 (+691230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.106078 (+ 2941us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.951432 (+845354us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":275045,"mutex_wait_us":1296707,"thread_start_us":208191,"threads_started":1}
W20260619 18:45:43.039677 12410 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.667682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50088)
0619 18:45:39.714411 (+ 46729us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.716565 (+ 2154us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.732390 (+ 15825us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.108606 (+1376216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.108653 (+ 47us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.108829 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.407293 (+298464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.409238 (+ 1945us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.027235 (+617997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.029332 (+ 2097us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.445319 (+415987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.448730 (+ 3411us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.980098 (+531368us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":89,"mutex_wait_us":967521}
W20260619 18:45:43.038044 12464 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.585385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50010)
0619 18:45:39.609740 (+ 24355us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.609806 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.610106 (+ 300us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.539232 (+929126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.539265 (+ 33us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.539381 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.961540 (+422159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.963669 (+ 2129us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.398082 (+434413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.398127 (+ 45us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:41.978777 (+580650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.980952 (+ 2175us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.168542 (+187590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.174658 (+ 6116us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.471997 (+297339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:42.540688 (+ 68691us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:42.540729 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:42.540819 (+ 90us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:42.541041 (+ 222us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:42.951210 (+410169us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 15 requested bytes
Metrics: {"client-negotiator.queue_time_us":4740,"mutex_wait_us":1465366}
W20260619 18:45:43.069954 12596 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.824764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49968 (local address 127.6.120.254:36501)
0619 18:45:41.033721 (+208957us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.033754 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.033804 (+ 50us) server_negotiation.cc:407] Connection header received
0619 18:45:41.033949 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.033980 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.034246 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.034461 (+ 215us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.194381 (+159920us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:41.530960 (+336579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.019179 (+488219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.999397 (+980218us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49968: BlockingRecv error: recv got EOF from 127.0.0.1:49968 (error 108)
Metrics: {"mutex_wait_us":748441,"server-negotiator.queue_time_us":208463,"spinlock_wait_cycles":2550528,"thread_start_us":233555,"threads_started":1}
W20260619 18:45:43.067873 12570 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.158252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49918 (local address 127.6.120.254:36501)
0619 18:45:40.586057 (+427805us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.586108 (+ 51us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.586181 (+ 73us) server_negotiation.cc:407] Connection header received
0619 18:45:40.586373 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.586401 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.600452 (+ 14051us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.603764 (+ 3312us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.778494 (+174730us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.828214 (+ 49720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.364492 (+536278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.120133 (+755641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.574354 (+454221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.994376 (+420022us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49918: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1237259,"server-negotiator.queue_time_us":427114,"spinlock_wait_cycles":29094656,"thread_start_us":135785,"threads_started":1}
W20260619 18:45:43.077708 12501 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.833876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50220)
0619 18:45:39.835241 (+ 1365us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.836194 (+ 953us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.840137 (+ 3943us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:42.457369 (+2617232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:42.465527 (+ 8158us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:42.468076 (+ 2549us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:42.561727 (+ 93651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.565856 (+ 4129us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.956426 (+390570us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":862,"mutex_wait_us":167273}
W20260619 18:45:43.095978 12450 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.685516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50136)
0619 18:45:39.750869 (+ 65353us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.752417 (+ 1548us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.794294 (+ 41877us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.866635 (+2072341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.867991 (+ 1356us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.876083 (+ 8092us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:42.425565 (+549482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.425629 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.997664 (+572035us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":2446,"mutex_wait_us":601998}
W20260619 18:45:43.106766 12595 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.892409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50056 (local address 127.6.120.254:36501)
0619 18:45:41.036556 (+144147us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.036600 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.036666 (+ 66us) server_negotiation.cc:407] Connection header received
0619 18:45:41.036858 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.036890 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.037188 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.037423 (+ 235us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.517815 (+480392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.846361 (+328546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.219826 (+373465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.961283 (+741457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.091416 (+130133us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50056: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1437351,"server-negotiator.queue_time_us":143502}
W20260619 18:45:43.107236 12537 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.652222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50124)
0619 18:45:39.742718 (+ 90496us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.742793 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.743144 (+ 351us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.868482 (+2125338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.869290 (+ 808us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.869421 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:42.473654 (+604233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.474371 (+ 717us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.018628 (+544257us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":89827,"mutex_wait_us":744073,"thread_start_us":48569,"threads_started":1}
W20260619 18:45:43.115267 12591 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.638300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49944 (local address 127.6.120.254:36501)
0619 18:45:40.832489 (+194189us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.832532 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.832590 (+ 58us) server_negotiation.cc:407] Connection header received
0619 18:45:40.832757 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.832793 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.833097 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.833331 (+ 234us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.332012 (+498681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.811181 (+479169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.002986 (+1191805us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49944: BlockingRecv error: recv got EOF from 127.0.0.1:49944 (error 108)
Metrics: {"mutex_wait_us":936665,"server-negotiator.queue_time_us":193507}
W20260619 18:45:43.110862 12455 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.608163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50032)
0619 18:45:39.611538 (+ 3375us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.611604 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.613722 (+ 2118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.857049 (+1243327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.859828 (+ 2779us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.892859 (+ 33031us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.388856 (+495997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.388913 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.713345 (+324432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.713397 (+ 52us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.429269 (+715872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.429332 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.042631 (+613299us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":329,"mutex_wait_us":1445860}
W20260619 18:45:43.151902 12087 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.751784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49814 (local address 127.6.120.254:36501)
0619 18:45:39.799562 (+ 47778us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.799595 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.799648 (+ 53us) server_negotiation.cc:407] Connection header received
0619 18:45:39.799844 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.799869 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.291645 (+491776us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:40.350225 (+ 58580us) spinlock_profiling.cc:243] Waited 9.34 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:40.353756 (+ 3531us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.354069 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.806749 (+452680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.343627 (+536878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.000892 (+1657265us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49814: BlockingRecv error: recv got EOF from 127.0.0.1:49814 (error 108)
Metrics: {"mutex_wait_us":1049232,"server-negotiator.queue_time_us":47338,"spinlock_wait_cycles":31826688,"thread_start_us":65949,"threads_started":1}
W20260619 18:45:43.155929 12431 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.663967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50066)
0619 18:45:39.671017 (+ 7050us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.671082 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.673138 (+ 2056us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.141713 (+1468575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.143159 (+ 1446us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.158188 (+ 15029us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.411836 (+253648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.414233 (+ 2397us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.798842 (+384609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.801725 (+ 2883us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.067830 (+266105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.095517 (+ 27687us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.998570 (+903053us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1157,"mutex_wait_us":694425}
W20260619 18:45:43.162779 12492 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.682574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50134)
0619 18:45:39.707690 (+ 25116us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.707763 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.708001 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.929501 (+2221500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.932676 (+ 3175us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.948238 (+ 15562us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:42.517427 (+569189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.518596 (+ 1169us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.996779 (+478183us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":2734,"mutex_wait_us":767129}
W20260619 18:45:43.182821 12437 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.376154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49922)
0619 18:45:39.402313 (+ 26159us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.405138 (+ 2825us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.437689 (+ 32551us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.674199 (+1236510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.674782 (+ 583us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.682241 (+ 7459us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.991821 (+309580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.995188 (+ 3367us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.363318 (+368130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.365175 (+ 1857us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.255127 (+889952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.320936 (+ 65809us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.004457 (+683521us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":3694,"mutex_wait_us":1546140}
W20260619 18:45:43.184458 12432 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.704155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50138)
0619 18:45:39.723172 (+ 19017us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.723217 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.751807 (+ 28590us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:42.072308 (+2320501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:42.072341 (+ 33us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:42.072503 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:42.522570 (+450067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.523659 (+ 1089us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.044962 (+521303us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1159,"mutex_wait_us":727835}
W20260619 18:45:43.278575 12237 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 70106.3us
W20260619 18:45:43.278659 12563 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.076966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50208 (local address 127.6.120.254:36501)
0619 18:45:42.226577 (+149611us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:42.226627 (+ 50us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:42.226682 (+ 55us) server_negotiation.cc:407] Connection header received
0619 18:45:42.226869 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:42.226904 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:42.227293 (+ 389us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:42.227485 (+ 192us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:43.087944 (+860459us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50208: BlockingRecv error: recv got EOF from 127.0.0.1:50208 (error 108)
Metrics: {"mutex_wait_us":224618,"server-negotiator.queue_time_us":149085,"spinlock_wait_cycles":28416}
W20260619 18:45:43.285713 12185 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.585262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49996)
0619 18:45:39.660852 (+ 75590us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.663651 (+ 2799us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.683303 (+ 19652us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.542951 (+859648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.543822 (+ 871us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.543983 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.028237 (+484254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.028323 (+ 86us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.425486 (+397163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.425543 (+ 57us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.165353 (+739810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.168057 (+ 2704us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.044740 (+876683us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":16353,"mutex_wait_us":1424374}
W20260619 18:45:43.278432 12207 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 81737.6us
W20260619 18:45:43.309666 12502 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.638670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49960 (local address 127.6.120.254:36501)
0619 18:45:40.842179 (+203509us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.842219 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.842300 (+ 81us) server_negotiation.cc:407] Connection header received
0619 18:45:40.842479 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.842515 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.842813 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.853061 (+ 10248us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.307938 (+454877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.682622 (+374684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.173641 (+491019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.035263 (+861622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.162597 (+127334us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49960: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1353053,"server-negotiator.queue_time_us":202942,"thread_start_us":184912,"threads_started":1}
W20260619 18:45:43.314320 12091 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.081711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50264 (local address 127.6.120.254:36501)
0619 18:45:42.964413 (+882702us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:42.964448 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:42.964505 (+ 57us) server_negotiation.cc:407] Connection header received
0619 18:45:42.964650 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:42.965592 (+ 942us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:42.967468 (+ 1876us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:42.967676 (+ 208us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:43.182646 (+214970us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50264: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"mutex_wait_us":164230,"server-negotiator.queue_time_us":868768}
W20260619 18:45:43.316303 12547 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.811388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50208)
0619 18:45:39.870397 (+ 59009us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.870444 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.870709 (+ 265us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:42.227561 (+2356852us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:42.227601 (+ 40us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:42.227731 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:42.917171 (+689440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.920583 (+ 3412us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.064589 (+144006us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":58540,"mutex_wait_us":728841,"thread_start_us":34842,"threads_started":1}
W20260619 18:45:43.330440 12577 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.300180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49938 (local address 127.6.120.254:36501)
0619 18:45:40.601950 (+301770us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.601986 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.602050 (+ 64us) server_negotiation.cc:407] Connection header received
0619 18:45:40.606701 (+ 4651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.608191 (+ 1490us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.647198 (+ 39007us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.656733 (+ 9535us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.777870 (+121137us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.991314 (+213444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.396086 (+404772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.111612 (+715526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.430023 (+318411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.430365 (+ 342us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:43.077962 (+647597us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49938: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"mutex_wait_us":1003959,"server-negotiator.queue_time_us":298863,"spinlock_wait_cycles":8947456,"thread_start_us":106746,"threads_started":1}
W20260619 18:45:43.331566 12557 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.984217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49886 (local address 127.6.120.254:36501)
0619 18:45:40.496341 (+512124us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.496378 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.496424 (+ 46us) server_negotiation.cc:407] Connection header received
0619 18:45:40.496594 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.496630 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.503683 (+ 7053us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.505848 (+ 2165us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.765743 (+259895us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.775680 (+ 9937us) spinlock_profiling.cc:243] Waited 6.37 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.813788 (+ 38108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.388068 (+574280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.112755 (+724687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.037933 (+925178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.178162 (+140229us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:49886: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1541840,"server-negotiator.queue_time_us":511623,"spinlock_wait_cycles":63000960,"thread_start_us":132813,"threads_started":1}
W20260619 18:45:43.332906 12058 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.415640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49946 (local address 127.6.120.254:36501)
0619 18:45:39.576230 (+160590us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.576268 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.495534 (+919266us) server_negotiation.cc:407] Connection header received
0619 18:45:40.496234 (+ 700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.496275 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.496604 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.496807 (+ 203us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.805897 (+309090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.390699 (+584802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.194110 (+803411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.112949 (+918839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.239039 (+126090us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:49946: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1379284,"server-negotiator.queue_time_us":47277}
W20260619 18:45:43.345383 12569 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.985103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50010 (local address 127.6.120.254:36501)
0619 18:45:40.529595 (+544492us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.529638 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.529709 (+ 71us) server_negotiation.cc:407] Connection header received
0619 18:45:40.529886 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.529921 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.530228 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.536933 (+ 6705us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.647601 (+110668us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f13888caca0 00007f138897f49c 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.765416 (+117815us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.968401 (+202985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.397617 (+429216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.988433 (+590816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.152994 (+164561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.235394 (+ 82400us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:42.541592 (+306198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 18:45:42.541654 (+ 62us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 18:45:42.541700 (+ 46us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 18:45:42.541789 (+ 89us) server_negotiation.cc:922] calling sasl_server_start()
0619 18:45:42.541952 (+ 163us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 18:45:42.542030 (+ 78us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 18:45:42.542254 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0619 18:45:43.141149 (+598895us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50010: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"mutex_wait_us":682877,"server-negotiator.queue_time_us":520522,"spinlock_wait_cycles":64024064,"thread_start_us":354624,"threads_started":1}
W20260619 18:45:43.345739 12560 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.887226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50250 (local address 127.6.120.254:36501)
0619 18:45:40.210003 (+322777us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.212748 (+ 2745us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.215150 (+ 2402us) server_negotiation.cc:407] Connection header received
0619 18:45:40.238943 (+ 23793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.238974 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.239222 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.258176 (+ 18954us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.690864 (+432688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.332296 (+641432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.167973 (+835677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.093978 (+926005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.253705 (+159727us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50250: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1701864,"server-negotiator.queue_time_us":281201,"thread_start_us":37110,"threads_started":1}
W20260619 18:45:43.352203 12490 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.110661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50196 (local address 127.6.120.254:36501)
0619 18:45:43.104410 (+993749us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.108419 (+ 4009us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.110750 (+ 2331us) server_negotiation.cc:407] Connection header received
0619 18:45:43.120436 (+ 9686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.143701 (+ 23265us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.163833 (+ 20132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.181318 (+ 17485us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50196: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"server-negotiator.queue_time_us":933267}
W20260619 18:45:43.360459 12544 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.732689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50052 (local address 127.6.120.254:36501)
0619 18:45:40.940439 (+207750us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.940480 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.940554 (+ 74us) server_negotiation.cc:407] Connection header received
0619 18:45:40.940753 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.940791 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.941125 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.941388 (+ 263us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.349257 (+407869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.868857 (+519600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.176345 (+1307488us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50052: BlockingRecv error: recv got EOF from 127.0.0.1:50052 (error 108)
Metrics: {"mutex_wait_us":833589,"server-negotiator.queue_time_us":207184}
W20260619 18:45:43.391287 12462 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.639448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50052)
0619 18:45:39.702641 (+ 63193us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.704463 (+ 1822us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.723593 (+ 19130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.941486 (+1217893us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.941528 (+ 42us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.941670 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.303151 (+361481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.308199 (+ 5048us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.877012 (+568813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.878860 (+ 1848us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:43.060395 (+1181535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.060447 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.164361 (+103914us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":2263,"mutex_wait_us":1340666}
W20260619 18:45:43.435413 12554 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.878079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50250)
0619 18:45:40.112893 (+234814us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:40.114208 (+ 1315us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:40.157859 (+ 43651us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.257494 (+ 99635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.258483 (+ 989us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.258635 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.688861 (+430226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.688944 (+ 83us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.343314 (+654370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.343352 (+ 38us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.154133 (+810781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.156270 (+ 2137us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.113108 (+956838us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":58817,"mutex_wait_us":1214986,"thread_start_us":27096,"threads_started":1}
W20260619 18:45:43.475319 12585 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.491634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50032 (local address 127.6.120.254:36501)
0619 18:45:40.785373 (+293739us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.785428 (+ 55us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.787082 (+ 1654us) server_negotiation.cc:407] Connection header received
0619 18:45:40.793295 (+ 6213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.794677 (+ 1382us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.828001 (+ 33324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.854893 (+ 26892us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.927790 (+ 72897us) spinlock_profiling.cc:243] Waited 984 us on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:41.390207 (+462417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.712725 (+322518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.429620 (+716895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.196630 (+767010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.350172 (+153542us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50032: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1187629,"server-negotiator.queue_time_us":244006,"spinlock_wait_cycles":2263808,"thread_start_us":209403,"threads_started":1}
W20260619 18:45:43.539804 12582 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.353914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50308)
0619 18:45:40.693437 (+339523us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:40.693504 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:40.693852 (+ 348us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.439509 (+2745657us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 34 requested bytes
Metrics: {"client-negotiator.queue_time_us":338800,"thread_start_us":98655,"threads_started":1}
W20260619 18:45:43.596037 12411 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.490437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49922 (local address 127.6.120.254:36501)
0619 18:45:40.649749 (+159312us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.649789 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.649855 (+ 66us) server_negotiation.cc:407] Connection header received
0619 18:45:40.650024 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.650059 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.650379 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.673678 (+ 23299us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.823465 (+149787us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.835196 (+ 11731us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b1800194920. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f138cce98b1 00007f138ccf6661 00007f1383e23f96 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1ec6c 00007f1383e1ebd6 0000000000620c99
0619 18:45:40.835718 (+ 522us) spinlock_profiling.cc:243] Waited 3.51 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1ec6c 00007f1383e1ebd6 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.999794 (+164076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.360578 (+360784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.329471 (+968893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.383688 (+1054217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.576950 (+193262us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49922: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1706750,"server-negotiator.queue_time_us":158767,"spinlock_wait_cycles":16704000,"thread_start_us":319836,"threads_started":1}
W20260619 18:45:43.599145 12590 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.306440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50292)
0619 18:45:41.038540 (+732100us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:41.038600 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:41.038957 (+ 357us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:42.968689 (+1929732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:42.968723 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:42.969862 (+ 1139us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:43.278229 (+308367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.280324 (+ 2095us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.597496 (+317172us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":731422,"mutex_wait_us":311375,"thread_start_us":346119,"threads_started":1}
W20260619 18:45:43.612649 12523 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.736422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50066 (local address 127.6.120.254:36501)
0619 18:45:41.091938 (+355516us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.095451 (+ 3513us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.098200 (+ 2749us) server_negotiation.cc:407] Connection header received
0619 18:45:41.109526 (+ 11326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.115967 (+ 6441us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.134732 (+ 18765us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.140282 (+ 5550us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.421645 (+281363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.790076 (+368431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.106126 (+316050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.254620 (+1148494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.445029 (+190409us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50066: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1722845,"server-negotiator.queue_time_us":277364,"thread_start_us":314871,"threads_started":1}
W20260619 18:45:43.631002 12444 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.673630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50126)
0619 18:45:39.705825 (+ 32195us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.705873 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.706230 (+ 357us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.806494 (+2100264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.808515 (+ 2021us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.815015 (+ 6500us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.920353 (+105338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.921640 (+ 1287us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.430578 (+508938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.430612 (+ 34us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:43.192367 (+761755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.196884 (+ 4517us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.529818 (+332934us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":5958,"mutex_wait_us":962922}
W20260619 18:45:43.631220 12413 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.744457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50134 (local address 127.6.120.254:36501)
0619 18:45:41.925115 (+180658us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.925151 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.925203 (+ 52us) server_negotiation.cc:407] Connection header received
0619 18:45:41.925337 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.925366 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.925631 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.925847 (+ 216us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:42.520320 (+594473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.268030 (+747710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.569033 (+301003us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50134: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1196214,"server-negotiator.queue_time_us":137488,"thread_start_us":304363,"threads_started":1}
W20260619 18:45:43.633356 12502 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.156095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50308 (local address 127.6.120.254:36501)
0619 18:45:43.344750 (+1188655us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.344789 (+ 39us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.344852 (+ 63us) server_negotiation.cc:407] Connection header received
0619 18:45:43.345021 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.345058 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.377831 (+ 32773us) spinlock_profiling.cc:243] Waited 6.86 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:43.388010 (+ 10179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.429442 (+ 41432us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:43.632084 (+202642us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50308: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"mutex_wait_us":166082,"server-negotiator.queue_time_us":1158163,"spinlock_wait_cycles":15792768}
W20260619 18:45:43.633458 12558 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.875128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49996 (local address 127.6.120.254:36501)
0619 18:45:40.193129 (+318001us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.489788 (+296659us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.500673 (+ 10885us) server_negotiation.cc:407] Connection header received
0619 18:45:40.510920 (+ 10247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.510956 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.535744 (+ 24788us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:40.535976 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.539974 (+ 3998us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.674679 (+134705us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.761114 (+ 86435us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.871099 (+109985us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:41.088441 (+217342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.423141 (+334700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.176574 (+753433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.563485 (+1386911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.612256 (+ 48771us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:49996: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1713958,"server-negotiator.queue_time_us":284490,"spinlock_wait_cycles":65241984,"thread_start_us":39979,"threads_started":1}
W20260619 18:45:43.648406 12573 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.175543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50276)
0619 18:45:40.492379 (+316836us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:40.492487 (+ 108us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:40.494036 (+ 1549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.831235 (+337199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.831280 (+ 45us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.831450 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.346968 (+515518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.349117 (+ 2149us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.063154 (+714037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.063189 (+ 35us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:43.237297 (+1174108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.248153 (+ 10856us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.522127 (+273974us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":315193,"mutex_wait_us":1620416,"thread_start_us":287526,"threads_started":1}
W20260619 18:45:43.693080 12441 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.674984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50102)
0619 18:45:39.738903 (+ 63919us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.740688 (+ 1785us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.773175 (+ 32487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.041471 (+1268296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.041520 (+ 49us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.041717 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.287772 (+246055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.287854 (+ 82us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.988258 (+700404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.989008 (+ 750us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:43.256875 (+1267867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.262916 (+ 6041us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.549965 (+287049us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":5249,"mutex_wait_us":1389030}
W20260619 18:45:43.696942 12551 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.079050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50220 (local address 127.6.120.254:36501)
0619 18:45:42.439126 (+360076us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:42.439159 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:42.439212 (+ 53us) server_negotiation.cc:407] Connection header received
0619 18:45:42.441909 (+ 2697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:42.442576 (+ 667us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:42.453521 (+ 10945us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:42.456324 (+ 2803us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:42.567534 (+111210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.482065 (+914531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.695323 (+213258us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50220: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1074501,"server-negotiator.queue_time_us":354784}
W20260619 18:45:43.913676 12189 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 254569us
W20260619 18:45:43.903843 12222 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 265909us
W20260619 18:45:43.952823 12612 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.052691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50088 (local address 127.6.120.254:36501)
0619 18:45:41.060679 (+ 7988us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.060737 (+ 58us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.061882 (+ 1145us) server_negotiation.cc:407] Connection header received
0619 18:45:41.062194 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.064662 (+ 2468us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.093244 (+ 28582us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.108087 (+ 14843us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.428429 (+320342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.019167 (+590738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.453195 (+434028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.380413 (+927218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.697387 (+316974us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50088: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1792801,"server-negotiator.queue_time_us":5674}
W20260619 18:45:43.970185 12224 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 761130us
W20260619 18:45:43.973647 12507 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.580963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50328)
0619 18:45:40.582343 (+ 1380us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:40.582424 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:40.582743 (+ 319us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.092944 (+2510201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.094632 (+ 1688us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.110705 (+ 16073us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:43.378186 (+267481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.379943 (+ 1757us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.696693 (+316750us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":752,"mutex_wait_us":319442}
W20260619 18:45:44.029301 12653 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.807676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50138 (local address 127.6.120.254:36501)
0619 18:45:42.070172 (+262496us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:42.070771 (+ 599us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:42.070829 (+ 58us) server_negotiation.cc:407] Connection header received
0619 18:45:42.070978 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:42.071007 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:42.071243 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:42.071446 (+ 203us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:42.544844 (+473398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.450080 (+905236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.631186 (+181106us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50138: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1350457,"server-negotiator.queue_time_us":261961,"thread_start_us":190776,"threads_started":1}
W20260619 18:45:44.037703 12549 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.837961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50234)
0619 18:45:40.128720 (+290759us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:40.131534 (+ 2814us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:40.189770 (+ 58236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.352219 (+1162449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.352915 (+ 696us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.353065 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.684465 (+331400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.684536 (+ 71us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.064020 (+379484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.064940 (+ 920us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:43.266981 (+1202041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.267045 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.835632 (+568587us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":134023,"mutex_wait_us":1520600,"thread_start_us":58442,"threads_started":1}
W20260619 18:45:44.050541 12603 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.892773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50102 (local address 127.6.120.254:36501)
0619 18:45:41.038540 (+145767us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.040163 (+ 1623us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.040242 (+ 79us) server_negotiation.cc:407] Connection header received
0619 18:45:41.040438 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.040475 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.040808 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.041232 (+ 424us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.414877 (+373645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.979459 (+564582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.691710 (+1712251us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50102: BlockingRecv error: recv got EOF from 127.0.0.1:50102 (error 108)
Metrics: {"mutex_wait_us":947021,"server-negotiator.queue_time_us":144937,"thread_start_us":420264,"threads_started":1}
W20260619 18:45:44.060853 12589 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.504786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50276 (local address 127.6.120.254:36501)
0619 18:45:40.812800 (+308014us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.818417 (+ 5617us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.819807 (+ 1390us) server_negotiation.cc:407] Connection header received
0619 18:45:40.823816 (+ 4009us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.824916 (+ 1100us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.829762 (+ 4846us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:40.830042 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.830313 (+ 271us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.916348 (+ 86035us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:41.361953 (+445605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.054764 (+692811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.691771 (+1637007us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50276: BlockingRecv error: recv got EOF from 127.0.0.1:50276 (error 108)
Metrics: {"mutex_wait_us":793181,"server-negotiator.queue_time_us":305502,"spinlock_wait_cycles":9194624,"thread_start_us":187649,"threads_started":1}
W20260619 18:45:44.072724 12583 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.335569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50320)
0619 18:45:40.691903 (+356334us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:40.691975 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:40.692350 (+ 375us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.593920 (+901570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.594736 (+ 816us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.623446 (+ 28710us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.684302 (+ 60856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.684403 (+ 101us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.040142 (+355739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.048530 (+ 8388us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:43.478002 (+1429472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.478106 (+ 104us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.938101 (+459995us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":355655,"mutex_wait_us":1623379,"thread_start_us":115349,"threads_started":1}
W20260619 18:45:44.074736 12194 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.591555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50026)
0619 18:45:39.610619 (+ 19064us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.610670 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.610889 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.655807 (+2044918us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.657536 (+ 1729us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.682342 (+ 24806us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.686785 (+ 4443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.686844 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.211249 (+524405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.212732 (+ 1483us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:43.691667 (+1478935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.712654 (+ 20987us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.048170 (+335516us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":277,"mutex_wait_us":1481501}
W20260619 18:45:44.078672 12014 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.059147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50234 (local address 127.6.120.254:36501)
0619 18:45:41.347893 (+288746us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.347926 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.347974 (+ 48us) server_negotiation.cc:407] Connection header received
0619 18:45:41.348123 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.348151 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.348384 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.349048 (+ 664us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.685422 (+336374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.049694 (+364272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.010500 (+1960806us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50234: BlockingRecv error: recv got EOF from 127.0.0.1:50234 (error 108)
Metrics: {"mutex_wait_us":603199,"server-negotiator.queue_time_us":279051,"thread_start_us":238869,"threads_started":1}
W20260619 18:45:44.057557 12425 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 700989us
W20260619 18:45:44.099273 12485 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.804090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50168)
0619 18:45:39.812302 (+ 8212us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.812352 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.812635 (+ 283us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:42.248194 (+2435559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:42.250132 (+ 1938us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:42.327440 (+ 77308us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:42.418332 (+ 90892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.418416 (+ 84us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.434807 (+ 16391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.434837 (+ 30us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:43.976333 (+1541496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.976426 (+ 93us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.094451 (+118025us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":3520,"mutex_wait_us":1546381}
W20260619 18:45:44.088537 12513 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.916947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50358)
0619 18:45:40.920913 (+ 3966us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:40.921021 (+ 108us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:40.921376 (+ 355us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.261344 (+2339968us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.261379 (+ 35us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.261509 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:43.634810 (+373301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.634865 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.999841 (+364976us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1225,"mutex_wait_us":413214}
W20260619 18:45:44.087639 12592 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.515625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50324)
0619 18:45:40.917561 (+401936us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:40.919177 (+ 1616us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:40.936295 (+ 17118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:42.960282 (+2023987us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:42.960325 (+ 43us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:42.960453 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:43.434693 (+474240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.437122 (+ 2429us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.651975 (+214853us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":343941,"mutex_wait_us":507356,"thread_start_us":176977,"threads_started":1}
W20260619 18:45:44.110601 12574 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.798020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50182)
0619 18:45:40.239208 (+441188us) spinlock_profiling.cc:243] Waited 5.03 ms on lock 0x7b4400023f4c. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383d68a95 00007f1383d694b2 00007f138a346511 00007f138a341e1a 00007f1383e385fe 00007f138cc63a39 00007f1383e558bb 00007f1383e53cbf 00007f1383e55e22 00007f138892cc48
0619 18:45:40.665643 (+426435us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:40.666930 (+ 1287us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:40.680497 (+ 13567us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.400070 (+719573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.401321 (+ 1251us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.412491 (+ 11170us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.587568 (+175077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.594574 (+ 7006us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.063528 (+468954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.063569 (+ 41us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:43.551976 (+1488407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.553969 (+ 1993us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.697904 (+143935us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":792514,"mutex_wait_us":1524818,"spinlock_wait_cycles":11579776,"thread_start_us":691058,"threads_started":1}
W20260619 18:45:44.111007 12497 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.736328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50330 (local address 127.6.120.254:36501)
0619 18:45:40.989716 (+253388us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.990540 (+ 824us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.042242 (+ 51702us) server_negotiation.cc:407] Connection header received
0619 18:45:41.042418 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.042462 (+ 44us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.042801 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.043028 (+ 227us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.449222 (+406194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.997564 (+548342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.992141 (+1994577us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50330: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":928603,"server-negotiator.queue_time_us":226121,"thread_start_us":119299,"threads_started":1}
W20260619 18:45:44.135676 12619 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.329746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50320 (local address 127.6.120.254:36501)
0619 18:45:41.583848 (+254102us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.583894 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.583942 (+ 48us) server_negotiation.cc:407] Connection header received
0619 18:45:41.584098 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.584144 (+ 46us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.584392 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.584619 (+ 227us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.693318 (+108699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.037302 (+343984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.029987 (+1992685us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50320: BlockingRecv error: recv got EOF from 127.0.0.1:50320 (error 108)
Metrics: {"mutex_wait_us":369861,"server-negotiator.queue_time_us":226013}
W20260619 18:45:44.131067 12405 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.652079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50112)
0619 18:45:39.714369 (+ 62290us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.716866 (+ 2497us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.750577 (+ 33711us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.709661 (+1959084us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.709702 (+ 41us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.709875 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.791900 (+ 82025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.795055 (+ 3155us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.437165 (+642110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.437215 (+ 50us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:43.590979 (+1153764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.600851 (+ 9872us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.992221 (+391370us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":7992,"mutex_wait_us":1349188}
W20260619 18:45:44.149426 12645 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.732718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50124 (local address 127.6.120.254:36501)
0619 18:45:41.862713 (+129995us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.862761 (+ 48us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.862821 (+ 60us) server_negotiation.cc:407] Connection header received
0619 18:45:41.863069 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.863107 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.864345 (+ 1238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.872325 (+ 7980us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:42.478950 (+606625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.637133 (+1158183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.069203 (+432070us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50124: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1561762,"server-negotiator.queue_time_us":121977}
W20260619 18:45:44.154870 12634 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.344399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50126 (local address 127.6.120.254:36501)
0619 18:45:41.775020 (+430621us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.775962 (+ 942us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.776890 (+ 928us) server_negotiation.cc:407] Connection header received
0619 18:45:41.788591 (+ 11701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.789144 (+ 553us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.799537 (+ 10393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.804862 (+ 5325us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.840013 (+ 35151us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:41.947398 (+107385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.430254 (+482856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.962014 (+1531760us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50126: BlockingRecv error: recv got EOF from 127.0.0.1:50126 (error 108)
Metrics: {"mutex_wait_us":865046,"server-negotiator.queue_time_us":346403,"spinlock_wait_cycles":5314048,"thread_start_us":282524,"threads_started":1}
W20260619 18:45:44.161089 12466 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.589090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50048 (local address 127.6.120.254:36501)
0619 18:45:41.775056 (+185966us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.776214 (+ 1158us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.777622 (+ 1408us) server_negotiation.cc:407] Connection header received
0619 18:45:41.783997 (+ 6375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.785489 (+ 1492us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.797261 (+ 11772us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.802699 (+ 5438us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.973136 (+170437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.202218 (+229082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.159296 (+1957078us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50048: BlockingRecv error: recv got EOF from 127.0.0.1:50048 (error 108)
Metrics: {"mutex_wait_us":295499,"server-negotiator.queue_time_us":110439,"spinlock_wait_cycles":1646336,"thread_start_us":133500,"threads_started":1}
W20260619 18:45:44.176812 12535 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.065086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50168 (local address 127.6.120.254:36501)
0619 18:45:42.226218 (+161132us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:42.226270 (+ 52us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:42.226342 (+ 72us) server_negotiation.cc:407] Connection header received
0619 18:45:42.226806 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:42.226865 (+ 59us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:42.233277 (+ 6412us) spinlock_profiling.cc:243] Waited 893 us on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f13888caca0 00007f138897f49c 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:42.233490 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:42.233679 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:42.429560 (+195881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.431185 (+ 1625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.173085 (+1741900us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50168: BlockingRecv error: recv got EOF from 127.0.0.1:50168 (error 108)
Metrics: {"mutex_wait_us":256434,"server-negotiator.queue_time_us":158740,"spinlock_wait_cycles":2077824}
W20260619 18:45:44.193925 12624 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.339557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50112 (local address 127.6.120.254:36501)
0619 18:45:41.708579 (+369022us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.708638 (+ 59us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.708713 (+ 75us) server_negotiation.cc:407] Connection header received
0619 18:45:41.708907 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.708944 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.709261 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.709543 (+ 282us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.816503 (+106960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.436722 (+620219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.030073 (+1593351us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50112: BlockingRecv error: recv got EOF from 127.0.0.1:50112 (error 108)
Metrics: {"mutex_wait_us":588524,"server-negotiator.queue_time_us":310068}
W20260619 18:45:44.206563 12419 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.643996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50048)
0619 18:45:39.704755 (+ 60759us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.708921 (+ 4166us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.737296 (+ 28375us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.806251 (+2068955us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.808344 (+ 2093us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.817602 (+ 9258us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.971874 (+154272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.971944 (+ 70us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.212725 (+240781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.213503 (+ 778us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:43.947394 (+1733891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.951003 (+ 3609us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.071010 (+120007us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1712,"mutex_wait_us":1434022}
W20260619 18:45:44.128471 12632 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.655142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50136 (local address 127.6.120.254:36501)
0619 18:45:41.787004 (+131862us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.787048 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.789177 (+ 2129us) server_negotiation.cc:407] Connection header received
0619 18:45:41.795216 (+ 6039us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.797003 (+ 1787us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.841817 (+ 44814us) spinlock_profiling.cc:243] Waited 8.21 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:41.858390 (+ 16573us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.862473 (+ 4083us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:42.425975 (+563502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.436234 (+1010259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.960547 (+524313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50136: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1407294,"server-negotiator.queue_time_us":45901,"spinlock_wait_cycles":18874624,"thread_start_us":126839,"threads_started":1}
W20260619 18:45:44.338750 12509 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.023941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50370)
0619 18:45:41.129386 (+105445us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:41.130262 (+ 876us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:41.139134 (+ 8872us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.801768 (+662634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.802740 (+ 972us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.811960 (+ 9220us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.860297 (+ 48337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.861181 (+ 884us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.522296 (+661115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.522332 (+ 36us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:43.691420 (+1169088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.694750 (+ 3330us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.187385 (+492635us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":37700,"mutex_wait_us":1149951}
W20260619 18:45:44.264247 12614 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.053224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50182 (local address 127.6.120.254:36501)
0619 18:45:41.367139 (+313915us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.368047 (+ 908us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.368686 (+ 639us) server_negotiation.cc:407] Connection header received
0619 18:45:41.374067 (+ 5381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.375461 (+ 1394us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.391817 (+ 16356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.398696 (+ 6879us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.618481 (+219785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.057703 (+439222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.015588 (+1957885us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50182: BlockingRecv error: recv got EOF from 127.0.0.1:50182 (error 108)
Metrics: {"mutex_wait_us":614555,"server-negotiator.queue_time_us":276484,"thread_start_us":5370,"threads_started":1}
W20260619 18:45:44.362099 12598 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.680192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50330)
0619 18:45:41.040262 (+360070us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:41.040383 (+ 121us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:41.040748 (+ 365us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.043330 (+ 2582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.043372 (+ 42us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.043542 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.446354 (+402812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.448097 (+ 1743us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.997897 (+549800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.997931 (+ 34us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:44.040719 (+2042788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.044671 (+ 3952us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.165600 (+120929us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":357169,"mutex_wait_us":2154594,"thread_start_us":375423,"threads_started":1}
W20260619 18:45:44.403893 12406 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.664480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50072)
0619 18:45:39.730355 (+ 65875us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.731556 (+ 1201us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.750395 (+ 18839us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.844091 (+2093696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.846754 (+ 2663us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.857288 (+ 10534us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.995874 (+138586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.995956 (+ 82us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.471861 (+475905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.471910 (+ 49us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:44.185269 (+1713359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.190928 (+ 5659us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.232666 (+ 41738us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":5354,"mutex_wait_us":1728601}
W20260619 18:45:44.402922 12516 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.058800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49980 (local address 127.6.120.254:36501)
0619 18:45:41.361581 (+302781us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.362315 (+ 734us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.363828 (+ 1513us) server_negotiation.cc:407] Connection header received
0619 18:45:41.368152 (+ 4324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.368754 (+ 602us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.379103 (+ 10349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.388500 (+ 9397us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.712531 (+324031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.065472 (+352941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.206673 (+2141201us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:49980: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":498532,"server-negotiator.queue_time_us":272591,"thread_start_us":256368,"threads_started":1}
W20260619 18:45:44.417434 12491 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.354971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50370 (local address 127.6.120.254:36501)
0619 18:45:41.753318 (+398347us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.771942 (+ 18624us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.775331 (+ 3389us) server_negotiation.cc:407] Connection header received
0619 18:45:41.780653 (+ 5322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.781972 (+ 1319us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.793456 (+ 11484us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.799630 (+ 6174us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.834043 (+ 34413us) spinlock_profiling.cc:243] Waited 4.97 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:41.872034 (+ 37991us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:41.993735 (+121701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.518777 (+525042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.712348 (+1193571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.358691 (+646343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.402225 (+ 43534us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50370: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1132906,"server-negotiator.queue_time_us":341333,"spinlock_wait_cycles":48491520,"thread_start_us":266375,"threads_started":1}
W20260619 18:45:44.421130 12620 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.315735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50026 (local address 127.6.120.254:36501)
0619 18:45:41.619274 (+303539us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.620058 (+ 784us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.625899 (+ 5841us) server_negotiation.cc:407] Connection header received
0619 18:45:41.636406 (+ 10507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.647352 (+ 10946us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.651468 (+ 4116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.655382 (+ 3914us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.690240 (+ 34858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.201802 (+511562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.182918 (+1981116us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50026: BlockingRecv error: recv got EOF from 127.0.0.1:50026 (error 108)
Metrics: {"mutex_wait_us":528201,"server-negotiator.queue_time_us":219728,"thread_start_us":272848,"threads_started":1}
W20260619 18:45:44.412482 12081 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.110072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50324 (local address 127.6.120.254:36501)
0619 18:45:42.957460 (+847388us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:42.957497 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:42.957548 (+ 51us) server_negotiation.cc:407] Connection header received
0619 18:45:42.957691 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:42.957726 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:42.957992 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:42.958194 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:43.441986 (+483792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.049171 (+607185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.234346 (+185175us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50324: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":770183,"server-negotiator.queue_time_us":846909}
W20260619 18:45:44.446267 12633 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.370932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50408)
0619 18:45:41.727745 (+356813us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:41.727800 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:41.728093 (+ 293us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.258136 (+1530043us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.262811 (+ 4675us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.293378 (+ 30567us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.130901 (+837523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.137541 (+ 6640us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.437856 (+300315us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":330192,"mutex_wait_us":755763,"thread_start_us":284162,"threads_started":1}
W20260619 18:45:44.469313 12182 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.104294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50292 (local address 127.6.120.254:36501)
0619 18:45:42.957817 (+853523us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:42.957879 (+ 62us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:42.957939 (+ 60us) server_negotiation.cc:407] Connection header received
0619 18:45:42.958083 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:42.958119 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:42.967489 (+ 9370us) spinlock_profiling.cc:243] Waited 4.31 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:42.967709 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:42.967912 (+ 203us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:43.294330 (+326418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.110885 (+816555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.208500 (+ 97615us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50292: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":879768,"server-negotiator.queue_time_us":851586,"spinlock_wait_cycles":9907968}
W20260619 18:45:44.536535 12613 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.140654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50382 (local address 127.6.120.254:36501)
0619 18:45:41.346176 (+205522us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.347484 (+ 1308us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.348878 (+ 1394us) server_negotiation.cc:407] Connection header received
0619 18:45:41.354531 (+ 5653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.354732 (+ 201us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.368776 (+ 14044us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.373653 (+ 4877us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.379706 (+ 6053us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:41.586131 (+206425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.924505 (+338374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.447062 (+1522557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.046941 (+599879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.143688 (+ 96747us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:44.232649 (+ 88961us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50382: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":873958,"server-negotiator.queue_time_us":199878,"spinlock_wait_cycles":4325120,"thread_start_us":169404,"threads_started":1}
W20260619 18:45:44.552707 12636 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.723861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50072 (local address 127.6.120.254:36501)
0619 18:45:41.809305 (+ 85444us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.810785 (+ 1480us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.811782 (+ 997us) server_negotiation.cc:407] Connection header received
0619 18:45:41.817613 (+ 5831us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.818861 (+ 1248us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.832311 (+ 13450us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.841780 (+ 9469us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.997220 (+155440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.470131 (+472911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.424941 (+1954810us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50072: BlockingRecv error: recv got EOF from 127.0.0.1:50072 (error 108)
Metrics: {"mutex_wait_us":603677,"server-negotiator.queue_time_us":64525,"spinlock_wait_cycles":1866112}
W20260619 18:45:44.555033 12556 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.110355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50328 (local address 127.6.120.254:36501)
0619 18:45:43.028203 (+917848us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.030277 (+ 2074us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.032223 (+ 1946us) server_negotiation.cc:407] Connection header received
0619 18:45:43.044769 (+ 12546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.047668 (+ 2899us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.064854 (+ 17186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.087513 (+ 22659us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:43.143436 (+ 55923us) spinlock_profiling.cc:243] Waited 5.26 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:43.380923 (+237487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.343161 (+962238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.424377 (+ 81216us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50328: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1141798,"server-negotiator.queue_time_us":865469,"spinlock_wait_cycles":12089216}
W20260619 18:45:44.557163 12596 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.112744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50344 (local address 127.6.120.254:36501)
0619 18:45:43.071217 (+958473us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.071253 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.072361 (+ 1108us) server_negotiation.cc:407] Connection header received
0619 18:45:43.072569 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.072611 (+ 42us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.072964 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.088099 (+ 15135us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:43.145931 (+ 57832us) spinlock_profiling.cc:243] Waited 4.98 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:43.173432 (+ 27501us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:43.198568 (+ 25136us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f13888caca0 00007f138897f49c 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:43.310534 (+111966us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.555199 (+1244665us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50344: BlockingRecv error: recv got EOF from 127.0.0.1:50344 (error 108)
Metrics: {"mutex_wait_us":310125,"server-negotiator.queue_time_us":957846,"spinlock_wait_cycles":28905088}
W20260619 18:45:44.572351 12511 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.692581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38340 (local address 127.6.120.193:37901)
0619 18:45:40.981693 (+289112us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.981728 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.336649 (+354921us) server_negotiation.cc:407] Connection header received
0619 18:45:41.342651 (+ 6002us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.343740 (+ 1089us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.347888 (+ 4148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.348049 (+ 161us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:41.597597 (+249548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.979381 (+381784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.055906 (+1076525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.609138 (+553232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.051519 (+442381us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:44.484731 (+433212us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:38340: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1737741,"server-negotiator.queue_time_us":267199,"thread_start_us":467026,"threads_started":1}
W20260619 18:45:44.580559 12546 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.748788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50398 (local address 127.6.120.254:36501)
0619 18:45:42.036878 (+288090us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:42.037978 (+ 1100us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:42.039133 (+ 1155us) server_negotiation.cc:407] Connection header received
0619 18:45:42.049577 (+ 10444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:42.050548 (+ 971us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:42.067174 (+ 16626us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:42.101575 (+ 34401us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:42.439837 (+338262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.262022 (+822185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.560378 (+1298356us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50398: BlockingRecv error: recv got EOF from 127.0.0.1:50398 (error 108)
Metrics: {"mutex_wait_us":1136433,"server-negotiator.queue_time_us":227985,"thread_start_us":262450,"threads_started":1}
W20260619 18:45:44.584012 12607 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.779652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50344)
0619 18:45:41.337402 (+557750us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:41.342210 (+ 4808us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:41.349542 (+ 7332us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.092689 (+1743147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.094750 (+ 2061us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.111934 (+ 17184us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.357971 (+1246037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.358664 (+ 693us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.475149 (+116485us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":419623,"mutex_wait_us":963900,"thread_start_us":370619,"threads_started":1}
W20260619 18:45:44.656275 12213 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 1.39444e+06us
W20260619 18:45:44.723050 12483 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.509571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49980)
0619 18:45:39.620255 (+110684us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.622922 (+ 2667us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.632466 (+ 9544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.387884 (+1755418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.387918 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.388674 (+ 756us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.712135 (+323461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.712210 (+ 75us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.081776 (+369566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.102337 (+ 20561us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:44.347132 (+2244795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.354949 (+ 7817us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.516692 (+161743us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":6219,"mutex_wait_us":2216901}
W20260619 18:45:44.728700 12515 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.155732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50398)
0619 18:45:41.193538 (+ 37806us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:41.193606 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:41.195032 (+ 1426us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:42.103183 (+908151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:42.104732 (+ 1549us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:42.115224 (+ 10492us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:42.436887 (+321663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.436948 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.262480 (+825532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.262511 (+ 31us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:44.356423 (+1093912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.356502 (+ 79us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.476285 (+119783us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1565,"mutex_wait_us":1251650}
W20260619 18:45:44.771791 12604 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.952780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50362 (local address 127.6.120.254:36501)
0619 18:45:41.054523 (+101743us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.054575 (+ 52us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.130953 (+ 76378us) server_negotiation.cc:407] Connection header received
0619 18:45:41.153075 (+ 22122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.155132 (+ 2057us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.181722 (+ 26590us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.189259 (+ 7537us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.306263 (+117004us) spinlock_profiling.cc:243] Waited 981 us on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:41.505443 (+199180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.985585 (+480142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.262456 (+1276871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.630718 (+368262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.119858 (+489140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:44.544649 (+424791us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50362: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1684751,"server-negotiator.queue_time_us":97907,"spinlock_wait_cycles":2256128}
W20260619 18:45:44.847280 12692 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.773s user 0.011s sys 0.029s
W20260619 18:45:44.847772 12692 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.798s user 0.011s sys 0.030s
W20260619 18:45:44.778872 12676 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.770s user 0.034s sys 0.095s
W20260619 18:45:44.864673 12689 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.715s user 0.013s sys 0.026s
W20260619 18:45:45.069391 12144 net_util.cc:504] Time spent look up canonical hostname for localhost 'dist-test-slave-90mn': real 0.294s user 0.001s sys 0.000s
W20260619 18:45:45.069638 12357 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.553s user 0.016s sys 0.047s
W20260619 18:45:45.072029 12357 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.555s user 0.016s sys 0.048s
W20260619 18:45:44.960345 12247 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 190251us
W20260619 18:45:45.040419 12512 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.952680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50362)
0619 18:45:41.130004 (+177324us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:41.130061 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:41.137844 (+ 7783us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.189866 (+ 52022us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.190787 (+ 921us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.193011 (+ 2224us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.474815 (+281804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.477260 (+ 2445us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.995255 (+517995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.995296 (+ 41us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:43.262130 (+1266834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.262192 (+ 62us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.635167 (+372975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.635202 (+ 35us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:44.382832 (+747630us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:44.436067 (+ 53235us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:44.436095 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:44.436171 (+ 76us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:44.436302 (+ 131us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:44.559240 (+122938us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":77996,"mutex_wait_us":2041764}
W20260619 18:45:45.079550 12676 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.072s user 0.040s sys 0.099s
W20260619 18:45:45.142282 12689 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.033s user 0.023s sys 0.033s
W20260619 18:45:45.157629 12713 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.718s user 0.023s sys 0.029s
W20260619 18:45:45.158151 12713 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.734s user 0.023s sys 0.029s
W20260619 18:45:45.160213 12687 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.654s user 0.031s sys 0.057s
W20260619 18:45:45.160717 12687 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.032s user 0.031s sys 0.058s
W20260619 18:45:45.172739 12683 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.142s user 0.020s sys 0.042s
W20260619 18:45:45.180763 12154 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.552s user 0.010s sys 0.023s
W20260619 18:45:45.181152 12694 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.646s user 0.027s sys 0.036s
W20260619 18:45:45.192390 12694 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.984s user 0.027s sys 0.037s
W20260619 18:45:45.205978 12683 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.561s user 0.020s sys 0.043s
W20260619 18:45:45.235240 12217 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 879015us
W20260619 18:45:45.220860 12227 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 405497us
W20260619 18:45:45.266260 12654 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.822089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:38346)
0619 18:45:42.204375 (+382286us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.205561 (+ 1186us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.218685 (+ 13124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:42.254925 (+ 36240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:42.274287 (+ 19362us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:42.327066 (+ 52779us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:42.957091 (+630025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.957203 (+ 112us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.480825 (+523622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.480894 (+ 69us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:44.585868 (+1104974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.585949 (+ 81us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.227645 (+641696us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":314726,"mutex_wait_us":1740911,"thread_start_us":157811,"threads_started":1}
W20260619 18:45:45.263094 12631 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.327268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50402)
0619 18:45:41.694512 (+367244us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:41.694584 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:41.694935 (+ 351us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:42.166325 (+471390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:42.168027 (+ 1702us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:42.182349 (+ 14322us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:42.576388 (+394039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.576470 (+ 82us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.560703 (+984233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.561828 (+ 1125us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:44.566860 (+1005032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.567679 (+ 819us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.246144 (+678465us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":364097,"mutex_wait_us":1764253,"thread_start_us":285386,"threads_started":1}
W20260619 18:45:45.273798 12536 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.051589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50402 (local address 127.6.120.254:36501)
0619 18:45:42.147553 (+ 95964us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:42.147599 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:42.147685 (+ 86us) server_negotiation.cc:407] Connection header received
0619 18:45:42.147863 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:42.147898 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:42.153267 (+ 5369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:42.164843 (+ 11576us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:42.228014 (+ 63171us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:42.583879 (+355865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.549287 (+965408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.270497 (+1721210us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50402: BlockingRecv error: recv got EOF from 127.0.0.1:50402 (error 108)
Metrics: {"mutex_wait_us":1200933,"server-negotiator.queue_time_us":92882,"spinlock_wait_cycles":7132160}
W20260619 18:45:45.286346 12661 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.973213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50432)
0619 18:45:42.139351 (+166138us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.139404 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.139671 (+ 267us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:42.162190 (+ 22519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:42.162241 (+ 51us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:42.162425 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:42.537087 (+374662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.545401 (+ 8314us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.343641 (+798240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.348033 (+ 4392us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:45.039182 (+1691149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.039279 (+ 97us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.277556 (+238277us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":165006,"mutex_wait_us":1989536,"thread_start_us":133746,"threads_started":1}
W20260619 18:45:45.305794 12508 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.151424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50382)
0619 18:45:41.175419 (+ 23995us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:41.175474 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:41.175751 (+ 277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.375312 (+199561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.376054 (+ 742us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.389446 (+ 13392us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.513344 (+123898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.513415 (+ 71us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.926141 (+412726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.926179 (+ 38us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:43.445741 (+1519562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.446591 (+ 850us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.071084 (+624493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.089048 (+ 17964us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:44.408827 (+319779us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:44.430827 (+ 22000us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:44.430869 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:44.430943 (+ 74us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:44.431102 (+ 159us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:45.222217 (+791115us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":2074,"mutex_wait_us":2400442}
W20260619 18:45:45.377969 12600 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.691457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:38340)
0619 18:45:41.336386 (+644929us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:41.336459 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:41.336863 (+ 404us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.349783 (+ 12920us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.349825 (+ 42us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.350335 (+ 510us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:41.586248 (+235913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.587902 (+ 1654us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.996740 (+408838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.998302 (+ 1562us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:43.045263 (+1046961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.049502 (+ 4239us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.610427 (+560925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.610493 (+ 66us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:44.385335 (+774842us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:44.587817 (+202482us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 18:45:45.307035 (+719218us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":626377,"mutex_wait_us":2438425,"thread_start_us":338983,"threads_started":1}
W20260619 18:45:45.404570 12223 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 45257.8us
I20260619 18:45:45.412739 12142 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:45.413544 12142 scanner-internal.cc:458] Time spent opening tablet: real 5.174s user 0.012s sys 0.019s
W20260619 18:45:45.412928 12659 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.913140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50428)
0619 18:45:42.319950 (+406810us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.326830 (+ 6880us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.328046 (+ 1216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.089425 (+761379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.092640 (+ 3215us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.108656 (+ 16016us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.386448 (+1277792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.387569 (+ 1121us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.288665 (+901096us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 1179 requested bytes
Metrics: {"client-negotiator.queue_time_us":312547,"mutex_wait_us":1334383,"thread_start_us":150457,"threads_started":1}
I20260619 18:45:45.371730 12136 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:45.500151 12187 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.063758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50468 (local address 127.6.120.254:36501)
0619 18:45:42.194744 (+130986us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:42.195183 (+ 439us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:42.197790 (+ 2607us) server_negotiation.cc:407] Connection header received
0619 18:45:42.200819 (+ 3029us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:42.201959 (+ 1140us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:42.212107 (+ 10148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:42.214307 (+ 2200us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:42.623464 (+409157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.960899 (+337435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.204705 (+1243806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.289120 (+1084415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.421094 (+131974us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50468: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1660006,"server-negotiator.queue_time_us":90716}
W20260619 18:45:45.500346 12652 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.929728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50432 (local address 127.6.120.254:36501)
0619 18:45:42.154592 (+224864us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:42.160869 (+ 6277us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:42.160943 (+ 74us) server_negotiation.cc:407] Connection header received
0619 18:45:42.161122 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:42.161166 (+ 44us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:42.161549 (+ 383us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:42.161837 (+ 288us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:42.553963 (+392126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.310038 (+756075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.413720 (+2103682us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50432: BlockingRecv error: recv got EOF from 127.0.0.1:50432 (error 108)
Metrics: {"mutex_wait_us":1055040,"server-negotiator.queue_time_us":199927}
W20260619 18:45:45.487262 12136 scanner-internal.cc:458] Time spent opening tablet: real 3.903s user 0.002s sys 0.010s
W20260619 18:45:45.513232 12595 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.115169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50358 (local address 127.6.120.254:36501)
0619 18:45:43.175505 (+1060336us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.179954 (+ 4449us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.181149 (+ 1195us) server_negotiation.cc:407] Connection header received
0619 18:45:43.190270 (+ 9121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.193484 (+ 3214us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.247582 (+ 54098us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.258601 (+ 11019us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:43.342567 (+ 83966us) spinlock_profiling.cc:243] Waited 5.26 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:43.698093 (+355526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.576957 (+878864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.315528 (+738571us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50358: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1829771,"server-negotiator.queue_time_us":992335,"spinlock_wait_cycles":12090112}
W20260619 18:45:45.528400 12667 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.037423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50458)
0619 18:45:42.232144 (+194721us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.232209 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.232505 (+ 296us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.473377 (+1240872us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.474398 (+ 1021us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.532227 (+ 57829us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.366484 (+834257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.370551 (+ 4067us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.414070 (+1043519us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":175615,"mutex_wait_us":688257,"thread_start_us":110567,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:45:45.551988 12091 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.137076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50442 (local address 127.6.120.254:36501)
0619 18:45:43.315271 (+1178195us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.315305 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.315362 (+ 57us) server_negotiation.cc:407] Connection header received
0619 18:45:43.315519 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.315549 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.327144 (+ 11595us) spinlock_profiling.cc:243] Waited 917 us on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:43.329138 (+ 1994us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.330258 (+ 1120us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:43.449420 (+119162us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.112072 (+662652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.408250 (+296178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.513361 (+1105111us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50442: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":925119,"server-negotiator.queue_time_us":1176511,"spinlock_wait_cycles":7529984}
W20260619 18:45:45.581045 12591 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.121340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50408 (local address 127.6.120.254:36501)
0619 18:45:43.168714 (+1047374us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.170752 (+ 2038us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.172928 (+ 2176us) server_negotiation.cc:407] Connection header received
0619 18:45:43.178953 (+ 6025us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.183120 (+ 4167us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.242019 (+ 58899us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.257203 (+ 15184us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.137907 (+880704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.271979 (+1134072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.406376 (+134397us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50408: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1421279,"server-negotiator.queue_time_us":994523}
W20260619 18:45:45.583364 12525 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.186433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50490)
0619 18:45:42.210119 (+ 23686us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.211227 (+ 1108us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.220301 (+ 9074us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.369451 (+1149150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.369494 (+ 43us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.369668 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.373027 (+1003359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.374697 (+ 1670us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.581504 (+1206807us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.120.254:36501: BlockingRecv error: recv got EOF from 127.6.120.254:36501 (error 108)
Metrics: {"client-negotiator.queue_time_us":1950,"mutex_wait_us":975294}
W20260619 18:45:45.583447 12058 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.164285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50448 (local address 127.6.120.254:36501)
0619 18:45:43.361261 (+1196976us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.361304 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.361374 (+ 70us) server_negotiation.cc:407] Connection header received
0619 18:45:43.361551 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.361587 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.361923 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.362210 (+ 287us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:43.596691 (+234481us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.293763 (+697072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.316076 (+1022313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.581214 (+265138us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50448: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1989626,"server-negotiator.queue_time_us":1182594,"spinlock_wait_cycles":2367232}
W20260619 18:45:45.579933 12563 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.134477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50454 (local address 127.6.120.254:36501)
0619 18:45:43.332216 (+1197739us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.332255 (+ 39us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.332304 (+ 49us) server_negotiation.cc:407] Connection header received
0619 18:45:43.332438 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.332463 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.332694 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.332891 (+ 197us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:43.391727 (+ 58836us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:43.440816 (+ 49089us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:43.998670 (+557854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.391693 (+1393023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.577531 (+185838us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50454: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1962457,"server-negotiator.queue_time_us":1171219,"spinlock_wait_cycles":36612224}
W20260619 18:45:45.594326 12521 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.013551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50454)
0619 18:45:42.014844 (+ 1293us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.014895 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.015212 (+ 317us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.342516 (+1327304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.346814 (+ 4298us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.356012 (+ 9198us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:43.969075 (+613063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.972669 (+ 3594us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.578156 (+1605487us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.120.254:36501: BlockingRecv error: recv got EOF from 127.6.120.254:36501 (error 108)
Metrics: {"client-negotiator.queue_time_us":871,"mutex_wait_us":601094,"thread_start_us":142104,"threads_started":1}
W20260619 18:45:45.595296 12569 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.191000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50490 (local address 127.6.120.254:36501)
0619 18:45:43.368428 (+1177428us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.368472 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.368541 (+ 69us) server_negotiation.cc:407] Connection header received
0619 18:45:43.368714 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.368751 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.369055 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.369751 (+ 696us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.383044 (+1013293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.302246 (+919202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.502076 (+199830us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50490: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1584202,"server-negotiator.queue_time_us":1176812}
W20260619 18:45:45.646361 12666 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.058125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50448)
0619 18:45:42.417719 (+359594us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.417826 (+ 107us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.418180 (+ 354us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.362296 (+944116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.362334 (+ 38us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.363872 (+ 1538us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.162153 (+798281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.162231 (+ 78us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.599646 (+1437415us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.120.254:36501: BlockingRecv error: recv got EOF from 127.6.120.254:36501 (error 108)
Metrics: {"client-negotiator.queue_time_us":358950,"mutex_wait_us":709054,"thread_start_us":285474,"threads_started":1}
W20260619 18:45:45.659559 12087 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.133409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50444 (local address 127.6.120.254:36501)
0619 18:45:43.286343 (+1152934us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.287698 (+ 1355us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.294890 (+ 7192us) server_negotiation.cc:407] Connection header received
0619 18:45:43.305375 (+ 10485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.306604 (+ 1229us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.354508 (+ 47904us) spinlock_profiling.cc:243] Waited 7.42 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:43.365066 (+ 10558us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.379694 (+ 14628us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:43.435887 (+ 56193us) spinlock_profiling.cc:243] Waited 3.51 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.274451 (+838564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.424449 (+1149998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.580094 (+155645us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50444: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1858433,"server-negotiator.queue_time_us":1043361,"spinlock_wait_cycles":25137792}
W20260619 18:45:45.675026 12480 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.825356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38346 (local address 127.6.120.193:37901)
0619 18:45:41.830537 (+ 5181us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.830568 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:42.207454 (+376886us) server_negotiation.cc:407] Connection header received
0619 18:45:42.228976 (+ 21522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:42.229008 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:42.236419 (+ 7411us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:42.254548 (+ 18129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:42.957517 (+702969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.480197 (+522680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.718691 (+1238494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.424179 (+705488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.542927 (+118748us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:38346: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1377831,"server-negotiator.queue_time_us":682}
W20260619 18:45:45.676127 12570 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.111826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50428 (local address 127.6.120.254:36501)
0619 18:45:43.074233 (+962407us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.074275 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.074341 (+ 66us) server_negotiation.cc:407] Connection header received
0619 18:45:43.074512 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.074549 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.074884 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.088142 (+ 13258us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.389073 (+1300931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.068213 (+679140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.542384 (+474171us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50428: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1138295,"server-negotiator.queue_time_us":958668}
W20260619 18:45:45.670258 12560 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.182970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50458 (local address 127.6.120.254:36501)
0619 18:45:43.434769 (+1251799us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.435567 (+ 798us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.439365 (+ 3798us) server_negotiation.cc:407] Connection header received
0619 18:45:43.443344 (+ 3979us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.444439 (+ 1095us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.456569 (+ 12130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.471505 (+ 14936us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.376442 (+904937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.584409 (+1207967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.651193 (+ 66784us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50458: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1571141,"server-negotiator.queue_time_us":1171346}
W20260619 18:45:45.686144 12670 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.197272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50478)
0619 18:45:42.434698 (+237426us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.434775 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.439953 (+ 5178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.469478 (+1029525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.471143 (+ 1665us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.523453 (+ 52310us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.413177 (+889724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.419272 (+ 6095us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.580762 (+1161490us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":223500,"mutex_wait_us":646262,"thread_start_us":171476,"threads_started":1}
W20260619 18:45:45.685711 12544 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.472206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50510 (local address 127.6.120.254:36501)
0619 18:45:43.374151 (+901945us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.374192 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.374253 (+ 61us) server_negotiation.cc:407] Connection header received
0619 18:45:43.374406 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.374442 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.374744 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.374986 (+ 242us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.557341 (+1182355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.400793 (+843452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.643621 (+242828us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50510: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1516312,"server-negotiator.queue_time_us":901383}
W20260619 18:45:45.732580 12660 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.964668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50444)
0619 18:45:42.071452 (+106784us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.071557 (+ 105us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.071918 (+ 361us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.384841 (+1312923us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.386841 (+ 2000us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.430009 (+ 43168us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.212833 (+782824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.217893 (+ 5060us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.653628 (+1435735us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":106118,"mutex_wait_us":886238,"thread_start_us":2164,"threads_started":1}
W20260619 18:45:45.744701 12557 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.344479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50492 (local address 127.6.120.254:36501)
0619 18:45:43.369688 (+1025209us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.369730 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.369798 (+ 68us) server_negotiation.cc:407] Connection header received
0619 18:45:43.369967 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.370006 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.370308 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.370536 (+ 228us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.273823 (+903287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.961344 (+687521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.580759 (+619415us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50492: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1383855,"server-negotiator.queue_time_us":1024636}
W20260619 18:45:45.763929 12490 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.448224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50494 (local address 127.6.120.254:36501)
0619 18:45:43.371832 (+923608us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.371885 (+ 53us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.371947 (+ 62us) server_negotiation.cc:407] Connection header received
0619 18:45:43.372126 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.372174 (+ 48us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.372499 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.372751 (+ 252us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:43.564153 (+191402us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:43.575058 (+ 10905us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1ec6c 00007f1383e1ebd6 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.192406 (+617348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.264885 (+1072479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.646960 (+382075us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50494: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1677184,"server-negotiator.queue_time_us":923031,"spinlock_wait_cycles":5456000}
W20260619 18:45:45.784240 12448 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.630991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50546)
0619 18:45:42.632039 (+ 1048us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.634748 (+ 2709us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.635107 (+ 359us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.002201 (+1367094us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.003062 (+ 861us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.013204 (+ 10142us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.399057 (+1385853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.403428 (+ 4371us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.742600 (+339172us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":446,"mutex_wait_us":1347708}
W20260619 18:45:45.802429 12681 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.551597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50522)
0619 18:45:42.869997 (+318400us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.870064 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.870387 (+ 323us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.920298 (+1049911us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.922150 (+ 1852us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.925184 (+ 3034us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.596562 (+671378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.596628 (+ 66us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.798373 (+1201745us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":317758,"mutex_wait_us":631291,"thread_start_us":138657,"threads_started":1}
W20260619 18:45:45.802970 12446 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.644200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50550)
0619 18:45:42.648875 (+ 4675us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.648931 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.651524 (+ 2593us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.638179 (+986655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.652826 (+ 14647us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.698596 (+ 45770us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.687189 (+988593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.687395 (+ 206us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.800752 (+1113357us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1178,"mutex_wait_us":1066857}
W20260619 18:45:45.807778 12411 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.555916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50522 (local address 127.6.120.254:36501)
0619 18:45:43.765389 (+1209473us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.795965 (+ 30576us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.826892 (+ 30927us) server_negotiation.cc:407] Connection header received
0619 18:45:43.849079 (+ 22187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.872844 (+ 23765us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.913926 (+ 41082us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.919429 (+ 5503us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.721063 (+801634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.645757 (+924694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.749283 (+103526us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50522: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1445314,"server-negotiator.queue_time_us":1055871}
W20260619 18:45:45.809648 12532 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.697421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50570)
0619 18:45:42.717108 (+ 19687us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.717177 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.717548 (+ 371us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.176066 (+1458518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.176099 (+ 33us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.176254 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.561689 (+385435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.561745 (+ 56us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.808352 (+1246607us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 1179 requested bytes
Metrics: {"client-negotiator.queue_time_us":18933,"mutex_wait_us":401805}
W20260619 18:45:45.816431 12608 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.962593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50570 (local address 127.6.120.254:36501)
0619 18:45:44.105295 (+1142702us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.107544 (+ 2249us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.111525 (+ 3981us) server_negotiation.cc:407] Connection header received
0619 18:45:44.119162 (+ 7637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.121261 (+ 2099us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.166996 (+ 45735us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.180721 (+ 13725us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.588457 (+407736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.781770 (+1193313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.810940 (+ 29170us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50570: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"mutex_wait_us":1444872,"server-negotiator.queue_time_us":1077858}
W20260619 18:45:45.818463 12460 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.688589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50562)
0619 18:45:42.867742 (+179153us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.867827 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.868213 (+ 386us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.915326 (+1047113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.915378 (+ 52us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.920267 (+ 4889us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.966139 (+1045872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.966247 (+ 108us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.760658 (+794411us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":178083,"mutex_wait_us":922728}
W20260619 18:45:45.818871 12524 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.956872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50442)
0619 18:45:41.999601 (+ 42729us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.003135 (+ 3534us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.026881 (+ 23746us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.329978 (+1303097us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.330008 (+ 30us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.330130 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.092674 (+762544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.099748 (+ 7074us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.408583 (+308835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.408617 (+ 34us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:45.568168 (+1159551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.568245 (+ 77us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.816650 (+248405us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1668,"mutex_wait_us":1989748}
W20260619 18:45:45.819003 12471 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.593089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50536)
0619 18:45:42.922122 (+329033us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.923967 (+ 1845us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.942434 (+ 18467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.633023 (+690589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.633067 (+ 44us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.633207 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.548655 (+915448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.551866 (+ 3211us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.817310 (+1265444us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":283500,"mutex_wait_us":957820}
W20260619 18:45:45.821543 12533 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.062794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50468)
0619 18:45:42.133646 (+ 70852us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.134533 (+ 887us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.141813 (+ 7280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:42.214550 (+ 72737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:42.214587 (+ 37us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:42.214708 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:42.621462 (+406754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.621534 (+ 72us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.963543 (+342009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.964327 (+ 784us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:44.192240 (+1227913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.196521 (+ 4281us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.736095 (+1539574us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.120.254:36501: BlockingRecv error: recv got EOF from 127.6.120.254:36501 (error 108)
Metrics: {"client-negotiator.queue_time_us":2036,"mutex_wait_us":1698631}
W20260619 18:45:45.822016 12502 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.645187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50550 (local address 127.6.120.254:36501)
0619 18:45:43.634359 (+989172us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.634389 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.634439 (+ 50us) server_negotiation.cc:407] Connection header received
0619 18:45:43.634565 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.634592 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.634821 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.638806 (+ 3985us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.012022 (+373216us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.689309 (+677287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.750145 (+1060836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.820292 (+ 70147us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50550: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1709762,"server-negotiator.queue_time_us":988721,"spinlock_wait_cycles":4946176}
W20260619 18:45:45.826335 12413 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.599045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50536 (local address 127.6.120.254:36501)
0619 18:45:43.632209 (+1033164us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.632240 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.632292 (+ 52us) server_negotiation.cc:407] Connection header received
0619 18:45:43.632427 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.632453 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.632702 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.632922 (+ 220us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.719332 (+1086410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.678979 (+959647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.807053 (+128074us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50536: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":976781,"server-negotiator.queue_time_us":1031476}
W20260619 18:45:45.833503 12585 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.513657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50518 (local address 127.6.120.254:36501)
0619 18:45:43.586160 (+1072503us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.591829 (+ 5669us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.594210 (+ 2381us) server_negotiation.cc:407] Connection header received
0619 18:45:43.610243 (+ 16033us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.611171 (+ 928us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.635733 (+ 24562us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.642416 (+ 6683us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:43.815975 (+173559us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.603984 (+788009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.646396 (+1042412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.810392 (+163996us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50518: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1825323,"server-negotiator.queue_time_us":1028770,"spinlock_wait_cycles":58990336}
W20260619 18:45:45.856880 12523 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.928262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50562 (local address 127.6.120.254:36501)
0619 18:45:43.914263 (+986001us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.914305 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.914385 (+ 80us) server_negotiation.cc:407] Connection header received
0619 18:45:43.914577 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.914621 (+ 44us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.914956 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.915226 (+ 270us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.027060 (+111834us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.966623 (+939563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.826864 (+860241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.852290 (+ 25426us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50562: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1184573,"server-negotiator.queue_time_us":985403,"spinlock_wait_cycles":8178432}
W20260619 18:45:45.879972 12577 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.173614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50478 (local address 127.6.120.254:36501)
0619 18:45:43.433281 (+1259667us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.434259 (+ 978us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.434811 (+ 552us) server_negotiation.cc:407] Connection header received
0619 18:45:43.439572 (+ 4761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.440623 (+ 1051us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.452129 (+ 11506us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.459883 (+ 7754us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.428407 (+968524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.645647 (+1217240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.843686 (+198039us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50478: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1824148,"server-negotiator.queue_time_us":1179930}
W20260619 18:45:45.905311 12477 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.517626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50518)
0619 18:45:42.520446 (+ 2820us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.520501 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.521927 (+ 1426us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.651426 (+1129499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.651462 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.651591 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.389265 (+737674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.389323 (+ 58us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.903374 (+1514051us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":90,"mutex_wait_us":796185}
W20260619 18:45:45.907773 12658 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.853855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50416)
0619 18:45:42.073615 (+219760us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.086189 (+ 12574us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.111180 (+ 24991us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:42.210647 (+ 99467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:42.211733 (+ 1086us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:42.221266 (+ 9533us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:42.921390 (+700124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.921455 (+ 65us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.630127 (+708672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.635504 (+ 5377us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:45.731507 (+2096003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.731602 (+ 95us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.905437 (+173835us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":219158,"mutex_wait_us":2604122,"thread_start_us":120808,"threads_started":1}
W20260619 18:45:46.120702 12684 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.868585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38348 (local address 127.6.120.193:37901)
0619 18:45:43.247876 (+379291us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.252567 (+ 4691us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.254005 (+ 1438us) server_negotiation.cc:407] Connection header received
0619 18:45:43.287379 (+ 33374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.294472 (+ 7093us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.338132 (+ 43660us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.346579 (+ 8447us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:44.528804 (+1182225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.513360 (+984556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.931719 (+418359us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:38348: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1442744,"server-negotiator.queue_time_us":244719,"thread_start_us":163306,"threads_started":1}
W20260619 18:45:46.121472 12463 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.470483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50510)
0619 18:45:42.510412 (+ 39929us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.513105 (+ 2693us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.519860 (+ 6755us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.375133 (+855273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.375180 (+ 47us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.375353 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.553693 (+1178340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.553756 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.404296 (+850540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.404360 (+ 64us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:45.838010 (+433650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.838067 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.955510 (+117443us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1779,"mutex_wait_us":1509540}
W20260619 18:45:46.215961 12648 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.858383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50416 (local address 127.6.120.254:36501)
0619 18:45:42.177488 (+319105us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:42.179547 (+ 2059us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:42.185719 (+ 6172us) server_negotiation.cc:407] Connection header received
0619 18:45:42.192068 (+ 6349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:42.193252 (+ 1184us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:42.203006 (+ 9754us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:42.207844 (+ 4838us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:42.934169 (+726325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.617461 (+683292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.937705 (+2320244us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50416: BlockingRecv error: recv got EOF from 127.0.0.1:50416 (error 108)
Metrics: {"mutex_wait_us":734410,"server-negotiator.queue_time_us":249939,"spinlock_wait_cycles":1137920}
W20260619 18:45:46.259774 12530 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.390680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50492)
0619 18:45:42.429028 (+ 38348us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.429084 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.429332 (+ 248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.370866 (+941534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.370914 (+ 48us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.371078 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.273224 (+902146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.273308 (+ 84us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.962263 (+688955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.962351 (+ 88us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:45.919275 (+956924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.920625 (+ 1350us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.251371 (+330746us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":96,"mutex_wait_us":1830012}
W20260619 18:45:46.224799 12610 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 211314us
W20260619 18:45:46.290278 12566 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.026957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50618)
0619 18:45:43.097299 (+ 70342us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.099171 (+ 1872us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.117306 (+ 18135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.726294 (+1608988us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.726346 (+ 52us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.726498 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.585045 (+858547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.585096 (+ 51us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.255856 (+670760us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":372,"mutex_wait_us":883138}
W20260619 18:45:46.291999 12551 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.945403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50578 (local address 127.6.120.254:36501)
0619 18:45:43.966339 (+1020936us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.966373 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.969009 (+ 2636us) server_negotiation.cc:407] Connection header received
0619 18:45:43.974306 (+ 5297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.975868 (+ 1562us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.998150 (+ 22282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.003410 (+ 5260us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.165603 (+162193us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.446078 (+280475us) spinlock_profiling.cc:243] Waited 6.86 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.530934 (+ 84856us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1ec6c 00007f1383e1ebd6 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.583539 (+ 52605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.493191 (+909652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.271218 (+778027us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50578: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1273557,"server-negotiator.queue_time_us":974993,"spinlock_wait_cycles":46922368}
W20260619 18:45:46.311546 12673 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.451894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50494)
0619 18:45:42.494581 (+ 42687us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.496453 (+ 1872us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.514035 (+ 17582us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.373169 (+859134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.373218 (+ 49us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.373385 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.046801 (+673416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.051489 (+ 4688us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.278394 (+1226905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.278449 (+ 55us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:45.882326 (+603877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.882382 (+ 56us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.224838 (+342456us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":26684,"mutex_wait_us":1295684,"thread_start_us":18735,"threads_started":1}
W20260619 18:45:46.315299 12455 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.254154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50698)
0619 18:45:43.348925 (+ 94771us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.350116 (+ 1191us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.359584 (+ 9468us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.493165 (+1133581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.495105 (+ 1940us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.527821 (+ 32716us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.600166 (+1072345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.600241 (+ 75us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.287903 (+687662us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":16673,"mutex_wait_us":695598}
W20260619 18:45:46.319918 12450 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.176247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50658)
0619 18:45:43.293331 (+117084us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.298113 (+ 4782us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.312658 (+ 14545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.544921 (+1232263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.546276 (+ 1355us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.560701 (+ 14425us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.645032 (+1084331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.645141 (+ 109us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.318141 (+673000us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":2033,"mutex_wait_us":1148918}
W20260619 18:45:46.332752 12634 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.163204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50640 (local address 127.6.120.254:36501)
0619 18:45:44.156082 (+992878us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.156145 (+ 63us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.156231 (+ 86us) server_negotiation.cc:407] Connection header received
0619 18:45:44.156408 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.156444 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.156744 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.156965 (+ 221us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.444880 (+287915us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.585391 (+140511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.699284 (+1113893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.331199 (+631915us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50640: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1377110,"server-negotiator.queue_time_us":990158,"spinlock_wait_cycles":38680832}
W20260619 18:45:46.343993 12589 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.071993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50626 (local address 127.6.120.254:36501)
0619 18:45:44.186716 (+1114723us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.190313 (+ 3597us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.193520 (+ 3207us) server_negotiation.cc:407] Connection header received
0619 18:45:44.202463 (+ 8943us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.204243 (+ 1780us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.233431 (+ 29188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.268441 (+ 35010us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.492152 (+1223711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.863211 (+371059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.308421 (+445210us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50626: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":717716,"server-negotiator.queue_time_us":1033658}
W20260619 18:45:46.349197 12691 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.994926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50598)
0619 18:45:43.043468 (+ 48542us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.043553 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.043944 (+ 391us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.468047 (+1424103us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.470186 (+ 2139us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.489719 (+ 19533us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.602655 (+112936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.602747 (+ 92us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.204531 (+601784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.204597 (+ 66us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:45.840090 (+635493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.840168 (+ 78us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.291682 (+451514us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":47778,"mutex_wait_us":803917,"thread_start_us":51256,"threads_started":1}
W20260619 18:45:46.359392 12014 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.031455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50604 (local address 127.6.120.254:36501)
0619 18:45:44.119951 (+1088496us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.127492 (+ 7541us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.128946 (+ 1454us) server_negotiation.cc:407] Connection header received
0619 18:45:44.140637 (+ 11691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.140678 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.424696 (+284018us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.433631 (+ 8935us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.443632 (+ 10001us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.726930 (+283298us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:45.378629 (+651699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.931201 (+552572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.307426 (+376225us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50604: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1164178,"server-negotiator.queue_time_us":1062119,"spinlock_wait_cycles":83290752}
W20260619 18:45:46.361557 12464 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.168095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50650)
0619 18:45:43.182071 (+ 13976us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.184364 (+ 2293us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.187042 (+ 2678us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.260924 (+1073882us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.273708 (+ 12784us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.273874 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.226775 (+952901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.232922 (+ 6147us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.312901 (+1079979us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":96,"mutex_wait_us":924199}
W20260619 18:45:46.363989 12699 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.164377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38354 (local address 127.6.120.193:37901)
0619 18:45:43.380679 (+216302us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.380721 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.587795 (+207074us) server_negotiation.cc:407] Connection header received
0619 18:45:43.588502 (+ 707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.588551 (+ 49us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.589047 (+ 496us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.589309 (+ 262us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:44.436268 (+846959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.306851 (+870583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.296991 (+990140us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:38354: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1695330,"server-negotiator.queue_time_us":215677,"thread_start_us":311766,"threads_started":1}
W20260619 18:45:46.399684 12653 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.968346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50588 (local address 127.6.120.254:36501)
0619 18:45:44.117083 (+1148737us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.117120 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.117191 (+ 71us) server_negotiation.cc:407] Connection header received
0619 18:45:44.117338 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.117375 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.119747 (+ 2372us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.122289 (+ 2542us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.413016 (+290727us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.593086 (+180070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.780261 (+1187175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.351192 (+570931us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50588: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1707482,"server-negotiator.queue_time_us":1081359,"spinlock_wait_cycles":4695936}
W20260619 18:45:46.420980 12466 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.170104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50674 (local address 127.6.120.254:36501)
0619 18:45:44.162635 (+992531us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.162672 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.162755 (+ 83us) server_negotiation.cc:407] Connection header received
0619 18:45:44.162916 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.162952 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.163244 (+ 292us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.166235 (+ 2991us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.216333 (+1050098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.852674 (+636341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.413793 (+561119us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50674: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1193837,"server-negotiator.queue_time_us":991490}
W20260619 18:45:46.427134 12632 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.253591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50698 (local address 127.6.120.254:36501)
0619 18:45:44.395969 (+1142378us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.397350 (+ 1381us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.398517 (+ 1167us) server_negotiation.cc:407] Connection header received
0619 18:45:44.402549 (+ 4032us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.404055 (+ 1506us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.460868 (+ 56813us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.476368 (+ 15500us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.490579 (+ 14211us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.558931 (+ 68352us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:45.601738 (+1042807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.306316 (+704578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.414544 (+108228us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50698: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1535929,"server-negotiator.queue_time_us":1101744,"spinlock_wait_cycles":14780928}
W20260619 18:45:46.459980 12612 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.958705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50582 (local address 127.6.120.254:36501)
0619 18:45:43.975716 (+1017011us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.978164 (+ 2448us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.981739 (+ 3575us) server_negotiation.cc:407] Connection header received
0619 18:45:43.991600 (+ 9861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.997544 (+ 5944us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.008867 (+ 11323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.015108 (+ 6241us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.434918 (+419810us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.540206 (+105288us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.604447 (+ 64241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.623152 (+1018705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.427040 (+803888us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50582: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1458776,"server-negotiator.queue_time_us":994929,"spinlock_wait_cycles":13472384}
W20260619 18:45:46.463464 12603 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.991884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50598 (local address 127.6.120.254:36501)
0619 18:45:44.166739 (+1174855us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.168862 (+ 2123us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.170586 (+ 1724us) server_negotiation.cc:407] Connection header received
0619 18:45:44.186308 (+ 15722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.190078 (+ 3770us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.430473 (+240395us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.438617 (+ 8144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.458748 (+ 20131us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.545506 (+ 86758us) spinlock_profiling.cc:243] Waited 8.8 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.552966 (+ 7460us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.583650 (+ 30684us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.604934 (+ 21284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.202590 (+597656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.841289 (+638699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.305373 (+464084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.390935 (+ 85562us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50598: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1077213,"server-negotiator.queue_time_us":1097971,"spinlock_wait_cycles":85231488}
W20260619 18:45:46.463714 12624 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.188952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50688 (local address 127.6.120.254:36501)
0619 18:45:44.195207 (+1006255us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.195250 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.195319 (+ 69us) server_negotiation.cc:407] Connection header received
0619 18:45:44.195482 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.195518 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.195810 (+ 292us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.196063 (+ 253us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.720797 (+524734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.677262 (+956465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.368462 (+691200us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50688: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1305881,"server-negotiator.queue_time_us":1005720}
W20260619 18:45:46.484324 12081 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.434571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50738 (local address 127.6.120.254:36501)
0619 18:45:44.496804 (+1062233us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.516880 (+ 20076us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.719501 (+202621us) server_negotiation.cc:407] Connection header received
0619 18:45:44.719810 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.719860 (+ 50us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.720511 (+ 651us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.720778 (+ 267us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.772533 (+1051755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.297333 (+524800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.465143 (+167810us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50738: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1080903,"server-negotiator.queue_time_us":997004}
W20260619 18:45:46.501252 12620 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.360285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50724 (local address 127.6.120.254:36501)
0619 18:45:44.422353 (+1062068us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.422394 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.422457 (+ 63us) server_negotiation.cc:407] Connection header received
0619 18:45:44.422607 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.422644 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.422984 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.423231 (+ 247us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.312479 (+889248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.907546 (+595067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.441881 (+534335us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50724: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":687376,"server-negotiator.queue_time_us":1061510}
W20260619 18:45:46.511837 12614 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.267181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50704 (local address 127.6.120.254:36501)
0619 18:45:44.404126 (+1136945us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.409625 (+ 5499us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.412217 (+ 2592us) server_negotiation.cc:407] Connection header received
0619 18:45:44.425182 (+ 12965us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.427193 (+ 2011us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.546523 (+119330us) spinlock_profiling.cc:243] Waited 5.36 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.554221 (+ 7698us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.564969 (+ 10748us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.579212 (+ 14243us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:45.520972 (+941760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.954393 (+433421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.506458 (+552065us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50704: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1303320,"server-negotiator.queue_time_us":1097909,"spinlock_wait_cycles":14723840}
W20260619 18:45:46.512579 11110 tablet_mm_ops.cc:140] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:1f02be074be240fa8534ef577aa46f77)
W20260619 18:45:46.522293 12558 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.880239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50546 (local address 127.6.120.254:36501)
0619 18:45:43.961256 (+1081017us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.963325 (+ 2069us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.964670 (+ 1345us) server_negotiation.cc:407] Connection header received
0619 18:45:43.967967 (+ 3297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.969130 (+ 1163us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.986620 (+ 17490us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.998643 (+ 12023us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.413361 (+1414718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.263247 (+849886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.463497 (+200250us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50546: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1122563,"server-negotiator.queue_time_us":1023754}
W20260619 18:45:46.522997 12491 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.332547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50712 (local address 127.6.120.254:36501)
0619 18:45:44.434511 (+1101964us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.435781 (+ 1270us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.438804 (+ 3023us) server_negotiation.cc:407] Connection header received
0619 18:45:44.454535 (+ 15731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.458860 (+ 4325us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.486039 (+ 27179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.495377 (+ 9338us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.567058 (+ 71681us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:45.564739 (+997681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.941648 (+376909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.516604 (+574956us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50712: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1187129,"server-negotiator.queue_time_us":1085427,"spinlock_wait_cycles":6082304}
W20260619 18:45:46.649713 12554 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.552348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50760)
0619 18:45:43.610803 (+ 58455us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.611603 (+ 800us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.615395 (+ 3792us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.586410 (+971015us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.586450 (+ 40us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.586585 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.587231 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.587296 (+ 65us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.647695 (+2060399us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.120.254:36501: BlockingRecv error: recv got EOF from 127.6.120.254:36501 (error 108)
Metrics: {"client-negotiator.queue_time_us":2217,"mutex_wait_us":92750}
W20260619 18:45:46.651787 12685 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.870226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:38348)
0619 18:45:43.184349 (+314123us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.190539 (+ 6190us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.257092 (+ 66553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.348980 (+ 91888us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.350052 (+ 1072us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.354612 (+ 4560us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:44.524879 (+1170267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.524961 (+ 82us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.523072 (+998111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.527334 (+ 4262us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.380638 (+853304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.380693 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.444715 (+ 64022us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":213728,"mutex_wait_us":1685994,"thread_start_us":157481,"threads_started":1}
W20260619 18:45:46.660902 12613 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.541972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50760 (local address 127.6.120.254:36501)
0619 18:45:44.553830 (+1011858us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.553873 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.553940 (+ 67us) server_negotiation.cc:407] Connection header received
0619 18:45:44.559419 (+ 5479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.560610 (+ 1191us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.585553 (+ 24943us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.585816 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.586043 (+ 227us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.550010 (+963967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.506543 (+956533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.549460 (+ 42917us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50760: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1812072,"server-negotiator.queue_time_us":995899,"spinlock_wait_cycles":2451840}
W20260619 18:45:46.662024 12703 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.352352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38368 (local address 127.6.120.193:37901)
0619 18:45:43.614026 (+261674us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.614067 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.616213 (+ 2146us) server_negotiation.cc:407] Connection header received
0619 18:45:43.617079 (+ 866us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.617121 (+ 42us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.617542 (+ 421us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.617760 (+ 218us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:44.583562 (+965802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.679310 (+1095748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.451922 (+772612us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:38368: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1678981,"server-negotiator.queue_time_us":221401,"thread_start_us":16621,"threads_started":1}
W20260619 18:45:46.661722 12459 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.962333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50582)
0619 18:45:43.000933 (+ 38600us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.003555 (+ 2622us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.032517 (+ 28962us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.016852 (+984335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.018769 (+ 1917us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.029836 (+ 11067us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.491311 (+461475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.493023 (+ 1712us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.642931 (+1149908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.642988 (+ 57us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.389258 (+746270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.389314 (+ 56us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.443879 (+ 54565us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1193,"mutex_wait_us":1018804}
I20260619 18:45:46.672370 12166 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:46.674300 12166 scanner-internal.cc:458] Time spent opening tablet: real 4.182s user 0.027s sys 0.011s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:46.676891 12518 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.055346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50604)
0619 18:45:43.148341 (+ 92995us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.150242 (+ 1901us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.165617 (+ 15375us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.454088 (+1288471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.458495 (+ 4407us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.482310 (+ 23815us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.377756 (+895446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.377839 (+ 83us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.932883 (+555044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.932925 (+ 42us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.660911 (+727986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.660974 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.675327 (+ 14353us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1525,"mutex_wait_us":1550629}
W20260619 18:45:46.688712 12535 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.169052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50650 (local address 127.6.120.254:36501)
0619 18:45:44.178984 (+1009932us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.179024 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.179071 (+ 47us) server_negotiation.cc:407] Connection header received
0619 18:45:44.184020 (+ 4949us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.187112 (+ 3092us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.229378 (+ 42266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.265904 (+ 36526us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.425404 (+159500us) spinlock_profiling.cc:243] Waited 40.1 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.517145 (+ 91741us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.538348 (+ 21203us) spinlock_profiling.cc:243] Waited 6.66 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f13888caca0 00007f138897f49c 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:45.411916 (+873568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.285453 (+873537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.444802 (+159349us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50650: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1765184,"server-negotiator.queue_time_us":1006315,"spinlock_wait_cycles":114259712}
W20260619 18:45:46.689041 12636 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.559760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50764 (local address 127.6.120.254:36501)
0619 18:45:44.553554 (+993794us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.553589 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.553631 (+ 42us) server_negotiation.cc:407] Connection header received
0619 18:45:44.553756 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.553782 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.554041 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.559645 (+ 5604us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.580684 (+ 21039us) spinlock_profiling.cc:243] Waited 5.3 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:45.318816 (+738132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.904184 (+585368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.641176 (+736992us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50764: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1282849,"server-negotiator.queue_time_us":993412,"spinlock_wait_cycles":12196736}
W20260619 18:45:46.710337 12410 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.097515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50636)
0619 18:45:43.175827 (+ 78312us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.178233 (+ 2406us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.188164 (+ 9931us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.662980 (+1474816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.663064 (+ 84us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.663332 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.584783 (+921451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.584844 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.693758 (+108914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.693807 (+ 49us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:45.862754 (+168947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.862850 (+ 96us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.485528 (+622678us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1018,"mutex_wait_us":1367178}
W20260619 18:45:46.760380 12516 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.365874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50730 (local address 127.6.120.254:36501)
0619 18:45:44.431219 (+1065345us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.431261 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.431327 (+ 66us) server_negotiation.cc:407] Connection header received
0619 18:45:44.435819 (+ 4492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.437562 (+ 1743us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.549423 (+111861us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.560400 (+ 10977us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.561768 (+ 1368us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.730376 (+168608us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:45.496792 (+766416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.963771 (+466979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.496326 (+532555us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50730: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1285761,"server-negotiator.queue_time_us":1063454,"spinlock_wait_cycles":5021952}
W20260619 18:45:46.761821 12696 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.352627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38362 (local address 127.6.120.193:37901)
0619 18:45:43.613700 (+261073us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.613745 (+ 45us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.990883 (+377138us) server_negotiation.cc:407] Connection header received
0619 18:45:44.013350 (+ 22467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.015841 (+ 2491us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.035446 (+ 19605us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.041406 (+ 5960us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:44.597371 (+555965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.650111 (+1052740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.479466 (+829355us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:38362: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1435261,"server-negotiator.queue_time_us":217102,"thread_start_us":199424,"threads_started":1}
W20260619 18:45:46.762212 12572 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.973688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50588)
0619 18:45:43.032449 (+ 58761us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.034449 (+ 2000us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.051651 (+ 17202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.122524 (+1070873us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.122561 (+ 37us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.122680 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.553316 (+430636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.553375 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.794218 (+1240843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.794277 (+ 59us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.659802 (+865525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.659889 (+ 87us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.760608 (+100719us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1604,"mutex_wait_us":1207098}
W20260619 18:45:46.776618 12700 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.364193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:38368)
0619 18:45:43.614484 (+250291us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.614548 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.614951 (+ 403us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.630068 (+ 15117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.635436 (+ 5368us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.637287 (+ 1851us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:44.578097 (+940810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.578907 (+ 810us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.691875 (+1112968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.691976 (+ 101us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.641102 (+949126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.641161 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.679041 (+ 37880us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":213306,"mutex_wait_us":1686992,"thread_start_us":158351,"threads_started":1}
W20260619 18:45:46.783483 12497 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.080353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50618 (local address 127.6.120.254:36501)
0619 18:45:44.145158 (+1064805us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.145202 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.145280 (+ 78us) server_negotiation.cc:407] Connection header received
0619 18:45:44.145468 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.145504 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.429488 (+283984us) spinlock_profiling.cc:243] Waited 8.32 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.544427 (+114939us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.567327 (+ 22900us) spinlock_profiling.cc:243] Waited 890 us on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f13888caca0 00007f138897f49c 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.725592 (+158265us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1ec6c 00007f1383e1ebd6 0000000000620c99 00007f13888caca0 00007f138897f49c 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.725855 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.726129 (+ 274us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.592726 (+866597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.458516 (+865790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.537179 (+ 78663us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50618: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1496244,"server-negotiator.queue_time_us":1030732,"spinlock_wait_cycles":56327936}
W20260619 18:45:46.788373 12492 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.188182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50688)
0619 18:45:43.306260 (+118078us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.308098 (+ 1838us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.325404 (+ 17306us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.196248 (+870844us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.196297 (+ 49us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.200774 (+ 4477us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.720180 (+519406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.720277 (+ 97us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.677605 (+957328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.677639 (+ 34us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.535294 (+857655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.537640 (+ 2346us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.715844 (+178204us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1128,"mutex_wait_us":1356085}
I20260619 18:45:46.788672 12124 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:46.822575 12556 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.630851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50768 (local address 127.6.120.254:36501)
0619 18:45:44.556219 (+925368us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.556255 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.556323 (+ 68us) server_negotiation.cc:407] Connection header received
0619 18:45:44.556484 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.556519 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.556838 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.557119 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.312795 (+755676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.751523 (+438728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.703607 (+952084us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50768: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1139799,"server-negotiator.queue_time_us":924787}
W20260619 18:45:46.825966 12182 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.448759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50750 (local address 127.6.120.254:36501)
0619 18:45:44.474315 (+1025556us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.474358 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.474428 (+ 70us) server_negotiation.cc:407] Connection header received
0619 18:45:44.474604 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.474641 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.652033 (+177392us) spinlock_profiling.cc:243] Waited 8.01 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.652610 (+ 577us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.652961 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.599622 (+946661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.270899 (+671277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.688214 (+417315us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50750: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1490150,"server-negotiator.queue_time_us":1025012,"spinlock_wait_cycles":18426624}
W20260619 18:45:46.828635 12462 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.447064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50750)
0619 18:45:43.550879 (+103815us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.552445 (+ 1566us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.565469 (+ 13024us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.730060 (+1164591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.730109 (+ 49us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.730240 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.586977 (+856737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.590838 (+ 3861us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.274038 (+683200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.274092 (+ 54us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.761305 (+487213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.761365 (+ 60us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.826880 (+ 65515us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":563,"mutex_wait_us":1258367}
W20260619 18:45:46.821650 12124 scanner-internal.cc:458] Time spent opening tablet: real 4.197s user 0.016s sys 0.016s
W20260619 18:45:46.832617 12711 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.609298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38384 (local address 127.6.120.193:37901)
0619 18:45:44.008505 (+399207us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.009825 (+ 1320us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.011013 (+ 1188us) server_negotiation.cc:407] Connection header received
0619 18:45:44.020256 (+ 9243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.023413 (+ 3157us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.383011 (+359598us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b4800081e18. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f138cd02aa0 00007f138cceb061 00007f1388974dbb 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.398361 (+ 15350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.403949 (+ 5588us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:44.596417 (+192468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.635464 (+1039047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.735705 (+1100241us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:38384: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1123937,"server-negotiator.queue_time_us":347954,"spinlock_wait_cycles":3221888,"thread_start_us":316674,"threads_started":1}
W20260619 18:45:46.836130 12710 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.609317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:38384)
0619 18:45:43.993326 (+384009us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.996261 (+ 2935us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:44.009587 (+ 13326us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.407655 (+398068us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.407704 (+ 49us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.407764 (+ 60us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:44.595723 (+187959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.595813 (+ 90us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.645347 (+1049534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.645403 (+ 56us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.791857 (+1146454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.791922 (+ 65us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.831765 (+ 39843us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":317654,"mutex_wait_us":931478,"thread_start_us":225095,"threads_started":1}
W20260619 18:45:46.842442 12584 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.924869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50578)
0619 18:45:42.925693 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.925751 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.932737 (+ 6986us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.007454 (+1074717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.009455 (+ 2001us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.021200 (+ 11745us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.573709 (+552509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.573789 (+ 80us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.494465 (+920676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.494547 (+ 82us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.656083 (+1161536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.657207 (+ 1124us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.756723 (+ 99516us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":380,"mutex_wait_us":1548353}
W20260619 18:45:46.842765 12645 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.164551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50658 (local address 127.6.120.254:36501)
0619 18:45:44.150657 (+986106us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.150699 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.150766 (+ 67us) server_negotiation.cc:407] Connection header received
0619 18:45:44.150937 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.150974 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.433649 (+282675us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.532038 (+ 98389us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.533612 (+ 1574us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.539576 (+ 5964us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.646096 (+1106520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.683911 (+1037815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.767687 (+ 83776us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50658: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1840033,"server-negotiator.queue_time_us":985536,"spinlock_wait_cycles":15123072}
W20260619 18:45:46.844254 12537 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.181257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50674)
0619 18:45:43.188568 (+ 7311us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.188618 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.188851 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.169675 (+980824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.172500 (+ 2825us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.172692 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.203323 (+1030631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.203427 (+ 104us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.853184 (+649757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.853236 (+ 52us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.725176 (+871940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.725248 (+ 72us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.793955 (+ 68707us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":4864,"mutex_wait_us":1726152}
W20260619 18:45:46.858043 12531 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.070199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50626)
0619 18:45:43.071500 (+ 1301us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.071565 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.071874 (+ 309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.273340 (+1201466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.273399 (+ 59us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.273562 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.491000 (+1217438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.491112 (+ 112us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.864929 (+373817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.864980 (+ 51us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.815672 (+950692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.816781 (+ 1109us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.836748 (+ 19967us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":613,"mutex_wait_us":2068801}
W20260619 18:45:46.865268 12619 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.096354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50636 (local address 127.6.120.254:36501)
0619 18:45:44.136868 (+1040514us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.136926 (+ 58us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.136994 (+ 68us) server_negotiation.cc:407] Connection header received
0619 18:45:44.137157 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.137193 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.434999 (+297806us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.446358 (+ 11359us) spinlock_profiling.cc:243] Waited 6.39 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.546679 (+100321us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f13888caca0 00007f138897f49c 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.552069 (+ 5390us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.562431 (+ 10362us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.596612 (+1034181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.691924 (+ 95312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.868545 (+176621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.769942 (+901397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.819793 (+ 49851us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50636: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1824516,"server-negotiator.queue_time_us":1038878,"spinlock_wait_cycles":79796864}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:46.863466 12706 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.365369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:38362)
0619 18:45:43.978863 (+613494us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.983216 (+ 4353us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:44.004045 (+ 20829us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.042369 (+ 38324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.047321 (+ 4952us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.052907 (+ 5586us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:44.597049 (+544142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.597109 (+ 60us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.659423 (+1062314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.659479 (+ 56us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.760584 (+1101105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.760654 (+ 70us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.839725 (+ 79071us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":564099,"mutex_wait_us":1486781,"thread_start_us":363534,"threads_started":1}
W20260619 18:45:46.874188 12698 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.299993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:38354)
0619 18:45:43.587536 (+287543us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.587611 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.588068 (+ 457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.600955 (+ 12887us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.606836 (+ 5881us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.611009 (+ 4173us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:44.418620 (+807611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.418829 (+ 209us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.344009 (+925180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.360264 (+ 16255us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.737308 (+1377044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.738061 (+ 753us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.848315 (+110254us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":282303,"mutex_wait_us":2004768,"thread_start_us":241632,"threads_started":1}
W20260619 18:45:46.874972 12590 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.617977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50768)
0619 18:45:43.950571 (+332594us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.956756 (+ 6185us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.965586 (+ 8830us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.557201 (+591615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.557236 (+ 35us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.557376 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.584358 (+ 26982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.584418 (+ 60us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.751945 (+1167527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.752016 (+ 71us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.817482 (+1065466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.817561 (+ 79us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.864238 (+ 46677us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":67155,"mutex_wait_us":991849}
I20260619 18:45:46.875653 12118 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
I20260619 18:45:46.861233 12150 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:46.876426 12118 scanner-internal.cc:458] Time spent opening tablet: real 4.006s user 0.012s sys 0.008s
I20260619 18:45:46.876660 12171 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:46.877012 12150 scanner-internal.cc:458] Time spent opening tablet: real 3.420s user 0.003s sys 0.002s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:46.886497 12437 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.330603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50712)
0619 18:45:43.331813 (+ 1210us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.331897 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.332159 (+ 262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.497128 (+1164969us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.521258 (+ 24130us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.530407 (+ 9149us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.545995 (+1015588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.550101 (+ 4106us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.950917 (+400816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.950969 (+ 52us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.839948 (+888979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.840927 (+ 979us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.875310 (+ 34383us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":595,"mutex_wait_us":1711554}
W20260619 18:45:46.877346 12171 scanner-internal.cc:458] Time spent opening tablet: real 4.240s user 0.033s sys 0.078s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:46.893560 12185 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.365010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50730)
0619 18:45:43.380281 (+ 15271us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.380337 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.380572 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.650575 (+1270003us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.650672 (+ 97us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.651006 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.038487 (+387481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.038583 (+ 96us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.975845 (+937262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.976341 (+ 496us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.865354 (+889013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.865579 (+ 225us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.890002 (+ 24423us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":78,"mutex_wait_us":1141348}
W20260619 18:45:46.890491 12431 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.261460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50704)
0619 18:45:43.262161 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.262228 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.262585 (+ 357us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.664750 (+1402165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.664866 (+ 116us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.665169 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.505020 (+839851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.507238 (+ 2218us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.955247 (+448009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.955300 (+ 53us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.867849 (+912549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.869616 (+ 1767us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.885480 (+ 15864us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":101,"mutex_wait_us":1568492}
W20260619 18:45:46.896880 12596 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.834553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50770 (local address 127.6.120.254:36501)
0619 18:45:44.563000 (+728447us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.563030 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.563076 (+ 46us) server_negotiation.cc:407] Connection header received
0619 18:45:44.563196 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.563231 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.563474 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.565244 (+ 1770us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.594023 (+ 28779us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:45.594663 (+1000640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.545023 (+950360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.799725 (+254702us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50770: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1901273,"server-negotiator.queue_time_us":727025,"spinlock_wait_cycles":8436096}
W20260619 18:45:46.996385 12432 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.359479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50724)
0619 18:45:43.441334 (+ 81855us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.443240 (+ 1906us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.450909 (+ 7669us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.423318 (+972409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.423352 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.423470 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.276590 (+853120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.282439 (+ 5849us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.908509 (+626070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.908548 (+ 39us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.926424 (+1017876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.926525 (+ 101us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.929521 (+ 2996us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":92,"mutex_wait_us":1612288}
W20260619 18:45:46.999862 12582 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.559505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50764)
0619 18:45:43.610985 (+ 51480us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.612318 (+ 1333us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.630503 (+ 18185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.560002 (+929499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.560045 (+ 43us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.560231 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.598699 (+ 38468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.598994 (+ 295us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.930077 (+1331083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.934412 (+ 4335us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.948771 (+1014359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.948849 (+ 78us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.975819 (+ 26970us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":2050,"mutex_wait_us":854469}
W20260619 18:45:47.008462 12547 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.440750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50738)
0619 18:45:43.448478 (+ 7728us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.448563 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.448872 (+ 309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.725137 (+1276265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.725202 (+ 65us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.725436 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.762092 (+1036656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.764931 (+ 2839us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.305337 (+540406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.307209 (+ 1872us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.003826 (+696617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.005668 (+ 1842us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.007011 (+ 1343us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":2303,"mutex_wait_us":1548420}
W20260619 18:45:47.009851 12501 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.116090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50640)
0619 18:45:43.187765 (+ 71675us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.189083 (+ 1318us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.239558 (+ 50475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.157048 (+917490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.157079 (+ 31us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.157219 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.157717 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.157788 (+ 71us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.733313 (+1575525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.738204 (+ 4891us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.864710 (+1126506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.864767 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.883392 (+ 18625us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":3754,"mutex_wait_us":917266}
W20260619 18:45:47.006376 12546 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.969102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50784 (local address 127.6.120.254:36501)
0619 18:45:44.581594 (+612492us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.581636 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.581698 (+ 62us) server_negotiation.cc:407] Connection header received
0619 18:45:44.581876 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.581917 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.582222 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.582436 (+ 214us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.487018 (+904582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.063410 (+576392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.004203 (+940793us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50784: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1297632,"server-negotiator.queue_time_us":611962}
W20260619 18:45:47.039480 12604 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.997039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50786 (local address 127.6.120.254:36501)
0619 18:45:45.159227 (+1162188us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:45.159282 (+ 55us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:45.159358 (+ 76us) server_negotiation.cc:407] Connection header received
0619 18:45:45.159550 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:45.159602 (+ 52us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:45.159936 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:45.169445 (+ 9509us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.696557 (+527112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.593189 (+896632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.009602 (+416413us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50786: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1035333,"server-negotiator.queue_time_us":960429}
W20260619 18:45:47.074352 12652 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.093316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50816 (local address 127.6.120.254:36501)
0619 18:45:45.550929 (+1457613us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:45.556519 (+ 5590us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:45.560022 (+ 3503us) server_negotiation.cc:407] Connection header received
0619 18:45:45.566368 (+ 6346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:45.567196 (+ 828us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:45.593309 (+ 26113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:45.603888 (+ 10579us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:46.333756 (+729868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.770676 (+436920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.072873 (+302197us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50816: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":633493,"server-negotiator.queue_time_us":1412461}
W20260619 18:45:47.102450 12441 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.711055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50770)
0619 18:45:43.914510 (+203455us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.914600 (+ 90us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.914912 (+ 312us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.666647 (+751735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.666742 (+ 95us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.668213 (+ 1471us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.588597 (+920384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.592755 (+ 4158us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.546632 (+953877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.546685 (+ 53us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.099925 (+553240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.099997 (+ 72us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.100959 (+ 962us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":192584,"mutex_wait_us":1281483}
W20260619 18:45:47.109982 12507 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.041569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50796)
0619 18:45:44.116090 (+ 74521us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:44.118542 (+ 2452us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:44.147807 (+ 29265us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:45.453990 (+1306183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:45.486886 (+ 32896us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:45.512188 (+ 25302us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.904669 (+392481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.904736 (+ 67us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.650349 (+745613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.650399 (+ 50us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.002483 (+352084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.003110 (+ 627us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.106623 (+103513us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":2233,"mutex_wait_us":702212}
W20260619 18:45:47.106670 12091 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.128277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50826 (local address 127.6.120.254:36501)
0619 18:45:45.652414 (+1524137us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:45.657138 (+ 4724us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:45.661024 (+ 3886us) server_negotiation.cc:407] Connection header received
0619 18:45:45.667986 (+ 6962us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:45.668995 (+ 1009us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:45.692647 (+ 23652us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:45.700965 (+ 8318us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.794737 (+ 93772us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:45.847153 (+ 52416us) spinlock_profiling.cc:243] Waited 8.11 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:46.066287 (+219134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.825005 (+758718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.104868 (+279863us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50826: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":812984,"server-negotiator.queue_time_us":1438026,"spinlock_wait_cycles":22516736}
W20260619 18:45:47.139441 12444 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.981594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50784)
0619 18:45:43.989470 (+ 7876us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.989553 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.989923 (+ 370us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.666419 (+676496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.666491 (+ 72us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.666714 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.318865 (+652151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.318935 (+ 70us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.063927 (+744992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.063973 (+ 46us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.998575 (+934602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.002105 (+ 3530us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.051236 (+ 49131us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":6273,"mutex_wait_us":1469775}
W20260619 18:45:47.152827 12187 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.059493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50800 (local address 127.6.120.254:36501)
0619 18:45:45.501184 (+1441691us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:45.501243 (+ 59us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:45.501317 (+ 74us) server_negotiation.cc:407] Connection header received
0619 18:45:45.501487 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:45.501522 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:45.505581 (+ 4059us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:45.510291 (+ 4710us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.635131 (+124840us) spinlock_profiling.cc:243] Waited 6.7 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:45.806850 (+171719us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:46.374573 (+567723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.646947 (+272374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.132656 (+485709us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50800: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":569081,"server-negotiator.queue_time_us":1439116,"spinlock_wait_cycles":19287296}
W20260619 18:45:47.155076 12549 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.056244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50816)
0619 18:45:44.135088 (+ 78844us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:44.148783 (+ 13695us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:44.169194 (+ 20411us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:45.633535 (+1464341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:45.633590 (+ 55us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:45.633761 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:46.333233 (+699472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.333302 (+ 69us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.783743 (+450441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.785091 (+ 1348us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.085368 (+300277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.085463 (+ 95us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.153121 (+ 67658us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":4609,"mutex_wait_us":857301}
W20260619 18:45:47.158061 12485 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.146672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50882)
0619 18:45:44.220802 (+ 74130us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:44.227423 (+ 6621us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:44.271359 (+ 43936us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:45.714501 (+1443142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:45.730315 (+ 15814us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:45.743700 (+ 13385us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:46.330839 (+587139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.330925 (+ 86us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.710927 (+380002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.710961 (+ 34us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.041005 (+330044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.041064 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.155573 (+114509us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":2219,"mutex_wait_us":829908}
W20260619 18:45:47.171077 12719 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.106299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50800)
0619 18:45:45.146316 (+1040017us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:45.146415 (+ 99us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:45.146873 (+ 458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:45.511887 (+365014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:45.511922 (+ 35us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:45.512745 (+ 823us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:46.373812 (+861067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.373885 (+ 73us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.648719 (+274834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.648761 (+ 42us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.051681 (+402920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.051754 (+ 73us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.160315 (+108561us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1039226,"mutex_wait_us":1205953,"thread_start_us":1038883,"threads_started":1}
W20260619 18:45:47.173346 12573 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.001249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50786)
0619 18:45:44.039353 (+ 38104us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:44.040851 (+ 1498us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:44.052870 (+ 12019us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:45.185695 (+1132825us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:45.186673 (+ 978us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:45.186913 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.694039 (+507126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.694117 (+ 78us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.594857 (+900740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.594912 (+ 55us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.079159 (+484247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.079251 (+ 92us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.153037 (+ 73786us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":97,"mutex_wait_us":989732}
W20260619 18:45:47.174891 12592 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.122750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50850)
0619 18:45:44.123480 (+ 730us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:44.123526 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:44.123747 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:45.793574 (+1669827us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:45.793621 (+ 47us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:45.793762 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:46.289612 (+495850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.291341 (+ 1729us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.464579 (+173238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.465599 (+ 1020us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.039546 (+573947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.039606 (+ 60us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.158705 (+119099us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":303,"mutex_wait_us":1008042}
W20260619 18:45:47.210834 12595 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.126803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50834 (local address 127.6.120.254:36501)
0619 18:45:45.561632 (+1434829us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:45.566240 (+ 4608us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:45.567007 (+ 767us) server_negotiation.cc:407] Connection header received
0619 18:45:45.587216 (+ 20209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:45.590768 (+ 3552us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:45.629496 (+ 38728us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:45.634165 (+ 4669us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:46.394678 (+760513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.676537 (+281859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.183476 (+506939us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50834: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":674797,"server-negotiator.queue_time_us":1394434}
W20260619 18:45:47.240868 12570 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.197237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50886 (local address 127.6.120.254:36501)
0619 18:45:45.677362 (+1480125us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:45.677416 (+ 54us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:45.677470 (+ 54us) server_negotiation.cc:407] Connection header received
0619 18:45:45.677605 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:45.677636 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:45.687951 (+ 10315us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:45.696204 (+ 8253us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.807588 (+111384us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:46.281448 (+473860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.753646 (+472198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.219918 (+466272us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50886: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":575132,"server-negotiator.queue_time_us":1477255,"spinlock_wait_cycles":7104768}
W20260619 18:45:47.259284 12574 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.138906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50864)
0619 18:45:44.139864 (+ 958us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:44.139916 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:44.140208 (+ 292us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:45.732502 (+1592294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:45.732560 (+ 58us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:45.732723 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:46.381125 (+648402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.381202 (+ 77us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.794315 (+413113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.794365 (+ 50us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.103476 (+309111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.103542 (+ 66us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.257393 (+153851us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":388,"mutex_wait_us":964798}
W20260619 18:45:47.267900 12058 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.164516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50850 (local address 127.6.120.254:36501)
0619 18:45:45.585023 (+1420507us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:45.585075 (+ 52us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:45.589057 (+ 3982us) server_negotiation.cc:407] Connection header received
0619 18:45:45.599076 (+ 10019us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:45.600952 (+ 1876us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:45.783709 (+182757us) spinlock_profiling.cc:243] Waited 9.53 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:45.784002 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:45.787153 (+ 3151us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.864632 (+ 77479us) spinlock_profiling.cc:243] Waited 9.97 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:46.295061 (+430429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.449779 (+154718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.039950 (+590171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.181642 (+141692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.211281 (+ 29639us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50850: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":334654,"server-negotiator.queue_time_us":1419792,"spinlock_wait_cycles":44832768}
W20260619 18:45:47.279821 12591 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.132157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50844 (local address 127.6.120.254:36501)
0619 18:45:45.582127 (+1449970us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:45.582211 (+ 84us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:45.582284 (+ 73us) server_negotiation.cc:407] Connection header received
0619 18:45:45.582445 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:45.582475 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:45.582801 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:45.583072 (+ 271us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.795815 (+212743us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:46.053229 (+257414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.546590 (+493361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.800171 (+253581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.113727 (+313556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.114070 (+ 343us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:47.236594 (+122524us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50844: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1033652,"server-negotiator.queue_time_us":1449497,"spinlock_wait_cycles":3501440}
W20260619 18:45:47.287576 12569 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.172310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50882 (local address 127.6.120.254:36501)
0619 18:45:45.675825 (+1503515us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:45.675913 (+ 88us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:45.675984 (+ 71us) server_negotiation.cc:407] Connection header received
0619 18:45:45.676170 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:45.676208 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:45.676527 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:45.676770 (+ 243us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.795274 (+118504us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:46.331347 (+536073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.710414 (+379067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.042350 (+331936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.285418 (+243068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.285944 (+ 526us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50882: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":617776,"server-negotiator.queue_time_us":1459154,"spinlock_wait_cycles":10568064}
W20260619 18:45:47.288610 12583 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.167192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50844)
0619 18:45:44.263012 (+ 95820us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:44.281299 (+ 18287us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:44.344012 (+ 62713us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:45.583811 (+1239799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:45.583865 (+ 54us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:45.584030 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:46.052079 (+468049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.052541 (+ 462us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.547051 (+494510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.547098 (+ 47us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.794495 (+247397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.794560 (+ 65us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.114726 (+320166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.114767 (+ 41us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.213389 (+ 98622us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:47.273612 (+ 60223us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:47.273638 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:47.273693 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:47.273818 (+ 125us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:47.274617 (+ 799us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1780,"mutex_wait_us":727092}
W20260619 18:45:47.307098 12563 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.168020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50864 (local address 127.6.120.254:36501)
0619 18:45:45.670233 (+1502213us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:45.680295 (+ 10062us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:45.681678 (+ 1383us) server_negotiation.cc:407] Connection header received
0619 18:45:45.687680 (+ 6002us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:45.689172 (+ 1492us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:45.706610 (+ 17438us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:45.714170 (+ 7560us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:46.381536 (+667366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.792948 (+411412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.103862 (+310914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.281882 (+178020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.285888 (+ 4006us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50864: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":720713,"server-negotiator.queue_time_us":1436111}
W20260619 18:45:47.397132 12231 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 90684.5us
W20260619 18:45:47.421157 12405 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.157232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50886)
0619 18:45:44.230725 (+ 73493us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:44.232435 (+ 1710us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:44.295004 (+ 62569us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:45.732842 (+1437838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:45.732935 (+ 93us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:45.735579 (+ 2644us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:46.274677 (+539098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.274748 (+ 71us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.763584 (+488836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.767366 (+ 3782us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.331829 (+564463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.331883 (+ 54us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.414168 (+ 82285us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1043,"mutex_wait_us":1075337}
W20260619 18:45:47.434465 12722 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.110281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50834)
0619 18:45:45.068671 (+958390us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:45.068748 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:45.069138 (+ 390us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:45.640832 (+571694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:45.644004 (+ 3172us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:45.661107 (+ 17103us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:46.385883 (+724776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.387861 (+ 1978us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.678990 (+291129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.679033 (+ 43us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.342855 (+663822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.342927 (+ 72us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.432675 (+ 89748us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":957617,"mutex_wait_us":1224008,"thread_start_us":1039802,"threads_started":1}
W20260619 18:45:47.438236 12490 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.643215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50906 (local address 127.6.120.254:36501)
0619 18:45:45.796496 (+1153281us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:45.796533 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:45.796589 (+ 56us) server_negotiation.cc:407] Connection header received
0619 18:45:45.796741 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:45.796770 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:45.797045 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:45.797256 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:46.409841 (+612585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.863680 (+453839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.340205 (+476525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.400643 (+ 60438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.400967 (+ 324us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:47.436823 (+ 35856us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50906: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1034917,"server-negotiator.queue_time_us":1142584}
W20260619 18:45:47.460809 12194 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.095317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50826)
0619 18:45:44.183793 (+ 88476us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:44.186882 (+ 3089us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:44.200346 (+ 13464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:45.731094 (+1530748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:45.731157 (+ 63us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:45.731349 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:46.065834 (+334485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.065915 (+ 81us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.828600 (+762685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.828656 (+ 56us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.358491 (+529835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.358548 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.444045 (+ 85497us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":657,"mutex_wait_us":892580}
W20260619 18:45:47.471763 12144 scanner-internal.cc:458] Time spent opening tablet: real 2.183s user 0.019s sys 0.007s
W20260619 18:45:47.488920 12536 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.052476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50796 (local address 127.6.120.254:36501)
0619 18:45:45.341051 (+1288575us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:45.343007 (+ 1956us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:45.345477 (+ 2470us) server_negotiation.cc:407] Connection header received
0619 18:45:45.361740 (+ 16263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:45.362129 (+ 389us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:45.403370 (+ 41241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:45.408234 (+ 4864us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.906113 (+497879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.642920 (+736807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.004789 (+361869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.474292 (+469503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.487118 (+ 12826us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50796: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1173344,"server-negotiator.queue_time_us":1226986,"spinlock_wait_cycles":1381120}
W20260619 18:45:47.532991 12557 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.431660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50898 (local address 127.6.120.254:36501)
0619 18:45:45.800171 (+1368511us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:45.805150 (+ 4979us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:45.812248 (+ 7098us) server_negotiation.cc:407] Connection header received
0619 18:45:45.815346 (+ 3098us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:45.822529 (+ 7183us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:45.880191 (+ 57662us) spinlock_profiling.cc:243] Waited 965 us on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:45.880440 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:45.880635 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:46.423240 (+542605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.827899 (+404659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.386932 (+559033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.420662 (+ 33730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.420992 (+ 330us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:47.498301 (+ 77309us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50898: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1020481,"server-negotiator.queue_time_us":1329511,"spinlock_wait_cycles":2219264}
W20260619 18:45:47.584721 12238 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 125554us
W20260619 18:45:47.594269 12594 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 115517us
W20260619 18:45:47.627341 12406 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.434708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50906)
0619 18:45:44.438517 (+ 3809us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:44.443489 (+ 4972us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:44.470206 (+ 26717us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:45.797634 (+1327428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:45.797684 (+ 50us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:45.797817 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:46.315834 (+518017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.315923 (+ 89us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.864087 (+548164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.864148 (+ 61us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.332841 (+468693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.337125 (+ 4284us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.400940 (+ 63815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.400983 (+ 43us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.485263 (+ 84280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:47.497659 (+ 12396us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:47.497687 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:47.497747 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:47.498817 (+ 1070us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:47.573594 (+ 74777us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":2112,"mutex_wait_us":1048404}
W20260619 18:45:47.654316 12357 scanner-internal.cc:458] Time spent opening tablet: real 3.220s user 0.019s sys 0.048s
W20260619 18:45:47.697587 12228 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 107057us
W20260619 18:45:47.705220 12200 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 314405us
W20260619 18:45:47.781010 12190 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 274622us
W20260619 18:45:47.826738 12598 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.436632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50898)
0619 18:45:44.527936 (+ 91304us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:44.529334 (+ 1398us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:44.544745 (+ 15411us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:45.881624 (+1336879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:45.881698 (+ 74us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:45.881863 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:46.422345 (+540482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.422442 (+ 97us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.829379 (+406937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.829416 (+ 37us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.386150 (+556734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.386228 (+ 78us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.420973 (+ 34745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.421012 (+ 39us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.571664 (+150652us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:47.639287 (+ 67623us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:47.639307 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:47.639347 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:47.639439 (+ 92us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:47.686825 (+ 47386us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":4678,"mutex_wait_us":1247260}
W20260619 18:45:47.881580 12593 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 152784us
W20260619 18:45:47.902292 12221 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 367063us
W20260619 18:45:48.015177 12227 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 138361us
W20260619 18:45:48.135829 12697 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 328982us
W20260619 18:45:48.310410 12147 scanner-internal.cc:458] Time spent opening tablet: real 2.673s user 0.002s sys 0.012s
W20260619 18:45:48.519037 12585 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:45.283722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50976 (local address 127.6.120.254:36501)
0619 18:45:45.883295 (+599573us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:45.885898 (+ 2603us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:45.887356 (+ 1458us) server_negotiation.cc:407] Connection header received
0619 18:45:45.900982 (+ 13626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:45.902008 (+ 1026us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:45.914578 (+ 12570us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:45.917767 (+ 3189us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:46.528988 (+611221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.992237 (+463249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.470754 (+478517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.774763 (+304009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.776292 (+ 1529us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:48.315437 (+539145us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50976: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1200529,"server-negotiator.queue_time_us":560956}
W20260619 18:45:48.537846 12154 scanner-internal.cc:458] Time spent opening tablet: real 4.305s user 0.011s sys 0.026s
W20260619 18:45:48.573644 12718 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 473318us
W20260619 18:45:48.577736 12724 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 641292us
W20260619 18:45:48.602245 12599 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 535628us
W20260619 18:45:48.670178 12247 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 1.17188e+06us
W20260619 18:45:48.717533 12635 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 335382us
W20260619 18:45:48.720391 12631 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:45.277274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50976)
0619 18:45:45.313228 (+ 35954us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:45.313292 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:45.313631 (+ 339us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:45.918887 (+605256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:45.920728 (+ 1841us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:45.929148 (+ 8420us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:46.520792 (+591644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.525036 (+ 4244us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.998061 (+473025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.998807 (+ 746us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.468591 (+469784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.468654 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.782631 (+313977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.784301 (+ 1670us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.322769 (+538468us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:48.609430 (+286661us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:48.610343 (+ 913us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:48.611163 (+ 820us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:48.612691 (+ 1528us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:48.648929 (+ 36238us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":5431,"mutex_wait_us":1774874}
W20260619 18:45:48.749094 12218 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 398453us
W20260619 18:45:48.781008 12702 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 888393us
W20260619 18:45:49.188252 12850 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.566s user 0.032s sys 0.062s
W20260619 18:45:49.504892 12708 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.648s user 0.003s sys 0.007s
W20260619 18:45:49.527156 12708 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.671s user 0.003s sys 0.007s
W20260619 18:45:49.357182 12576 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.588s user 0.006s sys 0.010s
W20260619 18:45:49.491061 12683 meta_cache.cc:1261] Time spent looking up entry by key: real 0.665s user 0.001s sys 0.000s
W20260619 18:45:49.511391 12850 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.889s user 0.032s sys 0.063s
W20260619 18:45:49.481669 12875 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.697s user 0.005s sys 0.022s
W20260619 18:45:49.496654 12605 meta_cache.cc:1261] Time spent looking up entry by key: real 0.119s user 0.008s sys 0.007s
W20260619 18:45:49.261973 12333 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.536s user 0.034s sys 0.043s
W20260619 18:45:49.509068 12869 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.556s user 0.000s sys 0.009s
W20260619 18:45:49.539656 12576 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.770s user 0.006s sys 0.015s
W20260619 18:45:49.544978 12875 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.761s user 0.006s sys 0.023s
W20260619 18:45:49.545920 12333 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.820s user 0.034s sys 0.044s
W20260619 18:45:49.547714 12869 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.595s user 0.001s sys 0.009s
W20260619 18:45:49.565629 12223 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 1.27516e+06us
W20260619 18:45:49.578553 12560 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.401135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51296 (local address 127.6.120.254:36501)
0619 18:45:47.219872 (+818737us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.219904 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.219950 (+ 46us) server_negotiation.cc:407] Connection header received
0619 18:45:47.220083 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.220133 (+ 50us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.235250 (+ 15117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.236325 (+ 1075us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.320430 (+ 84105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.481854 (+161424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.098061 (+616207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.670586 (+572525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.785684 (+115098us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:49.555741 (+770057us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51296: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":949610,"server-negotiator.queue_time_us":810734}
W20260619 18:45:49.590538 11039 thread.cc:636] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.678s user 0.003s sys 0.006s
W20260619 18:45:49.596302 11039 thread.cc:602] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.782s user 0.005s sys 0.006s
W20260619 18:45:49.615249 12636 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:45.834719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51180 (local address 127.6.120.254:36501)
0619 18:45:46.722368 (+887649us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:46.723307 (+ 939us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:46.724578 (+ 1271us) server_negotiation.cc:407] Connection header received
0619 18:45:46.724787 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:46.724828 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:46.725153 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:46.725346 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:46.820473 (+ 95127us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:46.932351 (+111878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.396128 (+463777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.805224 (+409096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.106229 (+301005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.570093 (+463864us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:49.613512 (+1043419us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51180: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1555146,"server-negotiator.queue_time_us":876080,"spinlock_wait_cycles":7715072}
W20260619 18:45:49.615706 12645 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.141428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51212 (local address 127.6.120.254:36501)
0619 18:45:46.843813 (+702385us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:46.843856 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:46.843908 (+ 52us) server_negotiation.cc:407] Connection header received
0619 18:45:46.844047 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:46.844096 (+ 49us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:46.844595 (+ 499us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:46.847581 (+ 2986us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.091315 (+243734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.405557 (+314242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.826145 (+420588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.924672 (+ 98527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.960455 (+ 35783us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:49.614219 (+1653764us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51212: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1011561,"server-negotiator.queue_time_us":701901}
W20260619 18:45:49.620970 12613 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:45.826225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51136 (local address 127.6.120.254:36501)
0619 18:45:46.702951 (+876726us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:46.702995 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:46.703082 (+ 87us) server_negotiation.cc:407] Connection header received
0619 18:45:46.703264 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:46.703306 (+ 42us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:46.703643 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:46.707474 (+ 3831us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.083563 (+376089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.389895 (+306332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.756301 (+366406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.827118 (+ 70817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.935635 (+108517us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:49.551350 (+1615715us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51136: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1361480,"server-negotiator.queue_time_us":854649}
W20260619 18:45:49.622046 12516 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:45.836628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51154 (local address 127.6.120.254:36501)
0619 18:45:46.761365 (+924737us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:46.761396 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:46.761469 (+ 73us) server_negotiation.cc:407] Connection header received
0619 18:45:46.761592 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:46.761633 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:46.761884 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:46.762145 (+ 261us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.013057 (+250912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.343406 (+330349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.831108 (+487702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.490145 (+659037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.703433 (+213288us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:49.620460 (+917027us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51154: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1917462,"server-negotiator.queue_time_us":924323}
W20260619 18:45:49.948500 12201 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 1.29712e+06us
I20260619 18:45:50.303673 10958 rpcz_store.cc:275] Call kudu.master.MasterService.ConnectToMaster from 127.0.0.1:51230 (request call id 0) took 1576 ms. Trace:
W20260619 18:45:50.517966 12816 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.279073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51612)
0619 18:45:47.389486 (+110413us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.389565 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.389861 (+ 296us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.510692 (+1120831us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.510725 (+ 33us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.510857 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:50.487994 (+1977137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:50.493072 (+ 5078us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:50.516691 (+ 23619us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":102426,"mutex_wait_us":1907160,"thread_start_us":82420,"threads_started":1}
W20260619 18:45:50.520295 12536 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.909355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51440 (local address 127.6.120.254:36501)
0619 18:45:47.502842 (+593487us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.502869 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.502941 (+ 72us) server_negotiation.cc:407] Connection header received
0619 18:45:47.504202 (+ 1261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.504231 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.504519 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.504714 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.673619 (+168905us) spinlock_profiling.cc:243] Waited 7.73 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:48.060657 (+387038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.707781 (+647124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.779497 (+ 71716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:49.914754 (+1135257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:50.518847 (+604093us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51440: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2726519,"server-negotiator.queue_time_us":580165,"spinlock_wait_cycles":17783552}
W20260619 18:45:50.204159 12623 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 1.14902e+06us
W20260619 18:45:50.523554 12620 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.186271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51572 (local address 127.6.120.254:36501)
0619 18:45:48.123069 (+936798us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.125911 (+ 2842us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.127261 (+ 1350us) server_negotiation.cc:407] Connection header received
0619 18:45:48.130389 (+ 3128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.131885 (+ 1496us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.148639 (+ 16754us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.159672 (+ 11033us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:48.382338 (+222666us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:50.513720 (+2131382us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51572: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":614039,"server-negotiator.queue_time_us":898534,"spinlock_wait_cycles":2342144}
W20260619 18:45:50.551887 12153 meta_cache.cc:1097] Time spent processing table locations response: real 0.876s user 0.016s sys 0.017s
W20260619 18:45:50.579762 12653 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.040604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51506 (local address 127.6.120.254:36501)
0619 18:45:47.773244 (+732640us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.773278 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.773328 (+ 50us) server_negotiation.cc:407] Connection header received
0619 18:45:47.773455 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.773481 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.773731 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.773901 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.850815 (+ 76914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.852967 (+ 2152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.098965 (+245998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.571991 (+473026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.784889 (+212898us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:50.576486 (+1791597us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51506: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1937968,"server-negotiator.queue_time_us":732201}
W20260619 18:45:50.572808 12563 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.783724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51370 (local address 127.6.120.254:36501)
0619 18:45:47.358401 (+574677us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.358434 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.358488 (+ 54us) server_negotiation.cc:407] Connection header received
0619 18:45:47.358614 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.358640 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.358904 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.362084 (+ 3180us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.455204 (+ 93120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.954867 (+499663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.717227 (+762360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.781464 (+ 64237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.781855 (+ 391us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:50.513788 (+1731933us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51370: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1253978,"server-negotiator.queue_time_us":534758}
W20260619 18:45:50.563283 12721 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 993143us
I20260619 18:45:50.524029 10958 rpcz_store.cc:276] 0619 18:45:48.727291 (+ 0us) service_pool.cc:170] Inserting onto call queue
0619 18:45:48.732742 (+ 5451us) service_pool.cc:227] Handling call
0619 18:45:48.746195 (+ 13453us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b54001c3090. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ed92 00007f138cd637c9 00007f138ccfbc36 00007f138ccccc28 00007f138cdc9e59 00007f138b0db534 00007f138b0db4c2 00007f138b0db3f1 00007f138b0db36c
0619 18:45:50.303555 (+1557360us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1545489,"spinlock_wait_cycles":3398400}
W20260619 18:45:50.669828 12725 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 1.96731e+06us
W20260619 18:45:50.948915 12462 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.867895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51392)
0619 18:45:46.878261 (+ 10366us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.878355 (+ 94us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.878776 (+ 421us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.418585 (+539809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.418631 (+ 46us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.418769 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.764242 (+345473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.764322 (+ 80us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.770763 (+ 6441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.770805 (+ 42us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.671198 (+900393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.671263 (+ 65us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:50.581757 (+1910494us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":4851,"mutex_wait_us":1881041}
W20260619 18:45:50.950801 12087 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.533554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51308 (local address 127.6.120.254:36501)
0619 18:45:47.243375 (+709821us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.243421 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.243489 (+ 68us) server_negotiation.cc:407] Connection header received
0619 18:45:47.243670 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.243713 (+ 43us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.247999 (+ 4286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.264079 (+ 16080us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.403613 (+139534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.731440 (+327827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.573657 (+842217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.574754 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:49.528338 (+953584us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:50.601166 (+1072828us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51308: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2470194,"server-negotiator.queue_time_us":703706,"spinlock_wait_cycles":1720704}
W20260619 18:45:50.951120 12595 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.395090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51278 (local address 127.6.120.254:36501)
0619 18:45:47.211748 (+816658us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.211782 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.211832 (+ 50us) server_negotiation.cc:407] Connection header received
0619 18:45:47.211959 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.211984 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.212266 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.212463 (+ 197us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.373914 (+161451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.887848 (+513934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.543580 (+655732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:49.911799 (+1368219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:50.635707 (+723908us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51278: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2521916,"server-negotiator.queue_time_us":816256}
W20260619 18:45:50.839536 12214 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 2.12467e+06us
W20260619 18:45:50.968221 12814 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.254461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51600)
0619 18:45:47.326631 (+ 72170us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.326716 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.327027 (+ 311us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.571106 (+1244079us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.571149 (+ 43us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.571286 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:48.572188 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.572252 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:50.966902 (+2394650us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":71543,"mutex_wait_us":658870,"thread_start_us":60839,"threads_started":1}
W20260619 18:45:50.969791 12437 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.893428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51414)
0619 18:45:46.919278 (+ 25850us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.920444 (+ 1166us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.928758 (+ 8314us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.455486 (+526728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.455520 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.455639 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.995766 (+540127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.002512 (+ 6746us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:49.549029 (+1546517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:49.550001 (+ 972us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:50.595502 (+1045501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:50.595589 (+ 87us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:50.633856 (+ 38267us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":915,"mutex_wait_us":1548485}
W20260619 18:45:50.971249 12455 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.332227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51252)
0619 18:45:46.333682 (+ 1455us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.333738 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.334008 (+ 270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.139952 (+805944us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.140479 (+ 527us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.156649 (+ 16170us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.246539 (+ 89890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.246597 (+ 58us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.715728 (+469131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.715777 (+ 49us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.370229 (+654452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.382568 (+ 12339us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:50.969420 (+2586852us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":942,"mutex_wait_us":2191759}
W20260619 18:45:51.023406 12081 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.951266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51464 (local address 127.6.120.254:36501)
0619 18:45:47.582730 (+631464us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.585462 (+ 2732us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.585517 (+ 55us) server_negotiation.cc:407] Connection header received
0619 18:45:47.585654 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.585683 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.585957 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.586162 (+ 205us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.955250 (+369088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.500768 (+545518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.945081 (+444313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:50.972705 (+2027624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:50.973278 (+ 573us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51464: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2745055,"server-negotiator.queue_time_us":597495}
W20260619 18:45:51.022223 12531 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.903715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51426)
0619 18:45:46.942001 (+ 38286us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.943192 (+ 1191us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.952669 (+ 9477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.498452 (+545783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.499273 (+ 821us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.500702 (+ 1429us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.781174 (+280472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.781245 (+ 71us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.181741 (+400496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.193986 (+ 12245us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.938965 (+744979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.939045 (+ 80us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:50.555289 (+1616244us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":293,"mutex_wait_us":1478703}
W20260619 18:45:51.022032 12614 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.187114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51566 (local address 127.6.120.254:36501)
0619 18:45:48.140436 (+953322us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.140479 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.140539 (+ 60us) server_negotiation.cc:407] Connection header received
0619 18:45:48.140701 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.140736 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.375254 (+234518us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:48.381886 (+ 6632us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.382196 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:50.972217 (+2590021us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51566: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1850616,"server-negotiator.queue_time_us":952767,"spinlock_wait_cycles":8775424}
W20260619 18:45:51.028554 12544 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.859716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51398 (local address 127.6.120.254:36501)
0619 18:45:47.413810 (+554094us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.415303 (+ 1493us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.416309 (+ 1006us) server_negotiation.cc:407] Connection header received
0619 18:45:47.416454 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.416485 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.416742 (+ 257us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.416914 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.457337 (+ 40423us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:47.483624 (+ 26287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.728554 (+244930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.375468 (+646914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.745090 (+369622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.745464 (+ 374us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:50.592318 (+1846854us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51398: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1339394,"server-negotiator.queue_time_us":550484,"spinlock_wait_cycles":6225792}
W20260619 18:45:50.974555 12875 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.682s user 0.006s sys 0.009s
I20260619 18:45:51.025719 10957 rpcz_store.cc:275] Call kudu.master.MasterService.ConnectToMaster from 127.0.0.1:51222 (request call id 0) took 2524 ms. Trace:
I20260619 18:45:51.039106 10957 rpcz_store.cc:276] 0619 18:45:48.501278 (+ 0us) service_pool.cc:170] Inserting onto call queue
0619 18:45:48.531378 (+ 30100us) service_pool.cc:227] Handling call
0619 18:45:51.023728 (+2492350us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b3c00108b18. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fc232a 00007f1383fc2521 00007f138cdca381 00007f138b0db534 00007f138b0db4c2 00007f138b0db3f1
0619 18:45:51.025520 (+ 1792us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1982417,"spinlock_wait_cycles":3518080}
W20260619 18:45:51.041875 12091 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.333131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51252 (local address 127.6.120.254:36501)
0619 18:45:47.127828 (+794697us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.128777 (+ 949us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.132796 (+ 4019us) server_negotiation.cc:407] Connection header received
0619 18:45:47.137595 (+ 4799us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.138324 (+ 729us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.138624 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.138831 (+ 207us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.330225 (+191394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.715042 (+384817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.406813 (+691771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:49.957638 (+1550825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:51.040600 (+1082962us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51252: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2897439,"server-negotiator.queue_time_us":786774}
W20260619 18:45:51.005436 12149 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.812s user 0.024s sys 0.029s
W20260619 18:45:51.035362 12875 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.739s user 0.012s sys 0.015s
W20260619 18:45:51.048655 12149 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.234s user 0.025s sys 0.034s
W20260619 18:45:51.059056 12853 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.040240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48624 (local address 127.6.120.193:37901)
0619 18:45:48.312332 (+272092us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.314904 (+ 2572us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.319185 (+ 4281us) server_negotiation.cc:407] Connection header received
0619 18:45:48.326958 (+ 7773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.327892 (+ 934us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.405666 (+ 77774us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.424238 (+ 18572us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:51.039568 (+2615330us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48624: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2596672,"server-negotiator.queue_time_us":222504}
W20260619 18:45:51.073395 12574 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.267260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51606)
0619 18:45:47.314343 (+ 47083us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.314842 (+ 499us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.319495 (+ 4653us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.568207 (+1248712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.569178 (+ 971us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.579611 (+ 10433us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:50.223735 (+1644124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:50.223826 (+ 91us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:50.973932 (+750106us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1749,"mutex_wait_us":2288873}
W20260619 18:45:51.074460 12547 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.018074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51506)
0619 18:45:47.068932 (+ 50858us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.068993 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.069286 (+ 293us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.774834 (+705548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.776667 (+ 1833us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.797219 (+ 20552us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.849907 (+ 52688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.849984 (+ 77us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.865965 (+ 15981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.878060 (+ 12095us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.095772 (+217712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.095832 (+ 60us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.595362 (+499530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.597840 (+ 2478us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:49.912553 (+1314713us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:50.059237 (+146684us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:50.059280 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:50.059347 (+ 67us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:50.059488 (+ 141us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:50.634653 (+575165us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":504,"mutex_wait_us":2102843}
W20260619 18:45:51.080309 12836 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.672954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51808)
0619 18:45:47.681080 (+ 8126us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.681204 (+ 124us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.681616 (+ 412us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:49.785309 (+2103693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:49.785363 (+ 54us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:49.785530 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:51.042464 (+1256934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:51.042518 (+ 54us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.043009 (+ 491us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":7209,"mutex_wait_us":1194006,"thread_start_us":6668,"threads_started":1}
W20260619 18:45:51.082399 12691 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.363564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51278)
0619 18:45:46.367497 (+ 3933us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.367542 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.367767 (+ 225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.213183 (+845416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.213214 (+ 31us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.213332 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.367346 (+154014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.369450 (+ 2104us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.890661 (+521211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.891486 (+ 825us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.541642 (+650156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.541706 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.070422 (+2528716us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":3497,"mutex_wait_us":2269790}
W20260619 18:45:51.114332 12823 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.408079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51746)
0619 18:45:47.633219 (+225140us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.634902 (+ 1683us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.642805 (+ 7903us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.597588 (+954783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.599099 (+ 1511us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.611343 (+ 12244us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:49.605583 (+994240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:49.605653 (+ 70us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:50.591303 (+985650us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":206437,"mutex_wait_us":1049057,"thread_start_us":160699,"threads_started":1}
W20260619 18:45:51.129278 12634 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.259200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51600 (local address 127.6.120.254:36501)
0619 18:45:48.537442 (+1278242us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.538516 (+ 1074us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.540187 (+ 1671us) server_negotiation.cc:407] Connection header received
0619 18:45:48.546348 (+ 6161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.550947 (+ 4599us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.565838 (+ 14891us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.569254 (+ 3416us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:48.696616 (+127362us) spinlock_profiling.cc:243] Waited 5.24 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:48.945841 (+249225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.060591 (+2114750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:51.061150 (+ 559us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51600: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2336867,"server-negotiator.queue_time_us":1212689,"spinlock_wait_cycles":12041088}
W20260619 18:45:51.140225 12617 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.568s user 0.011s sys 0.012s
W20260619 18:45:51.133399 12210 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 2.42854e+06us
W20260619 18:45:51.210189 12617 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.710s user 0.011s sys 0.023s
W20260619 18:45:51.205080 12606 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 2.3606e+06us
W20260619 18:45:51.207373 12798 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 112750us
W20260619 18:45:51.231983 12187 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.375248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51286 (local address 127.6.120.254:36501)
0619 18:45:47.153925 (+778677us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.153959 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.154019 (+ 60us) server_negotiation.cc:407] Connection header received
0619 18:45:47.154173 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.154203 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.154459 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.154682 (+ 223us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.285722 (+131040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.731088 (+445366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.837395 (+106307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.181532 (+344137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.638259 (+456727us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:51.229277 (+2591018us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51286: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":3241211,"server-negotiator.queue_time_us":778211}
W20260619 18:45:51.246197 12608 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.903741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51426 (local address 127.6.120.254:36501)
0619 18:45:47.489202 (+585461us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.489239 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.489286 (+ 47us) server_negotiation.cc:407] Connection header received
0619 18:45:47.489416 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.489453 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.493785 (+ 4332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.497398 (+ 3613us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.781576 (+284178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.172149 (+390573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.941145 (+768996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:50.304089 (+1362944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:51.234083 (+929994us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51426: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2825414,"server-negotiator.queue_time_us":585007}
W20260619 18:45:51.253780 12619 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.311934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51614 (local address 127.6.120.254:36501)
0619 18:45:48.549737 (+1237803us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.551039 (+ 1302us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.554178 (+ 3139us) server_negotiation.cc:407] Connection header received
0619 18:45:48.561541 (+ 7363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.562623 (+ 1082us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.575620 (+ 12997us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.577513 (+ 1893us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:51.234863 (+2657350us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51614: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1813969,"server-negotiator.queue_time_us":1188197}
W20260619 18:45:51.298247 12554 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.658232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51320)
0619 18:45:46.660397 (+ 2165us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.660460 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.660711 (+ 251us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.248821 (+588110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.248862 (+ 41us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.249028 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.475750 (+226722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.475850 (+ 100us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.725182 (+249332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.725243 (+ 61us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.695070 (+969827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.697012 (+ 1942us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.239253 (+2542241us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1634,"mutex_wait_us":2355148}
W20260619 18:45:51.311792 12058 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.710725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51334 (local address 127.6.120.254:36501)
0619 18:45:47.286625 (+575900us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.286658 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.286708 (+ 50us) server_negotiation.cc:407] Connection header received
0619 18:45:47.286843 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.286869 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.287126 (+ 257us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.287327 (+ 201us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.416455 (+129128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.729042 (+312587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.734705 (+1005663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.787219 (+ 52514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:49.625136 (+837917us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:51.218370 (+1593234us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51334: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2730125,"server-negotiator.queue_time_us":569756}
W20260619 18:45:51.305872 12675 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 107777us
W20260619 18:45:51.353718 12466 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.279203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51612 (local address 127.6.120.254:36501)
0619 18:45:48.494731 (+1215528us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.494771 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.494837 (+ 66us) server_negotiation.cc:407] Connection header received
0619 18:45:48.497330 (+ 2493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.500583 (+ 3253us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.510378 (+ 9795us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.510615 (+ 237us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:51.220167 (+2709552us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51612: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":947317,"server-negotiator.queue_time_us":1210663}
W20260619 18:45:51.452667 12632 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.197585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51584 (local address 127.6.120.254:36501)
0619 18:45:48.315800 (+1118215us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.315843 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.315904 (+ 61us) server_negotiation.cc:407] Connection header received
0619 18:45:48.316059 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.316083 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.316420 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.316645 (+ 225us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:51.228407 (+2911762us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51584: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1221658,"server-negotiator.queue_time_us":1100763}
W20260619 18:45:51.494021 12490 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.865544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51402 (local address 127.6.120.254:36501)
0619 18:45:47.439103 (+573559us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.439133 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.439192 (+ 59us) server_negotiation.cc:407] Connection header received
0619 18:45:47.439330 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.439354 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.439592 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.440266 (+ 674us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.701255 (+260989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.703248 (+ 1993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.923891 (+220643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.168684 (+244793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.301342 (+132658us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:51.385379 (+3084037us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51402: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2376815,"server-negotiator.queue_time_us":573118}
W20260619 18:45:51.946367 12485 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.177770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51558)
0619 18:45:47.199466 (+ 21696us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.200099 (+ 633us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.216270 (+ 16171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.062377 (+846107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.063711 (+ 1334us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.076689 (+ 12978us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:50.669519 (+2592830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:50.669616 (+ 97us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.374986 (+705370us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":498,"mutex_wait_us":3134998}
W20260619 18:45:51.528645 12570 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.659132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51320 (local address 127.6.120.254:36501)
0619 18:45:47.241836 (+582704us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.241866 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.241914 (+ 48us) server_negotiation.cc:407] Connection header received
0619 18:45:47.242057 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.242084 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.242339 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.250635 (+ 8296us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.353540 (+102905us) spinlock_profiling.cc:243] Waited 5 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:47.477131 (+123591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.724471 (+247340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.707844 (+983373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:50.582163 (+1874319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:51.375191 (+793028us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51320: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2934460,"server-negotiator.queue_time_us":582339,"spinlock_wait_cycles":11501440}
W20260619 18:45:51.543299 12568 meta_cache.cc:1097] Time spent processing table locations response: real 0.052s user 0.000s sys 0.001s
W20260619 18:45:51.946071 12014 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.180469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51558 (local address 127.6.120.254:36501)
0619 18:45:48.014915 (+834446us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.014953 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.014999 (+ 46us) server_negotiation.cc:407] Connection header received
0619 18:45:48.015125 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.015149 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.041595 (+ 26446us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:48.050566 (+ 8971us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.059662 (+ 9096us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:51.421658 (+3361996us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51558: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1397802,"server-negotiator.queue_time_us":830288,"spinlock_wait_cycles":10105216}
W20260619 18:45:51.959080 12413 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.856435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51392 (local address 127.6.120.254:36501)
0619 18:45:47.408810 (+552375us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.409497 (+ 687us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.410867 (+ 1370us) server_negotiation.cc:407] Connection header received
0619 18:45:47.412630 (+ 1763us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.413167 (+ 537us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.418156 (+ 4989us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.418350 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.765164 (+346814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.767185 (+ 2021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.673717 (+906532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:50.597262 (+1923545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:51.489678 (+892416us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51392: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2808882,"server-negotiator.queue_time_us":545953}
W20260619 18:45:51.959483 12444 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.176054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51544)
0619 18:45:47.176953 (+ 899us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.177001 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.177240 (+ 239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.006657 (+829417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.006691 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.006816 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:48.017306 (+ 10490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.017367 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.520522 (+3503155us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":393,"mutex_wait_us":1022681}
W20260619 18:45:51.959347 12215 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 3.35848e+06us
W20260619 18:45:51.948776 12681 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:45.829112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51136)
0619 18:45:45.879879 (+ 50767us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:45.879948 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:45.880267 (+ 319us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:46.709602 (+829335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:46.711323 (+ 1721us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:46.726433 (+ 15110us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.082383 (+355950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.082471 (+ 88us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.390698 (+308227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.390743 (+ 45us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.754352 (+363609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.754411 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.827564 (+ 73153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.827619 (+ 55us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.584869 (+757250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:49.956574 (+1371705us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:49.956616 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:49.956686 (+ 70us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:50.028491 (+ 71805us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:51.319169 (+1290678us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":8767,"mutex_wait_us":3950838}
W20260619 18:45:51.958336 12492 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.842553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51378)
0619 18:45:46.843141 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.843198 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.843495 (+ 297us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.403884 (+560389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.403918 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.404047 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.497233 (+ 93186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.498912 (+ 1679us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.084535 (+585623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.085925 (+ 1390us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:49.605441 (+1519516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:49.605521 (+ 80us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.364649 (+1759128us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":123,"mutex_wait_us":2954713}
W20260619 18:45:51.974258 12583 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.310940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51614)
0619 18:45:47.312718 (+ 1778us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.312766 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.313120 (+ 354us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.577804 (+1264684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.577839 (+ 35us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.577994 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:51.072234 (+2494240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:51.074657 (+ 2423us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.518006 (+443349us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1123,"mutex_wait_us":2861189}
W20260619 18:45:51.975291 12549 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.195814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51584)
0619 18:45:47.207411 (+ 11597us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.207465 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.207803 (+ 338us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.318948 (+1111145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.318984 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.320777 (+ 1793us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:51.205157 (+2884380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:51.208100 (+ 2943us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.411271 (+203171us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":4504,"mutex_wait_us":2636189}
W20260619 18:45:51.975899 12507 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.148708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51530)
0619 18:45:47.168774 (+ 20066us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.168831 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.169092 (+ 261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.032560 (+863468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.034323 (+ 1763us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.045937 (+ 11614us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:48.746754 (+700817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.746813 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.483326 (+2736513us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":13692,"mutex_wait_us":1922823}
W20260619 18:45:51.893493 12246 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 3.11683e+06us
W20260619 18:45:51.979508 12431 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.944864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51464)
0619 18:45:46.947668 (+ 2804us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.947718 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.947971 (+ 253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.586403 (+638432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.586443 (+ 40us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.586590 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.954329 (+367739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.954426 (+ 97us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.510909 (+556483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.510950 (+ 41us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.944443 (+433493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.944518 (+ 75us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.428842 (+2484324us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1558,"mutex_wait_us":2129840}
W20260619 18:45:51.979182 12558 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.899184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51414 (local address 127.6.120.254:36501)
0619 18:45:47.454538 (+555354us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.454571 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.454619 (+ 48us) server_negotiation.cc:407] Connection header received
0619 18:45:47.454745 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.454775 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.455086 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.455266 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:48.006723 (+551457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:49.543765 (+1537042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:51.433630 (+1889865us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51414: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2882626,"server-negotiator.queue_time_us":554945}
W20260619 18:45:52.016952 12612 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.457797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51762 (local address 127.6.120.254:36501)
0619 18:45:48.577916 (+1120119us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.577948 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.577994 (+ 46us) server_negotiation.cc:407] Connection header received
0619 18:45:48.578112 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.578139 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.578387 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.578568 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:52.007697 (+3429129us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51762: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1680342,"server-negotiator.queue_time_us":1110490}
W20260619 18:45:52.018116 12863 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.096325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48634 (local address 127.6.120.193:37901)
0619 18:45:48.422795 (+326470us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.422832 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.429921 (+ 7089us) server_negotiation.cc:407] Connection header received
0619 18:45:48.479569 (+ 49648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.482999 (+ 3430us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.506555 (+ 23556us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.518516 (+ 11961us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:52.011869 (+3493353us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48634: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":843652,"server-negotiator.queue_time_us":316764,"thread_start_us":200521,"threads_started":1}
W20260619 18:45:52.031988 12636 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.674286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51808 (local address 127.6.120.254:36501)
0619 18:45:49.710829 (+2036543us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:49.711812 (+ 983us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:49.714131 (+ 2319us) server_negotiation.cc:407] Connection header received
0619 18:45:49.756252 (+ 42121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:49.764358 (+ 8106us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:49.784888 (+ 20530us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:49.785156 (+ 268us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:51.503314 (+1718158us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51808: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1631424,"server-negotiator.queue_time_us":1941537}
W20260619 18:45:52.027776 12244 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 1.08619e+06us
W20260619 18:45:52.035535 12782 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.533554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51308)
0619 18:45:46.866675 (+333121us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.867526 (+ 851us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.894767 (+ 27241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.256004 (+361237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.256053 (+ 49us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.256260 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.400285 (+144025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.400344 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.734987 (+334643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.735044 (+ 57us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.572699 (+837655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.572760 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.585980 (+ 13220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.595252 (+ 9272us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.744263 (+149011us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:48.753795 (+ 9532us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:48.761023 (+ 7228us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:48.763466 (+ 2443us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:48.785543 (+ 22077us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:51.427555 (+2642012us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":282333,"mutex_wait_us":2742444,"thread_start_us":250859,"threads_started":1}
W20260619 18:45:52.160720 11039 thread.cc:636] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.801s user 0.000s sys 0.028s
W20260619 18:45:52.035413 12585 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.447871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51750 (local address 127.6.120.254:36501)
0619 18:45:48.576148 (+1128277us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.578699 (+ 2551us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.578749 (+ 50us) server_negotiation.cc:407] Connection header received
0619 18:45:48.578884 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.578912 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.579153 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.579329 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:51.583307 (+3003978us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51750: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2018149,"server-negotiator.queue_time_us":1092121}
W20260619 18:45:52.066476 12796 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.004130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51474)
0619 18:45:47.144915 (+140785us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.145021 (+ 106us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.145315 (+ 294us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.613674 (+468359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.613708 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.613845 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:48.565047 (+951202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.565128 (+ 81us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.358685 (+2793557us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":134422,"mutex_wait_us":2167318,"thread_start_us":54374,"threads_started":1}
W20260619 18:45:52.311661 12591 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.750825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51346 (local address 127.6.120.254:36501)
0619 18:45:47.337459 (+586634us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.338332 (+ 873us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.339331 (+ 999us) server_negotiation.cc:407] Connection header received
0619 18:45:47.347584 (+ 8253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.348617 (+ 1033us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.360137 (+ 11520us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.362364 (+ 2227us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.376008 (+ 13644us) spinlock_profiling.cc:243] Waited 6.41 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:47.572292 (+196284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.705095 (+132803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.746580 (+1041485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:49.624511 (+877931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:49.624823 (+ 312us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:51.354382 (+1729559us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51346: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2657704,"server-negotiator.queue_time_us":550068,"spinlock_wait_cycles":14751104}
W20260619 18:45:52.677279 12722 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.442939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51750)
0619 18:45:47.446851 (+ 3912us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.446905 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.448450 (+ 1545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.597858 (+1149408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.599435 (+ 1577us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.611211 (+ 11776us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:51.442125 (+2830914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:51.446400 (+ 4275us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.005419 (+559019us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1922,"mutex_wait_us":3311057}
W20260619 18:45:52.312996 12203 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 1.72896e+06us
W20260619 18:45:52.313571 12410 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.797026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51358)
0619 18:45:46.822547 (+ 25521us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.822617 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.825037 (+ 2420us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.325335 (+500298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.325372 (+ 37us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.325509 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.494375 (+168866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.496036 (+ 1661us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.863450 (+367414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.863500 (+ 50us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.893944 (+ 30444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.894002 (+ 58us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.078825 (+184823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.081139 (+ 2314us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.612845 (+531706us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:49.713752 (+1100907us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:49.713785 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:49.755172 (+ 41387us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:49.780143 (+ 24971us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:51.357906 (+1577763us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":5558,"mutex_wait_us":3137165}
W20260619 18:45:52.314227 12584 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.864550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51402)
0619 18:45:46.919628 (+ 55078us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.921350 (+ 1722us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.932482 (+ 11132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.439971 (+507489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.440004 (+ 33us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.440159 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.456684 (+ 16525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.456754 (+ 70us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.705511 (+248757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.705551 (+ 40us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.923536 (+217985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.923612 (+ 76us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.171733 (+248121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.171778 (+ 45us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:49.559958 (+1388180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:50.537865 (+977907us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:50.537905 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:50.537966 (+ 61us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:50.538112 (+ 146us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:51.322738 (+784626us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":2050,"mutex_wait_us":3150031}
W20260619 18:45:52.311789 12882 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.884s user 0.008s sys 0.016s
W20260619 18:45:52.312449 12557 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.930570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51454 (local address 127.6.120.254:36501)
0619 18:45:47.579370 (+648800us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.580770 (+ 1400us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.582024 (+ 1254us) server_negotiation.cc:407] Connection header received
0619 18:45:47.586880 (+ 4856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.586911 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.587181 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.587361 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.780651 (+193290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.128990 (+348339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:51.506762 (+3377772us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51454: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1918926,"server-negotiator.queue_time_us":614437}
W20260619 18:45:52.313589 12569 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.780619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51358 (local address 127.6.120.254:36501)
0619 18:45:47.319782 (+539163us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.319834 (+ 52us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.319894 (+ 60us) server_negotiation.cc:407] Connection header received
0619 18:45:47.320041 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.320073 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.320512 (+ 439us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.320722 (+ 210us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.371367 (+ 50645us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:47.498762 (+127395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.863002 (+364240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.899138 (+ 36136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.071101 (+171963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.565470 (+494369us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:51.419884 (+2854414us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51358: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2759294,"server-negotiator.queue_time_us":524071,"spinlock_wait_cycles":3104000}
W20260619 18:45:52.311836 12537 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.857148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51398)
0619 18:45:46.857728 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.857778 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.858049 (+ 271us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.417875 (+559826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.417910 (+ 35us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.418031 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.426124 (+ 8093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.426181 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.729419 (+303238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.729487 (+ 68us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.332036 (+602549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.337286 (+ 5250us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.746095 (+408809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.746142 (+ 47us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:49.559857 (+813715us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:50.394402 (+834545us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:50.394440 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:50.394505 (+ 65us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:50.394685 (+ 180us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:51.321308 (+926623us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":2966827}
W20260619 18:45:52.311578 12910 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.621s user 0.000s sys 0.012s
W20260619 18:45:52.159268 12902 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.742s user 0.009s sys 0.023s
W20260619 18:45:52.304457 12295 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.775s user 0.006s sys 0.010s
W20260619 18:45:52.312749 12185 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.932444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51454)
0619 18:45:46.950352 (+ 17908us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.950402 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.950647 (+ 245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.587570 (+636923us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.587634 (+ 64us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.587766 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.764764 (+176998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.764832 (+ 68us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.133032 (+368200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.135546 (+ 2514us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:51.974012 (+3838466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:51.974080 (+ 68us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.028842 (+ 54762us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":9263,"mutex_wait_us":3784420}
W20260619 18:45:52.506320 12936 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.659s user 0.008s sys 0.034s
W20260619 18:45:52.320426 11039 thread.cc:602] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.962s user 0.002s sys 0.035s
W20260619 18:45:52.067296 12743 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 1.01909e+06us
W20260619 18:45:52.132083 12650 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 3.477e+06us
W20260619 18:45:52.667572 12903 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.902s user 0.021s sys 0.022s
W20260619 18:45:52.840509 12604 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.475056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51776 (local address 127.6.120.254:36501)
0619 18:45:48.707662 (+1232606us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.707711 (+ 49us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.707762 (+ 51us) server_negotiation.cc:407] Connection header received
0619 18:45:48.712167 (+ 4405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.721976 (+ 9809us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.729390 (+ 7414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.736155 (+ 6765us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:52.027677 (+3291522us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51776: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":3217021,"server-negotiator.queue_time_us":1232139}
W20260619 18:45:52.679486 12577 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.077001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51828 (local address 127.6.120.254:36501)
0619 18:45:49.677757 (+1600756us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:49.695970 (+ 18213us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:49.697939 (+ 1969us) server_negotiation.cc:407] Connection header received
0619 18:45:49.709833 (+ 11894us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:49.710526 (+ 693us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:49.780635 (+ 70109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:49.780965 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:52.006946 (+2225981us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51828: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2172790,"server-negotiator.queue_time_us":1542720}
W20260619 18:45:52.311596 12603 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.042559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51518 (local address 127.6.120.254:36501)
0619 18:45:47.828720 (+786161us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.828752 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.828806 (+ 54us) server_negotiation.cc:407] Connection header received
0619 18:45:47.828928 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.828957 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.830557 (+ 1600us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.830781 (+ 224us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:48.039052 (+208271us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:48.250557 (+211505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.769370 (+518813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.786821 (+ 17451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:49.620931 (+834110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:49.621365 (+ 434us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:51.421543 (+1800178us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51518: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":3355795,"server-negotiator.queue_time_us":743085,"spinlock_wait_cycles":5301120}
W20260619 18:45:52.696477 12536 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.743651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51898 (local address 127.6.120.254:36501)
0619 18:45:50.521193 (+1777542us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:50.521227 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:50.521279 (+ 52us) server_negotiation.cc:407] Connection header received
0619 18:45:50.521435 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:50.521461 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:50.521727 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:50.524629 (+ 2902us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:52.029070 (+1504441us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51898: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1257937,"server-negotiator.queue_time_us":1777140}
W20260619 18:45:52.313001 12860 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.869s user 0.016s sys 0.048s
W20260619 18:45:52.842000 12910 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.160s user 0.004s sys 0.021s
W20260619 18:45:52.806893 12852 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.006028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48620)
0619 18:45:48.274478 (+268450us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:48.274537 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:48.274874 (+ 337us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.277042 (+ 2168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.277092 (+ 50us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.277159 (+ 67us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:48.836595 (+559436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.836662 (+ 67us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.584291 (+2747629us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":267955,"mutex_wait_us":847002,"thread_start_us":267559,"threads_started":1}
W20260619 18:45:52.853554 12936 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.196s user 0.017s sys 0.034s
W20260619 18:45:52.852501 12902 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.435s user 0.024s sys 0.031s
W20260619 18:45:52.853250 12441 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.160320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51536)
0619 18:45:47.168529 (+ 8209us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.168596 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.168884 (+ 288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.976795 (+807911us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.980568 (+ 3773us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.995151 (+ 14583us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:49.545505 (+1550354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:49.548012 (+ 2507us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.010861 (+2462849us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":2412,"mutex_wait_us":2975622}
W20260619 18:45:52.856813 12295 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.325s user 0.011s sys 0.018s
W20260619 18:45:52.841259 12882 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.422s user 0.012s sys 0.031s
W20260619 18:45:52.449874 12143 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.703s user 0.007s sys 0.022s
W20260619 18:45:52.508347 12925 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.822s user 0.001s sys 0.021s
W20260619 18:45:52.734380 12812 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.184870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51572)
0619 18:45:47.364973 (+180103us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.365048 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.365378 (+ 330us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.159184 (+793806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.159248 (+ 64us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.166335 (+ 7087us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:50.590371 (+2424036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:50.590456 (+ 85us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.551014 (+960558us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":161276,"mutex_wait_us":2544007,"thread_start_us":117455,"threads_started":1}
W20260619 18:45:52.852221 12908 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.076s user 0.015s sys 0.015s
W20260619 18:45:52.866066 12860 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.426s user 0.021s sys 0.057s
W20260619 18:45:52.870628 12903 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.442s user 0.024s sys 0.028s
W20260619 18:45:52.471422 12232 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 1.8718e+06us
W20260619 18:45:52.887077 12143 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.376s user 0.012s sys 0.028s
W20260619 18:45:52.894657 12925 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.413s user 0.004s sys 0.029s
W20260619 18:45:53.086841 11040 thread.cc:636] server-negotiator [worker] (thread pool) Time spent creating pthread: real 1.535s user 0.000s sys 0.044s
W20260619 18:45:53.118947 11040 thread.cc:602] server-negotiator [worker] (thread pool) Time spent starting thread: real 1.575s user 0.000s sys 0.045s
W20260619 18:45:53.106154 12589 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.038658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51496 (local address 127.6.120.254:36501)
0619 18:45:47.663154 (+624496us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.663203 (+ 49us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.663292 (+ 89us) server_negotiation.cc:407] Connection header received
0619 18:45:47.663474 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.663513 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.685850 (+ 22337us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:47.686125 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.686379 (+ 254us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:48.159215 (+472836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.725621 (+566406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:51.984848 (+3259227us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51496: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2666989,"server-negotiator.queue_time_us":618399,"spinlock_wait_cycles":5857536}
W20260619 18:45:52.910290 12613 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.237833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51830 (local address 127.6.120.254:36501)
0619 18:45:49.622062 (+1384229us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:49.622096 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:49.622146 (+ 50us) server_negotiation.cc:407] Connection header received
0619 18:45:49.622272 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:49.622298 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:49.622557 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:49.622748 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:52.007141 (+2384393us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51830: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2155443,"server-negotiator.queue_time_us":1383822}
W20260619 18:45:53.099769 12834 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.641007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48562)
0619 18:45:47.679425 (+ 38418us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.679490 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.680011 (+ 521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.689692 (+ 9681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.689748 (+ 56us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.689851 (+ 103us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:48.128391 (+438540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.129367 (+ 976us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.776276 (+646909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.776318 (+ 42us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.778953 (+ 2635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.779035 (+ 82us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.571344 (+3792309us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":37847,"mutex_wait_us":2242891,"thread_start_us":37462,"threads_started":1}
I20260619 18:45:52.952821 12131 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:52.941494 12908 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.643s user 0.017s sys 0.021s
W20260619 18:45:52.872411 12765 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 411655us
W20260619 18:45:53.054596 12780 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 45258.8us
W20260619 18:45:53.140491 12596 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.681986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51860 (local address 127.6.120.254:36501)
0619 18:45:49.624175 (+942189us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:49.624208 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:49.624257 (+ 49us) server_negotiation.cc:407] Connection header received
0619 18:45:49.624384 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:49.624432 (+ 48us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:49.624755 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:49.624968 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:52.058379 (+2433411us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51860: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1936408,"server-negotiator.queue_time_us":941770}
W20260619 18:45:53.142879 12131 scanner-internal.cc:458] Time spent opening tablet: real 5.305s user 0.008s sys 0.017s
W20260619 18:45:53.211259 12477 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.963471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48592)
0619 18:45:47.967141 (+ 3670us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.975722 (+ 8581us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.992981 (+ 17259us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.069456 (+ 76475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.071231 (+ 1775us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.077808 (+ 6577us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:48.768814 (+691006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.768891 (+ 77us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.319131 (+3550240us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":460,"mutex_wait_us":1758211}
W20260619 18:45:53.211987 12516 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.660798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51844 (local address 127.6.120.254:36501)
0619 18:45:49.622909 (+962111us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:49.622939 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:49.622984 (+ 45us) server_negotiation.cc:407] Connection header received
0619 18:45:49.623102 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:49.623132 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:49.623354 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:49.623547 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:52.060237 (+2436690us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51844: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1287213,"server-negotiator.queue_time_us":961682}
W20260619 18:45:53.211934 12883 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.539169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48660)
0619 18:45:48.776810 (+237641us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:48.776880 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:48.777308 (+ 428us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.812077 (+ 34769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.813502 (+ 1425us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.826514 (+ 13012us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:49.618762 (+792248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:49.618819 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.643266 (+3024447us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":223373,"mutex_wait_us":1880556,"thread_start_us":31476,"threads_started":1}
W20260619 18:45:53.159781 12533 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:45.829898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51154)
0619 18:45:45.837344 (+ 7446us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:45.837401 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:45.837667 (+ 266us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:46.770457 (+932790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:46.772247 (+ 1790us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:46.782836 (+ 10589us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.012622 (+229786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.012684 (+ 62us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.343920 (+331236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.343971 (+ 51us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.829403 (+485432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.830036 (+ 633us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.500785 (+670749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.505184 (+ 4399us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:50.477540 (+1972356us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:50.854194 (+376654us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:50.854238 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:50.854338 (+ 100us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:50.854509 (+ 171us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:52.410267 (+1555758us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1494,"mutex_wait_us":4336450}
I20260619 18:45:53.212530 12160 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:53.213650 12160 scanner-internal.cc:458] Time spent opening tablet: real 5.458s user 0.004s sys 0.007s
W20260619 18:45:53.189616 12194 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.471335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51776)
0619 18:45:47.483928 (+ 12593us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.483981 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.484237 (+ 256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.736468 (+1252231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.736505 (+ 37us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.736637 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:51.587457 (+2850820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:51.587559 (+ 102us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.313277 (+725718us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1067,"mutex_wait_us":3517954}
W20260619 18:45:53.214177 12560 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.643106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51806 (local address 127.6.120.254:36501)
0619 18:45:49.604270 (+1961164us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:49.604321 (+ 51us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:49.604382 (+ 61us) server_negotiation.cc:407] Connection header received
0619 18:45:49.604540 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:49.604570 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:49.604865 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:49.605117 (+ 252us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:53.140739 (+3535622us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51806: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":3322318,"server-negotiator.queue_time_us":1958362}
W20260619 18:45:53.221966 12480 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.979413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48592 (local address 127.6.120.193:37901)
0619 18:45:48.027680 (+ 48267us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.029478 (+ 1798us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.032307 (+ 2829us) server_negotiation.cc:407] Connection header received
0619 18:45:48.036416 (+ 4109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.039325 (+ 2909us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.060885 (+ 21560us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.068005 (+ 7120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:48.769694 (+701689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.066380 (+2296686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:52.174767 (+1108387us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48592: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":3429155,"server-negotiator.queue_time_us":550}
I20260619 18:45:53.214730 12140 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:45:53.225353 12140 scanner-internal.cc:458] Time spent opening tablet: real 4.986s user 0.015s sys 0.013s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:45:53.226015 12897 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.681095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51860)
0619 18:45:49.260276 (+579181us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:49.260351 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:49.260742 (+ 391us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:49.625054 (+364312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:49.625083 (+ 29us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:49.625207 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:52.483561 (+2858354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.502931 (+ 19370us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.972430 (+469499us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":578517,"mutex_wait_us":1962615,"thread_start_us":130716,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:45:53.227764 12463 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.140464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51212)
0619 18:45:46.141083 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.141135 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.141397 (+ 262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:46.848668 (+707271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:46.850210 (+ 1542us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:46.853229 (+ 3019us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.090940 (+237711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.091022 (+ 82us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.406514 (+315492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.406560 (+ 46us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.815425 (+408865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.824302 (+ 8877us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.925231 (+100929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.925275 (+ 44us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:49.897670 (+1972395us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:50.393906 (+496236us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:50.396240 (+ 2334us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:50.475216 (+ 78976us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:50.492173 (+ 16957us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:52.625046 (+2132873us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":5060776}
W20260619 18:45:53.230937 12501 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.041448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51518)
0619 18:45:47.042152 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.042212 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.042495 (+ 283us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.836182 (+793687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.836217 (+ 35us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.836367 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:48.169343 (+332976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.170477 (+ 1134us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.772830 (+602353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.772866 (+ 36us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.774929 (+ 2063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.774981 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:49.623309 (+848328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:49.815350 (+192041us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:51.073279 (+1257929us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:51.119276 (+ 45997us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:51.119315 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:51.119397 (+ 82us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:51.119577 (+ 180us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:52.447281 (+1327704us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":2809965}
W20260619 18:45:53.213912 12572 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.801477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51370)
0619 18:45:46.827347 (+ 25870us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.827398 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.827609 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.362599 (+534990us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.365375 (+ 2776us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.365563 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.454908 (+ 89345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.454969 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.957464 (+502495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.957523 (+ 59us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.711246 (+753723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.711310 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.785238 (+ 73928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.785298 (+ 60us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:50.223562 (+1438264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:50.473179 (+249617us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:50.473214 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:50.473278 (+ 64us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:50.476312 (+ 3034us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:52.850967 (+2374655us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":3875,"mutex_wait_us":4500243}
W20260619 18:45:53.234117 12898 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.721339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48664)
0619 18:45:49.813596 (+1092257us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b18002fd100. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f138cce98b1 00007f138ccf6661 00007f1383e56638 00007f1383e59b11 00007f1383e59ac9 00007f1383e59a59 00007f1383e59a21 00007f1383e58d1d 00007f138d0ae204 00007f138d0ae039 00007f1383e38dc6
0619 18:45:49.815571 (+ 1975us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:49.815612 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:49.815942 (+ 330us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:49.825784 (+ 9842us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:49.837387 (+ 11603us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:49.844726 (+ 7339us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:52.432545 (+2587819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.432606 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.159163 (+726557us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":829344,"mutex_wait_us":3092159,"spinlock_wait_cycles":5378304,"thread_start_us":826327,"threads_started":1}
I20260619 18:45:53.234754 12158 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:53.235225 12158 scanner-internal.cc:458] Time spent opening tablet: real 4.946s user 0.014s sys 0.009s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:53.236454 12752 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.662629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48570 (local address 127.6.120.193:37901)
0619 18:45:47.665634 (+ 3005us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.665669 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.665717 (+ 48us) server_negotiation.cc:407] Connection header received
0619 18:45:47.665871 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.665898 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.683780 (+ 17882us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.686031 (+ 2251us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:48.004455 (+318424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.660959 (+656504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:49.621543 (+960584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:49.622593 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:49.623005 (+ 412us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:52.138730 (+2515725us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48570: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2745492,"server-negotiator.queue_time_us":2476}
W20260619 18:45:53.236831 12862 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.099229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48634)
0619 18:45:48.413547 (+314318us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:48.423598 (+ 10051us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:48.459153 (+ 35555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.520538 (+ 61385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.521861 (+ 1323us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.527651 (+ 5790us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:51.418609 (+2890958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:51.418669 (+ 60us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.137558 (+718889us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":250928,"mutex_wait_us":3475554,"thread_start_us":157714,"threads_started":1}
W20260619 18:45:53.237031 12182 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.566246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51790 (local address 127.6.120.254:36501)
0619 18:45:48.948491 (+1382245us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.948537 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.948608 (+ 71us) server_negotiation.cc:407] Connection header received
0619 18:45:48.948778 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.948814 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.949155 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.949372 (+ 217us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:52.877159 (+3927787us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51790: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":3891669,"server-negotiator.queue_time_us":1270994}
W20260619 18:45:53.237663 12961 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.503s user 0.001s sys 0.012s
W20260619 18:45:53.220890 12592 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.194061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51594)
0619 18:45:47.207961 (+ 13900us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.209342 (+ 1381us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.210145 (+ 803us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.312279 (+1102134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.315318 (+ 3039us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.326489 (+ 11171us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:48.786401 (+459912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.786467 (+ 66us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.211847 (+3425380us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":991,"mutex_wait_us":2433485}
W20260619 18:45:53.224881 12464 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.374262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51286)
0619 18:45:46.375016 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.375063 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.375297 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.163651 (+788354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.164748 (+ 1097us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.169098 (+ 4350us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.284309 (+115211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.285410 (+ 1101us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.735091 (+449681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.735138 (+ 47us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.836794 (+101656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.836865 (+ 71us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.215251 (+378386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.216234 (+ 983us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:50.203765 (+1987531us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:50.537139 (+333374us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:50.537183 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:50.537263 (+ 80us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:50.537446 (+ 183us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:52.605822 (+2068376us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":336,"mutex_wait_us":4344163}
W20260619 18:45:53.223666 12777 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.399611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51296)
0619 18:45:46.461057 (+ 61446us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.461122 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.461375 (+ 253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.241792 (+780417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.241843 (+ 51us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.242027 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.244402 (+ 2375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.244452 (+ 50us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.482146 (+237694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.482202 (+ 56us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.090383 (+608181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.092896 (+ 2513us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.671145 (+578249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.671191 (+ 46us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.856598 (+185407us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:50.164513 (+1307915us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:50.164553 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:50.164628 (+ 75us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:50.164808 (+ 180us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:52.474520 (+2309712us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":60878,"mutex_wait_us":4230523,"thread_start_us":53307,"threads_started":1}
W20260619 18:45:53.161742 12956 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.654s user 0.000s sys 0.013s
I20260619 18:45:53.242122 12529 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:53.236479 12719 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.177199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51546)
0619 18:45:47.204869 (+ 27670us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.208006 (+ 3137us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.218259 (+ 10253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.126834 (+908575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.128172 (+ 1338us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.137470 (+ 9298us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:49.843676 (+1706206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:49.897149 (+ 53473us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.216267 (+2319118us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1027,"mutex_wait_us":3638750}
W20260619 18:45:53.246960 12590 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.892309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51410)
0619 18:45:46.923957 (+ 31648us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.929037 (+ 5080us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.946880 (+ 17843us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.454061 (+507181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.454102 (+ 41us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.454231 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.516394 (+ 62163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.516486 (+ 92us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.051443 (+534957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.056377 (+ 4934us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.831951 (+775574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.833706 (+ 1755us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.028833 (+3195127us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1762,"mutex_wait_us":2671054}
W20260619 18:45:53.249414 12645 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.834672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51822 (local address 127.6.120.254:36501)
0619 18:45:49.616571 (+1781899us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:49.616605 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:49.616665 (+ 60us) server_negotiation.cc:407] Connection header received
0619 18:45:49.616792 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:49.616818 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:49.617138 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:49.625714 (+ 8576us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:52.485967 (+2860253us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51822: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2803667,"server-negotiator.queue_time_us":1781506}
W20260619 18:45:53.249554 12631 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.734494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51884)
0619 18:45:48.736916 (+ 2422us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:48.736965 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:48.737273 (+ 308us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:50.597625 (+1860352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:50.597677 (+ 52us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:50.597795 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:51.695427 (+1097632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:51.695489 (+ 62us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.319066 (+623577us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1984,"mutex_wait_us":1549896}
W20260619 18:45:53.643301 12893 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.661787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48664 (local address 127.6.120.193:37901)
0619 18:45:48.838429 (+176642us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.859905 (+ 21476us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:49.815739 (+955834us) server_negotiation.cc:407] Connection header received
0619 18:45:49.816229 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:49.816263 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:49.816645 (+ 382us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:49.816864 (+ 219us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:52.972560 (+3155696us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48664: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2948066,"server-negotiator.queue_time_us":71897,"thread_start_us":28492,"threads_started":1}
W20260619 18:45:53.643088 12545 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 355368us
W20260619 18:45:53.266253 12523 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.009025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51490 (local address 127.6.120.254:36501)
0619 18:45:47.651813 (+642788us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.651848 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.651896 (+ 48us) server_negotiation.cc:407] Connection header received
0619 18:45:47.652026 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.652052 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.652351 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.658074 (+ 5723us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:48.061756 (+403682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.750974 (+689218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:52.319010 (+3568036us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51490: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":3002806,"server-negotiator.queue_time_us":642393}
W20260619 18:45:53.643080 12899 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.742638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51898)
0619 18:45:49.705550 (+962912us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:49.710109 (+ 4559us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:49.764480 (+ 54371us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:50.525219 (+760739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:50.533176 (+ 7957us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:50.562981 (+ 29805us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:51.986159 (+1423178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:51.993035 (+ 6876us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.950004 (+956969us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":844117,"mutex_wait_us":1881486,"thread_start_us":304578,"threads_started":1}
W20260619 18:45:53.261897 12573 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.184164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51566)
0619 18:45:47.216045 (+ 31881us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.217423 (+ 1378us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.229923 (+ 12500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.403440 (+1173517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.406267 (+ 2827us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.406452 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:51.413261 (+3006809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:51.418036 (+ 4775us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.367139 (+949103us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1061,"mutex_wait_us":3780437}
W20260619 18:45:53.252555 12961 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.627s user 0.001s sys 0.013s
W20260619 18:45:53.656814 12849 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.986317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48604 (local address 127.6.120.193:37901)
0619 18:45:48.008323 (+ 22006us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.008369 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.468685 (+460316us) server_negotiation.cc:407] Connection header received
0619 18:45:48.483364 (+ 14679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.488208 (+ 4844us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.564487 (+ 76279us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b4800081e18. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f138cd02aa0 00007f138cceb061 00007f1388974dbb 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:48.570340 (+ 5853us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.581980 (+ 11640us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:52.174378 (+3592398us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48604: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":3424367,"server-negotiator.queue_time_us":21479,"spinlock_wait_cycles":4084608,"thread_start_us":8337,"threads_started":1}
W20260619 18:45:53.657222 12513 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.654816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48570)
0619 18:45:47.655964 (+ 1148us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.656017 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.656360 (+ 343us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.686324 (+ 29964us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.686371 (+ 47us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.686525 (+ 154us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:47.761350 (+ 74825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.761464 (+ 114us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.669863 (+908399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.669905 (+ 42us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:49.619528 (+949623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:49.619598 (+ 70us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:49.697841 (+ 78243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:49.698818 (+ 977us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:51.696614 (+1997796us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:51.696945 (+ 331us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 18:45:52.509335 (+812390us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":640,"mutex_wait_us":3707355}
W20260619 18:45:53.626446 12556 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.002332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51474 (local address 127.6.120.254:36501)
0619 18:45:47.592533 (+590201us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.593388 (+ 855us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.594150 (+ 762us) server_negotiation.cc:407] Connection header received
0619 18:45:47.603426 (+ 9276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.603466 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.606347 (+ 2881us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.612655 (+ 6308us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:48.565563 (+952908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.283368 (+2717805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:52.444777 (+1161409us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51474: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":3924590,"server-negotiator.queue_time_us":549277}
W20260619 18:45:53.640965 12535 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.176220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51544 (local address 127.6.120.254:36501)
0619 18:45:48.004805 (+828585us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.004838 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.004888 (+ 50us) server_negotiation.cc:407] Connection header received
0619 18:45:48.005825 (+ 937us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.005854 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.006140 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.006351 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:48.496276 (+489925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.529120 (+3032844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:52.320911 (+791791us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51544: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":4191401,"server-negotiator.queue_time_us":828146}
W20260619 18:45:53.648370 12956 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.193s user 0.000s sys 0.014s
W20260619 18:45:53.650801 12146 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.719s user 0.004s sys 0.015s
W20260619 18:45:53.658581 12432 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.017964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51496)
0619 18:45:47.050959 (+ 32995us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.051018 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.051331 (+ 313us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.686697 (+635366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.686745 (+ 48us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.686895 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:48.148049 (+461154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.156478 (+ 8429us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.729711 (+573233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.731624 (+ 1913us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:50.599835 (+1868211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:50.599910 (+ 75us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.612551 (+2012641us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":5585,"mutex_wait_us":3587080}
W20260619 18:45:53.657408 12242 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 353433us
W20260619 18:45:53.676364 12411 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.841705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51378 (local address 127.6.120.254:36501)
0619 18:45:47.400983 (+559278us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.401018 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.401074 (+ 56us) server_negotiation.cc:407] Connection header received
0619 18:45:47.401224 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.401252 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.401526 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.401722 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.502865 (+101143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.083114 (+580249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:49.607657 (+1524543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.992750 (+2385093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:52.486683 (+493933us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51378: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":3394797,"server-negotiator.queue_time_us":558867}
W20260619 18:45:53.661947 12529 scanner-internal.cc:458] Time spent opening tablet: real 5.777s user 0.005s sys 0.011s
W20260619 18:45:53.658210 12920 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.873s user 0.025s sys 0.011s
W20260619 18:45:53.665093 12838 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.731205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48580 (local address 127.6.120.193:37901)
0619 18:45:47.982121 (+250916us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.982166 (+ 45us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.985554 (+ 3388us) server_negotiation.cc:407] Connection header received
0619 18:45:48.002578 (+ 17024us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.003482 (+ 904us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.026572 (+ 23090us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.032883 (+ 6311us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:48.098762 (+ 65879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.933626 (+834864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:52.130877 (+3197251us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48580: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2106371,"server-negotiator.queue_time_us":178299,"thread_start_us":98170,"threads_started":1}
W20260619 18:45:53.684851 12648 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.147353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51536 (local address 127.6.120.254:36501)
0619 18:45:47.949448 (+802095us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.949486 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.949552 (+ 66us) server_negotiation.cc:407] Connection header received
0619 18:45:47.949709 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.949742 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.961435 (+ 11693us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.966408 (+ 4973us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:48.037936 (+ 71528us) spinlock_profiling.cc:243] Waited 4.87 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:49.553137 (+1515201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.133270 (+2580133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:52.643039 (+509769us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51536: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":3046509,"server-negotiator.queue_time_us":801619,"spinlock_wait_cycles":11197696}
W20260619 18:45:53.713881 12914 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:49.587296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48690 (local address 127.6.120.193:37901)
0619 18:45:50.497913 (+910617us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:50.497940 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:50.556692 (+ 58752us) server_negotiation.cc:407] Connection header received
0619 18:45:50.557186 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:50.557239 (+ 53us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:50.557687 (+ 448us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:50.557945 (+ 258us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:53.147626 (+2589681us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48690: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1833052,"server-negotiator.queue_time_us":900839,"thread_start_us":20114,"threads_started":1}
W20260619 18:45:53.660678 12960 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.007s user 0.009s sys 0.043s
W20260619 18:45:53.697117 12146 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.288s user 0.005s sys 0.015s
W20260619 18:45:53.697220 12733 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.777s user 0.005s sys 0.008s
W20260619 18:45:53.735545 12165 meta_cache.cc:1097] Time spent processing table locations response: real 0.061s user 0.001s sys 0.000s
W20260619 18:45:53.749891 12960 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.719s user 0.009s sys 0.044s
W20260619 18:45:53.751490 12459 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.735643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51334)
0619 18:45:46.787541 (+ 51898us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.796953 (+ 9412us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.805203 (+ 8250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.287600 (+482397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.287632 (+ 32us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.298268 (+ 10636us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.412989 (+114721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.415128 (+ 2139us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.730112 (+314984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.730165 (+ 53us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.733927 (+1003762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.733992 (+ 65us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.826733 (+ 92741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.832725 (+ 5992us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:50.601440 (+1768715us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:50.624861 (+ 23421us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:50.625849 (+ 988us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:50.626674 (+ 825us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:50.639410 (+ 12736us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:52.157045 (+1517635us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":14164,"mutex_wait_us":4175382}
W20260619 18:45:53.742740 12920 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.555s user 0.027s sys 0.013s
W20260619 18:45:53.759058 12518 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.748947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51346)
0619 18:45:46.798882 (+ 49935us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.800365 (+ 1483us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.813029 (+ 12664us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.365801 (+552772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.367310 (+ 1509us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.374946 (+ 7636us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.571817 (+196871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.571886 (+ 69us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.708857 (+136971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.711353 (+ 2496us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.746143 (+1034790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.746199 (+ 56us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:49.697792 (+951593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:49.698600 (+ 808us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:50.966987 (+1268387us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:51.018995 (+ 52008us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:51.019034 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:51.019094 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:51.019252 (+ 158us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:51.969949 (+950697us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":5253,"mutex_wait_us":3244479}
I20260619 18:45:53.743345 12548 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
I20260619 18:45:53.783722 12164 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:53.825713 12524 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:45.831124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51180)
0619 18:45:45.833059 (+ 1935us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:45.833107 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:45.833369 (+ 262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:46.725580 (+892211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:46.725614 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:46.725754 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:46.813539 (+ 87785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.815185 (+ 1646us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.396596 (+581411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.396634 (+ 38us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.796863 (+400229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.799046 (+ 2183us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.118279 (+319233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.120315 (+ 2036us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:50.549774 (+2429459us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:50.832863 (+283089us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:50.833714 (+ 851us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:50.834802 (+ 1088us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:50.839711 (+ 4909us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:52.339532 (+1499821us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1489,"mutex_wait_us":4445989}
W20260619 18:45:53.859714 12548 scanner-internal.cc:458] Time spent opening tablet: real 6.471s user 0.006s sys 0.025s
W20260619 18:45:53.803833 12733 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.498s user 0.005s sys 0.010s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:53.892138 12876 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.502473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48650)
0619 18:45:48.566665 (+ 64192us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:48.568606 (+ 1941us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:48.577474 (+ 8868us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.635764 (+ 58290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.636720 (+ 956us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.640713 (+ 3993us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:51.415562 (+2774849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:51.419730 (+ 4168us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.839473 (+2419743us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":62644,"mutex_wait_us":4871311,"thread_start_us":55675,"threads_started":1}
I20260619 18:45:53.892997 12564 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:53.893523 12564 scanner-internal.cc:458] Time spent opening tablet: real 5.792s user 0.006s sys 0.003s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:45:53.875890 12624 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.420321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51746 (local address 127.6.120.254:36501)
0619 18:45:48.553811 (+1133490us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.554870 (+ 1059us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.560209 (+ 5339us) server_negotiation.cc:407] Connection header received
0619 18:45:48.563825 (+ 3616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.566233 (+ 2408us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.580809 (+ 14576us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:48.581010 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.581222 (+ 212us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:50.223416 (+1642194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.237364 (+3013948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:53.687521 (+450157us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51746: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":4910636,"server-negotiator.queue_time_us":1086754,"spinlock_wait_cycles":14239488}
W20260619 18:45:53.872649 12792 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.904163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51440)
0619 18:45:47.038210 (+134047us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.038260 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.038530 (+ 270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.506780 (+468250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.506821 (+ 41us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.506972 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.949824 (+442852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.951587 (+ 1763us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.710228 (+758641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.710275 (+ 47us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.772452 (+ 62177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.772519 (+ 67us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.569172 (+3796653us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":133538,"mutex_wait_us":2964037,"thread_start_us":121273,"threads_started":1}
W20260619 18:45:53.902343 12816 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:50.599861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51914)
0619 18:45:50.600633 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:50.600702 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:50.600993 (+ 291us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:50.943907 (+342914us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:50.943960 (+ 53us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:50.944080 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:52.518707 (+1574627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.518787 (+ 80us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.896615 (+1377828us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":124,"mutex_wait_us":1716203}
W20260619 18:45:53.902474 12828 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.574680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51790)
0619 18:45:47.666878 (+ 92198us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.668374 (+ 1496us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.699305 (+ 30931us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.949429 (+1250124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.949458 (+ 29us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.949610 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:52.431998 (+3482388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.432074 (+ 76us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.432731 (+ 657us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":50841,"mutex_wait_us":2658973,"thread_start_us":7975,"threads_started":1}
W20260619 18:45:53.899930 12653 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:49.491366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51910 (local address 127.6.120.254:36501)
0619 18:45:50.580923 (+1089557us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:50.580970 (+ 47us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:50.581026 (+ 56us) server_negotiation.cc:407] Connection header received
0619 18:45:50.660995 (+ 79969us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:50.669486 (+ 8491us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:50.750714 (+ 81228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:50.777524 (+ 26810us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:53.250614 (+2473090us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51910: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1495703,"server-negotiator.queue_time_us":1089028}
W20260619 18:45:53.889709 12164 scanner-internal.cc:458] Time spent opening tablet: real 6.398s user 0.010s sys 0.005s
W20260619 18:45:53.903527 12904 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.813603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48678 (local address 127.6.120.193:37901)
0619 18:45:49.596892 (+783289us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:49.599296 (+ 2404us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:49.696656 (+ 97360us) server_negotiation.cc:407] Connection header received
0619 18:45:49.754008 (+ 57352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:49.754043 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:49.754408 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:49.774842 (+ 20434us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:52.066234 (+2291392us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48678: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1994593,"server-negotiator.queue_time_us":725589,"thread_start_us":782776,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:45:53.931867 12896 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.707406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51870)
0619 18:45:49.235196 (+527790us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:49.235283 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:49.235780 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:49.625560 (+389780us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:49.625599 (+ 39us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:49.625722 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:51.063514 (+1437792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:51.064483 (+ 969us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.188547 (+1124064us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":523680,"mutex_wait_us":1575157,"thread_start_us":81763,"threads_started":1}
W20260619 18:45:53.926251 12180 meta_cache.cc:1097] Time spent processing table locations response: real 0.480s user 0.001s sys 0.000s
W20260619 18:45:53.960371 12652 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.196321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51594 (local address 127.6.120.254:36501)
0619 18:45:48.268984 (+1072663us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.270941 (+ 1957us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.288839 (+ 17898us) server_negotiation.cc:407] Connection header received
0619 18:45:48.293319 (+ 4480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.294373 (+ 1054us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.304123 (+ 9750us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.311859 (+ 7736us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:49.911433 (+1599574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.675508 (+2764075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:53.903199 (+1227691us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51594: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":5392450,"server-negotiator.queue_time_us":985573}
W20260619 18:45:53.961731 12551 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.138726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51530 (local address 127.6.120.254:36501)
0619 18:45:47.993165 (+854439us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.995332 (+ 2167us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.000912 (+ 5580us) server_negotiation.cc:407] Connection header received
0619 18:45:48.005611 (+ 4699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.009366 (+ 3755us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.023609 (+ 14243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.031746 (+ 8137us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:48.751969 (+720223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.810390 (+4058421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:53.948654 (+1138264us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51530: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":5572306,"server-negotiator.queue_time_us":805830}
W20260619 18:45:53.966977 12546 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.710562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51870 (local address 127.6.120.254:36501)
0619 18:45:49.624430 (+913868us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:49.624466 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:49.624510 (+ 44us) server_negotiation.cc:407] Connection header received
0619 18:45:49.624633 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:49.624662 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:49.624914 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:49.625095 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:51.068072 (+1442977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.995546 (+927474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:53.248392 (+1252846us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51870: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2948640,"server-negotiator.queue_time_us":913449}
W20260619 18:45:53.972566 12628 meta_cache.cc:1097] Time spent processing table locations response: real 0.078s user 0.001s sys 0.000s
W20260619 18:45:53.979970 12502 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.893972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51410 (local address 127.6.120.254:36501)
0619 18:45:47.452909 (+558937us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.452944 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.453005 (+ 61us) server_negotiation.cc:407] Connection header received
0619 18:45:47.453156 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.453180 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.453475 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.453679 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.516815 (+ 63136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.046763 (+529948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.888807 (+842044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.941760 (+4052953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:53.252267 (+310507us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51410: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":4618103,"server-negotiator.queue_time_us":555302}
W20260619 18:45:53.999800 12081 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:50.917484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51918 (local address 127.6.120.254:36501)
0619 18:45:51.039499 (+122015us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.039534 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.218945 (+179411us) server_negotiation.cc:407] Connection header received
0619 18:45:51.226155 (+ 7210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.227133 (+ 978us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.252318 (+ 25185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.252532 (+ 214us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:53.995622 (+2743090us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51918: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1197452,"server-negotiator.queue_time_us":120372,"spinlock_wait_cycles":14080}
W20260619 18:45:54.000033 12945 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:49.722605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48698)
0619 18:45:51.044306 (+1321701us) spinlock_profiling.cc:243] Waited 8.84 ms on lock 0x7b4400023f4c. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383d68a95 00007f1383d694b2 00007f138a346511 00007f138a341e1a 00007f1383e385fe 00007f138cc63a39 00007f1383e558bb 00007f1383e53cbf 00007f1383e55e22 00007f138892cc48
0619 18:45:51.231130 (+186824us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.231184 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.231565 (+ 381us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.239420 (+ 7855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.248225 (+ 8805us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.254868 (+ 6643us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:52.972034 (+1717166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.972087 (+ 53us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.961219 (+989132us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1506621,"mutex_wait_us":2495695,"spinlock_wait_cycles":20331392,"thread_start_us":722501,"threads_started":1}
W20260619 18:45:54.004630 12405 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.444300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51762)
0619 18:45:47.445938 (+ 1638us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.445986 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.446258 (+ 272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.596342 (+1150084us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.598615 (+ 2273us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.610468 (+ 11853us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:52.850328 (+4239860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.850387 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.696129 (+845742us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":504,"mutex_wait_us":4952524}
W20260619 18:45:54.043354 12497 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.271313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51606 (local address 127.6.120.254:36501)
0619 18:45:48.533602 (+1262289us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.537697 (+ 4095us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.538540 (+ 843us) server_negotiation.cc:407] Connection header received
0619 18:45:48.542559 (+ 4019us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.544074 (+ 1515us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.562822 (+ 18748us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.567791 (+ 4969us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:50.225774 (+1657983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.810069 (+2584295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:53.870910 (+1060841us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51606: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":3335307,"server-negotiator.queue_time_us":1208087,"spinlock_wait_cycles":1457536}
W20260619 18:45:54.029405 12598 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.834093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51822)
0619 18:45:47.834898 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.834957 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.835207 (+ 250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:49.697773 (+1862566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:49.698848 (+ 1075us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:49.721638 (+ 22790us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:52.306034 (+2584396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.308188 (+ 2154us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.909761 (+1601573us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":351,"mutex_wait_us":4037911}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
I20260619 18:45:54.010818 12576 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:54.058802 12930 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:49.910484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48718)
0619 18:45:50.959928 (+1049444us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:50.965626 (+ 5698us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:50.982244 (+ 16618us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.060950 (+ 78706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.060993 (+ 43us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.061060 (+ 67us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:52.160586 (+1099526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.166240 (+ 5654us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.936563 (+1770323us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1007054,"mutex_wait_us":1785704,"thread_start_us":135102,"threads_started":1}
W20260619 18:45:54.060274 12091 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.017575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51940 (local address 127.6.120.254:36501)
0619 18:45:51.042703 (+ 25128us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.042735 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.042781 (+ 46us) server_negotiation.cc:407] Connection header received
0619 18:45:51.042929 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.042953 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.043203 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.046400 (+ 3197us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:54.058594 (+3012194us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51940: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":976898,"server-negotiator.queue_time_us":24290}
W20260619 18:45:54.053896 12406 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.641819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51806)
0619 18:45:47.654301 (+ 12482us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.654357 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.654594 (+ 237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:49.606044 (+1951450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:49.606080 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:49.606222 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:51.694954 (+2088732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:51.695038 (+ 84us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.847944 (+2152906us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":265,"mutex_wait_us":3976277}
W20260619 18:45:54.056984 12927 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:49.815284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48698 (local address 127.6.120.193:37901)
0619 18:45:50.546973 (+731689us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:50.547013 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.233795 (+686782us) server_negotiation.cc:407] Connection header received
0619 18:45:51.233972 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.233997 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.234319 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.234505 (+ 186us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:53.162864 (+1928359us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48698: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1222208,"server-negotiator.queue_time_us":728743,"thread_start_us":33307,"threads_started":1}
I20260619 18:45:54.067039 12713 scanner-internal.cc:172] Scan of tablet d63b7834d93346288748391962132228 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:54.074478 12135 meta_cache.cc:1097] Time spent processing table locations response: real 0.100s user 0.000s sys 0.001s
W20260619 18:45:54.087303 12576 scanner-internal.cc:458] Time spent opening tablet: real 5.319s user 0.007s sys 0.026s
W20260619 18:45:54.092165 12856 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.045400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48624)
0619 18:45:48.276021 (+230621us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:48.276075 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:48.276465 (+ 390us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.423062 (+146597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.423106 (+ 44us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.423173 (+ 67us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:51.697623 (+3274450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:51.697719 (+ 96us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.162797 (+1465078us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":228844,"mutex_wait_us":4100945,"thread_start_us":199992,"threads_started":1}
W20260619 18:45:54.427961 12916 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:49.587502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48690)
0619 18:45:50.556492 (+968990us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:50.556548 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:50.556895 (+ 347us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:50.561651 (+ 4756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:50.563549 (+ 1898us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:50.572044 (+ 8495us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:52.643493 (+2071449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.643573 (+ 80us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.926907 (+1283334us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":938149,"mutex_wait_us":3128863,"thread_start_us":109340,"threads_started":1}
I20260619 18:45:54.429562 12605 scanner-internal.cc:172] Scan of tablet d63b7834d93346288748391962132228 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:54.430042 12605 scanner-internal.cc:458] Time spent opening tablet: real 5.053s user 0.016s sys 0.015s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:54.092882 12713 scanner-internal.cc:458] Time spent opening tablet: real 5.343s user 0.021s sys 0.040s
W20260619 18:45:54.100437 12491 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.180566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51546 (local address 127.6.120.254:36501)
0619 18:45:48.095835 (+915269us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.095881 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.095942 (+ 61us) server_negotiation.cc:407] Connection header received
0619 18:45:48.098288 (+ 2346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.099623 (+ 1335us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.118461 (+ 18838us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.123440 (+ 4979us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:49.900206 (+1776766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.519906 (+2619700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:53.898236 (+1378330us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51546: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":4109505,"server-negotiator.queue_time_us":898685}
W20260619 18:45:54.459473 12732 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.657152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48562 (local address 127.6.120.193:37901)
0619 18:45:47.672307 (+ 15155us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.672348 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.679607 (+ 7259us) server_negotiation.cc:407] Connection header received
0619 18:45:47.680379 (+ 772us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.680409 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.687538 (+ 7129us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b4800081e18. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f138cd02aa0 00007f138cceb061 00007f1388974dbb 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:47.687876 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.688124 (+ 248us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:48.137417 (+449293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.771549 (+634132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.812157 (+ 40608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.212457 (+3400300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:53.144657 (+932200us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48562: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":5264276,"server-negotiator.queue_time_us":6057,"spinlock_wait_cycles":3752704}
W20260619 18:45:54.465088 12742 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.012456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48620 (local address 127.6.120.193:37901)
0619 18:45:48.058411 (+ 45955us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.060822 (+ 2411us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.274692 (+213870us) server_negotiation.cc:407] Connection header received
0619 18:45:48.275128 (+ 436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.275166 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.275549 (+ 383us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.275717 (+ 168us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:48.567900 (+292183us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b4800081e18. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:48.856945 (+289045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.028284 (+3171339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:53.646566 (+1618282us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48620: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":4432376,"server-negotiator.queue_time_us":8740,"spinlock_wait_cycles":2754816,"thread_start_us":107790,"threads_started":1}
W20260619 18:45:54.466064 12894 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.652387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51844)
0619 18:45:48.835998 (+183611us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:48.836056 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:48.937263 (+101207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:49.623614 (+686351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:49.623654 (+ 40us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:49.623791 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:51.915941 (+2292150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:51.921077 (+ 5136us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.655262 (+1734185us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":182146,"mutex_wait_us":3103192,"thread_start_us":99503,"threads_started":1}
I20260619 18:45:54.466346 12119 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:54.466578 12854 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.995065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48604)
0619 18:45:48.460192 (+465127us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:48.460265 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:48.460667 (+ 402us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.579018 (+118351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.579052 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.579104 (+ 52us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:52.948406 (+4369302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.948468 (+ 62us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.622850 (+674382us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":320978,"mutex_wait_us":3912507,"thread_start_us":262239,"threads_started":1}
W20260619 18:45:54.466830 12119 scanner-internal.cc:458] Time spent opening tablet: real 6.673s user 0.014s sys 0.017s
W20260619 18:45:54.466836 12917 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:49.589048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48684 (local address 127.6.120.193:37901)
0619 18:45:50.519980 (+930932us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:50.520029 (+ 49us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:50.581180 (+ 61151us) server_negotiation.cc:407] Connection header received
0619 18:45:50.581376 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:50.581412 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:50.581837 (+ 425us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:50.582032 (+ 195us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:53.247357 (+2665325us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48684: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1245538,"server-negotiator.queue_time_us":908356,"thread_start_us":117459,"threads_started":1}
W20260619 18:45:54.465345 12932 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:49.856523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48724)
0619 18:45:51.042090 (+1185567us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.042153 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.042522 (+ 369us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.069985 (+ 27463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.071615 (+ 1630us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.075306 (+ 3691us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:52.644166 (+1568860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.644240 (+ 74us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.176793 (+532553us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1125816,"mutex_wait_us":1651156,"thread_start_us":161805,"threads_started":1}
I20260619 18:45:54.505414 12683 scanner-internal.cc:172] Scan of tablet d63b7834d93346288748391962132228 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:54.509996 12683 scanner-internal.cc:458] Time spent opening tablet: real 5.684s user 0.007s sys 0.005s
W20260619 18:45:54.503621 12857 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.072015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51828)
0619 18:45:48.382212 (+310197us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:48.382285 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:48.403218 (+ 20933us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:49.781390 (+1378172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:49.781435 (+ 45us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:49.781615 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:52.487542 (+2705927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.505368 (+ 17826us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.860306 (+1354938us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":261885,"mutex_wait_us":3786529,"thread_start_us":193458,"threads_started":1}
W20260619 18:45:54.511585 12466 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.351590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52010 (local address 127.6.120.254:36501)
0619 18:45:51.355974 (+ 4384us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.356028 (+ 54us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:52.433134 (+1077106us) server_negotiation.cc:407] Connection header received
0619 18:45:52.676577 (+243443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:52.676613 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:52.676888 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:52.677096 (+ 208us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:54.510227 (+1833131us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52010: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":76201,"server-negotiator.queue_time_us":3832}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:54.523614 12058 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.308402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51994 (local address 127.6.120.254:36501)
0619 18:45:51.312764 (+ 4362us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.312795 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.312848 (+ 53us) server_negotiation.cc:407] Connection header received
0619 18:45:51.319755 (+ 6907us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.321208 (+ 1453us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.357404 (+ 36196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.364422 (+ 7018us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:54.508607 (+3144185us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51994: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1489611,"server-negotiator.queue_time_us":3964}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:45:54.541734 12087 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:50.904531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51928 (local address 127.6.120.254:36501)
0619 18:45:51.068135 (+163604us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.069522 (+ 1387us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.428172 (+358650us) server_negotiation.cc:407] Connection header received
0619 18:45:51.437830 (+ 9658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.438377 (+ 547us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.452016 (+ 13639us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.479637 (+ 27621us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:54.049802 (+2570165us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51928: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1162988,"server-negotiator.queue_time_us":127058}
W20260619 18:45:54.604560 12610 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 3.55613e+06us
I20260619 18:45:54.607177 12540 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:54.607677 12540 scanner-internal.cc:458] Time spent opening tablet: real 6.928s user 0.003s sys 0.005s
W20260619 18:45:54.611434 12878 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.526969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48660 (local address 127.6.120.193:37901)
0619 18:45:48.636027 (+109058us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.636936 (+ 909us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.782219 (+145283us) server_negotiation.cc:407] Connection header received
0619 18:45:48.782418 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.782448 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.782802 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.783013 (+ 211us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:51.422045 (+2639032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.608568 (+3186523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:54.609269 (+ 701us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48660: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":5158351,"server-negotiator.queue_time_us":81350,"thread_start_us":42259,"threads_started":1}
W20260619 18:45:54.612763 12490 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.412198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52034 (local address 127.6.120.254:36501)
0619 18:45:51.495198 (+ 83000us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.496960 (+ 1762us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.501227 (+ 4267us) server_negotiation.cc:407] Connection header received
0619 18:45:51.503615 (+ 2388us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.506150 (+ 2535us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.522102 (+ 15952us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.551102 (+ 29000us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:54.611486 (+3060384us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52034: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1216295,"server-negotiator.queue_time_us":82577}
W20260619 18:45:54.613489 12866 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.180810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51830)
0619 18:45:48.541826 (+361016us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:48.541892 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:48.550685 (+ 8793us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:49.695321 (+1144636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:49.697283 (+ 1962us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:49.698308 (+ 1025us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:53.139312 (+3441004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:53.144145 (+ 4833us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.066532 (+922387us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":319443,"mutex_wait_us":4030018,"thread_start_us":51934,"threads_started":1}
W20260619 18:45:54.593571 12928 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:49.772599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48710)
0619 18:45:50.848037 (+1075438us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:50.848164 (+ 127us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:50.848704 (+ 540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:50.853001 (+ 4297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:50.853564 (+ 563us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:50.864729 (+ 11165us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:52.486882 (+1622153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.486973 (+ 91us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.888234 (+1401261us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":866206,"mutex_wait_us":2394839,"thread_start_us":64994,"threads_started":1}
I20260619 18:45:54.634871 12177 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:54.636142 12462 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:50.967236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51940)
0619 18:45:50.968771 (+ 1535us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:50.968821 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:50.969076 (+ 255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.049692 (+ 80616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.051116 (+ 1424us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.062220 (+ 11104us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:54.497963 (+3435743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:54.505814 (+ 7851us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.616055 (+110241us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1097,"mutex_wait_us":3491104}
W20260619 18:45:54.640221 12620 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.751908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51884 (local address 127.6.120.254:36501)
0619 18:45:50.596455 (+1844547us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:50.596489 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:50.596547 (+ 58us) server_negotiation.cc:407] Connection header received
0619 18:45:50.596690 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:50.596716 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:50.596970 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:50.597182 (+ 212us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:51.695810 (+1098628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.052702 (+2356892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:54.638622 (+585920us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51884: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":3492915,"server-negotiator.queue_time_us":1809575}
W20260619 18:45:54.635950 12177 scanner-internal.cc:458] Time spent opening tablet: real 5.262s user 0.004s sys 0.047s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:54.729797 12863 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.358661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48764 (local address 127.6.120.193:37901)
0619 18:45:52.166343 (+807682us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:52.167468 (+ 1125us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:52.168535 (+ 1067us) server_negotiation.cc:407] Connection header received
0619 18:45:52.172284 (+ 3749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:52.174971 (+ 2687us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:52.214658 (+ 39687us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:52.214869 (+ 211us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:54.510999 (+2296130us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48764: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1532634,"server-negotiator.queue_time_us":675500,"thread_start_us":1497635,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:45:54.727715 12877 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.508571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48650 (local address 127.6.120.193:37901)
0619 18:45:48.571313 (+ 62742us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.571377 (+ 64us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.571436 (+ 59us) server_negotiation.cc:407] Connection header received
0619 18:45:48.599082 (+ 27646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.601254 (+ 2172us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.618150 (+ 16896us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.634223 (+ 16073us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:51.428580 (+2794357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.897486 (+2468906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:54.049533 (+152047us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48650: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":4036289,"server-negotiator.queue_time_us":61477,"thread_start_us":51985,"threads_started":1}
W20260619 18:45:54.737046 12532 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.705241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48580)
0619 18:45:47.736117 (+ 30876us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.736193 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.736607 (+ 414us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.035016 (+298409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.036380 (+ 1364us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.042626 (+ 6246us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:48.089653 (+ 47027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.089728 (+ 75us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.935668 (+845940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.935718 (+ 50us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:53.714784 (+4779066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:53.725277 (+ 10493us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.071148 (+345871us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":2509,"mutex_wait_us":4920683}
W20260619 18:45:54.749527 12913 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:49.577414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48684)
0619 18:45:50.580370 (+1002956us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:50.580464 (+ 94us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:50.580889 (+ 425us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:50.618482 (+ 37593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:50.623998 (+ 5516us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:50.626709 (+ 2711us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:53.681237 (+3054528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:53.698563 (+ 17326us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.075874 (+377311us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":922358,"mutex_wait_us":3033454,"thread_start_us":21250,"threads_started":1}
W20260619 18:45:54.745416 12905 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.856236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48678)
0619 18:45:49.628970 (+772734us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:49.675816 (+ 46846us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:49.710277 (+ 34461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:49.775146 (+ 64869us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:49.775192 (+ 46us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:49.775259 (+ 67us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:53.741986 (+3966727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:53.752036 (+ 10050us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.052473 (+300437us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":691912,"mutex_wait_us":3941768,"thread_start_us":670981,"threads_started":1}
W20260619 18:45:54.751382 12563 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:50.601244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51914 (local address 127.6.120.254:36501)
0619 18:45:50.942990 (+341746us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:50.943041 (+ 51us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:50.943123 (+ 82us) server_negotiation.cc:407] Connection header received
0619 18:45:50.943275 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:50.943302 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:50.943579 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:50.944176 (+ 597us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:52.521626 (+1577450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.433036 (+1911410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:54.641752 (+208716us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51914: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1670822,"server-negotiator.queue_time_us":328755}
W20260619 18:45:54.753661 12455 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.043992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51962)
0619 18:45:51.084122 (+ 40130us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.085229 (+ 1107us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.115031 (+ 29802us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.161609 (+ 46578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.163046 (+ 1437us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.165166 (+ 2120us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:52.508940 (+1343774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.509013 (+ 73us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.457692 (+1948679us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1633,"mutex_wait_us":1679088}
W20260619 18:45:54.755579 12437 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.043790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51948)
0619 18:45:51.074756 (+ 30966us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.083333 (+ 8577us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.102507 (+ 19174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.147289 (+ 44782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.148022 (+ 733us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.165253 (+ 17231us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:52.436430 (+1271177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.436523 (+ 93us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.464490 (+2027967us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1741,"mutex_wait_us":1505002}
W20260619 18:45:54.757261 12942 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:50.978075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48732)
0619 18:45:51.246451 (+268376us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.246534 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.246888 (+ 354us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.352195 (+105307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.353251 (+ 1056us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.356795 (+ 3544us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:53.855322 (+2498527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:53.860515 (+ 5193us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.422588 (+562073us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":250740,"mutex_wait_us":1866111,"thread_start_us":134143,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:54.759378 12614 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.050133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51962 (local address 127.6.120.254:36501)
0619 18:45:51.058908 (+ 8775us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.058957 (+ 49us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.094361 (+ 35404us) server_negotiation.cc:407] Connection header received
0619 18:45:51.123353 (+ 28992us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.129218 (+ 5865us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.144563 (+ 15345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.148201 (+ 3638us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:52.509376 (+1361175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.612337 (+2102961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:54.614973 (+ 2636us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51962: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2462324,"server-negotiator.queue_time_us":8358,"spinlock_wait_cycles":1323264}
I20260619 18:45:54.759110 12159 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
I20260619 18:45:54.783900 12132 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:54.765645 12814 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.041293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51946)
0619 18:45:51.074735 (+ 33442us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.083258 (+ 8523us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.103263 (+ 20005us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.189741 (+ 86478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.189777 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.189912 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:52.485874 (+1295962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.485960 (+ 86us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.606614 (+2120654us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":4413,"mutex_wait_us":1788756}
I20260619 18:45:54.761623 12676 scanner-internal.cc:172] Scan of tablet d63b7834d93346288748391962132228 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:54.779996 12595 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.049670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51948 (local address 127.6.120.254:36501)
0619 18:45:51.059669 (+ 9999us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.059706 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.084918 (+ 25212us) server_negotiation.cc:407] Connection header received
0619 18:45:51.120324 (+ 35406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.123527 (+ 3203us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.139457 (+ 15930us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.146701 (+ 7244us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:52.519346 (+1372645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.638432 (+2119086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:54.639179 (+ 747us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51948: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":3405596,"server-negotiator.queue_time_us":6576}
W20260619 18:45:54.789423 12608 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.151957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51972 (local address 127.6.120.254:36501)
0619 18:45:51.247183 (+ 95226us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.247222 (+ 39us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.247274 (+ 52us) server_negotiation.cc:407] Connection header received
0619 18:45:51.247403 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.247453 (+ 50us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.252318 (+ 4865us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.252532 (+ 214us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:53.988724 (+2736192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.608839 (+620115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:54.609385 (+ 546us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51972: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2137667,"server-negotiator.queue_time_us":94784,"spinlock_wait_cycles":22656}
W20260619 18:45:54.834110 12132 scanner-internal.cc:458] Time spent opening tablet: real 4.286s user 0.003s sys 0.006s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:45:54.843248 12413 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.427874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52048 (local address 127.6.120.254:36501)
0619 18:45:51.960231 (+532357us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.960267 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:52.487486 (+527219us) server_negotiation.cc:407] Connection header received
0619 18:45:52.608275 (+120789us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:52.608314 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:52.608654 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:52.611956 (+ 3302us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:54.552826 (+1940870us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52048: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":934142,"server-negotiator.queue_time_us":531882}
W20260619 18:45:54.847501 12926 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:49.882738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48724 (local address 127.6.120.193:37901)
0619 18:45:50.547810 (+665072us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:50.547852 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.046020 (+498168us) server_negotiation.cc:407] Connection header received
0619 18:45:51.054886 (+ 8866us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.055932 (+ 1046us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.065560 (+ 9628us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.067781 (+ 2221us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:52.677516 (+1609735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.641921 (+1964405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:54.642654 (+ 733us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48724: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":3156138,"server-negotiator.queue_time_us":664504,"thread_start_us":464521,"threads_started":1}
W20260619 18:45:54.848956 12547 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.166547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51972)
0619 18:45:51.167189 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.167255 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.167566 (+ 311us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.252863 (+ 85297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.252897 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.253031 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:53.971845 (+2718814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:53.978248 (+ 6403us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.783493 (+805245us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":118,"mutex_wait_us":2984248}
I20260619 18:45:54.777508 12692 scanner-internal.cc:172] Scan of tablet d63b7834d93346288748391962132228 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:54.790778 12907 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:49.257325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51910)
0619 18:45:50.565697 (+1308372us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:50.572341 (+ 6644us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:50.635996 (+ 63655us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:50.800619 (+164623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:50.802158 (+ 1539us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:50.837232 (+ 35074us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:53.999885 (+3162653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:53.999958 (+ 73us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.518110 (+518152us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1235246,"mutex_wait_us":2895537,"thread_start_us":337942,"threads_started":1}
W20260619 18:45:54.852437 12676 scanner-internal.cc:458] Time spent opening tablet: real 6.280s user 0.010s sys 0.010s
W20260619 18:45:54.857707 12692 scanner-internal.cc:458] Time spent opening tablet: real 6.155s user 0.006s sys 0.017s
W20260619 18:45:54.858273 12159 scanner-internal.cc:458] Time spent opening tablet: real 7.256s user 0.004s sys 0.021s
W20260619 18:45:54.888984 12908 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.635s user 0.000s sys 0.003s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:45:54.887183 12781 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.180s user 0.019s sys 0.016s
W20260619 18:45:54.922811 12554 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.393802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52018)
0619 18:45:51.428493 (+ 34691us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.428554 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.428816 (+ 262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.489060 (+ 60244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.489108 (+ 48us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.489286 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:52.522567 (+1033281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.522641 (+ 74us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.565289 (+2042648us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1949,"mutex_wait_us":1105099}
W20260619 18:45:54.950876 12780 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.191s user 0.006s sys 0.035s
W20260619 18:45:54.951339 12780 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.200s user 0.006s sys 0.035s
W20260619 18:45:54.927845 12961 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.263s user 0.016s sys 0.025s
W20260619 18:45:54.929519 12908 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.682s user 0.000s sys 0.004s
W20260619 18:45:54.948688 12582 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.007919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51490)
0619 18:45:47.037502 (+ 29583us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.037560 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.037894 (+ 334us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.664190 (+626296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.664246 (+ 56us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.664443 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:48.049938 (+385495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.053407 (+ 3469us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.761186 (+707779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.762350 (+ 1164us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:53.922243 (+5159893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:53.931439 (+ 9196us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.496786 (+565347us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":16582,"mutex_wait_us":5453944,"thread_start_us":113737,"threads_started":1}
W20260619 18:45:54.953727 12574 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.132866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51970)
0619 18:45:51.165948 (+ 33082us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.166042 (+ 94us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.166350 (+ 308us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.237131 (+ 70781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.247884 (+ 10753us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.296789 (+ 48905us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:52.841067 (+1544278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.849957 (+ 8890us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.601170 (+1751213us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":408,"mutex_wait_us":1549767}
W20260619 18:45:54.956614 12910 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.258s user 0.016s sys 0.025s
W20260619 18:45:54.998188 12910 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.311s user 0.016s sys 0.026s
W20260619 18:45:54.945365 12781 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.248s user 0.020s sys 0.016s
W20260619 18:45:55.000588 12903 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.377s user 0.006s sys 0.036s
W20260619 18:45:55.001616 12903 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.393s user 0.006s sys 0.037s
W20260619 18:45:55.002904 12836 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.254867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51986)
0619 18:45:51.305291 (+ 50424us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.305344 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.305656 (+ 312us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.415060 (+109404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.415115 (+ 55us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.415283 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:53.992260 (+2576977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:54.000612 (+ 8352us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.001316 (+1000704us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":406,"mutex_wait_us":3045949}
W20260619 18:45:55.005398 12853 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:49.909661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48718 (local address 127.6.120.193:37901)
0619 18:45:51.060018 (+1150357us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.060054 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.060148 (+ 94us) server_negotiation.cc:407] Connection header received
0619 18:45:51.060314 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.060352 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.060701 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.060898 (+ 197us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:52.170893 (+1109995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.636902 (+2466009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:55.003796 (+366894us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48718: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":3528934,"server-negotiator.queue_time_us":1149625,"thread_start_us":53810,"threads_started":1}
W20260619 18:45:55.007282 12544 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.046849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51946 (local address 127.6.120.254:36501)
0619 18:45:51.060003 (+ 13154us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.060034 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.086963 (+ 26929us) server_negotiation.cc:407] Connection header received
0619 18:45:51.120262 (+ 33299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.123472 (+ 3210us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.188885 (+ 65413us) spinlock_profiling.cc:243] Waited 7.38 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:51.189218 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.189658 (+ 440us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:52.486326 (+1296668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.861777 (+2375451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:54.999864 (+138087us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51946: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2850948,"server-negotiator.queue_time_us":6144,"spinlock_wait_cycles":16966016}
W20260619 18:45:54.955539 12961 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.291s user 0.016s sys 0.026s
W20260619 18:45:54.952687 12765 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.193s user 0.011s sys 0.030s
W20260619 18:45:55.015013 12715 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.971s user 0.004s sys 0.008s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:55.017844 12531 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.057915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51966)
0619 18:45:51.067921 (+ 10006us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.067974 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.072887 (+ 4913us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.165044 (+ 92157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.165088 (+ 44us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.165224 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:52.431711 (+1266487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.431802 (+ 91us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.729047 (+2297245us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":847,"mutex_wait_us":1376652}
W20260619 18:45:55.026968 12715 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.983s user 0.004s sys 0.009s
W20260619 18:45:55.019520 12765 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.267s user 0.012s sys 0.030s
W20260619 18:45:55.012751 12947 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 2.557s user 0.008s sys 0.043s
W20260619 18:45:55.061239 12823 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.306213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51994)
0619 18:45:51.312617 (+ 6404us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.312671 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.312957 (+ 286us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.377608 (+ 64651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.385315 (+ 7707us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.412423 (+ 27108us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:54.645678 (+3233255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:54.675059 (+ 29381us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.860767 (+185708us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1791,"mutex_wait_us":3194619}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:55.050843 12956 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.088s user 0.002s sys 0.012s
W20260619 18:45:55.059474 12947 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.604s user 0.008s sys 0.044s
W20260619 18:45:55.063177 12957 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.235380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48746 (local address 127.6.120.193:37901)
0619 18:45:51.590964 (+355584us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.937654 (+346690us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.937733 (+ 79us) server_negotiation.cc:407] Connection header received
0619 18:45:51.951014 (+ 13281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.953999 (+ 2985us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.992676 (+ 38677us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:52.005054 (+ 12378us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:54.775858 (+2770804us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48746: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":871793,"server-negotiator.queue_time_us":353528,"thread_start_us":146182,"threads_started":1}
W20260619 18:45:55.076542 12583 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.024946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52104)
0619 18:45:52.160578 (+135632us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:52.165080 (+ 4502us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:52.171639 (+ 6559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:52.809948 (+638309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:52.809989 (+ 41us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:52.810124 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:53.916521 (+1106397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:53.925690 (+ 9169us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.073725 (+1148035us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":2062,"mutex_wait_us":1060432}
W20260619 18:45:55.077623 12585 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.028019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52108 (local address 127.6.120.254:36501)
0619 18:45:52.552248 (+524229us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:52.606802 (+ 54554us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:52.692355 (+ 85553us) server_negotiation.cc:407] Connection header received
0619 18:45:52.800903 (+108548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:52.826576 (+ 25673us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:52.840975 (+ 14399us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:52.851133 (+ 10158us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.076276 (+2225143us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52108: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":996557,"server-negotiator.queue_time_us":340275}
W20260619 18:45:55.078338 12691 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.421050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52034)
0619 18:45:51.451914 (+ 30864us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.453218 (+ 1304us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.485710 (+ 32492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.556317 (+ 70607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.574029 (+ 17712us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.657437 (+ 83408us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:54.730850 (+3073413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:54.734780 (+ 3930us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.923054 (+188274us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":740,"mutex_wait_us":3042377}
W20260619 18:45:55.087652 12632 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.393699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52018 (local address 127.6.120.254:36501)
0619 18:45:51.487901 (+ 94202us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.487946 (+ 45us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.488023 (+ 77us) server_negotiation.cc:407] Connection header received
0619 18:45:51.488272 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.488311 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.488650 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.489388 (+ 738us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:52.641591 (+1152203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.964879 (+2323288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:55.065744 (+100865us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52018: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":3343073,"server-negotiator.queue_time_us":93609}
W20260619 18:45:55.094651 12591 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.028515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52118 (local address 127.6.120.254:36501)
0619 18:45:52.677301 (+648786us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:52.677328 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:52.677390 (+ 62us) server_negotiation.cc:407] Connection header received
0619 18:45:52.677519 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:52.677546 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:52.734440 (+ 56894us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:52.868337 (+133897us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.093608 (+2225271us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52118: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2155159,"server-negotiator.queue_time_us":648125}
W20260619 18:45:55.099359 12636 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.011861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52104 (local address 127.6.120.254:36501)
0619 18:45:52.482680 (+470819us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:52.503111 (+ 20431us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:52.506450 (+ 3339us) server_negotiation.cc:407] Connection header received
0619 18:45:52.530993 (+ 24543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:52.586840 (+ 55847us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:52.697210 (+110370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:52.809549 (+112339us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:52.983033 (+173484us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:54.615371 (+1632338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.097580 (+482209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:55.098062 (+ 482us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52104: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2092236,"server-negotiator.queue_time_us":317464,"spinlock_wait_cycles":40666496}
W20260619 18:45:55.101820 12492 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.032834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52118)
0619 18:45:52.159675 (+126841us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:52.161126 (+ 1451us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:52.169888 (+ 8762us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:52.872279 (+702391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:52.877002 (+ 4723us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:52.940451 (+ 63449us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.100214 (+2159763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.100269 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.100732 (+ 463us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":2026,"mutex_wait_us":1409383}
W20260619 18:45:55.073879 12956 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.111s user 0.002s sys 0.012s
W20260619 18:45:55.116212 12920 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.030s user 0.042s sys 0.051s
W20260619 18:45:55.116662 12920 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.035s user 0.042s sys 0.051s
W20260619 18:45:55.106593 12960 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.039s user 0.005s sys 0.008s
W20260619 18:45:55.112208 12931 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.057s user 0.070s sys 0.049s
W20260619 18:45:55.117592 12953 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.189870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48754)
0619 18:45:51.589081 (+399211us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.589171 (+ 90us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.589635 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.653113 (+ 63478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.658097 (+ 4984us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.665030 (+ 6933us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:52.982594 (+1317564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:53.016125 (+ 33531us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.949703 (+1933578us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":398432,"mutex_wait_us":1546611,"thread_start_us":229518,"threads_started":1}
W20260619 18:45:55.118741 12969 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.040s user 0.007s sys 0.007s
W20260619 18:45:55.141196 12940 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:50.884410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51918)
0619 18:45:51.216060 (+331650us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.216164 (+ 104us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.216582 (+ 418us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.283285 (+ 66703us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.283792 (+ 507us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.297580 (+ 13788us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:54.472853 (+3175273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:54.495501 (+ 22648us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.960409 (+464908us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":330919,"mutex_wait_us":3089962,"thread_start_us":316712,"threads_started":1}
W20260619 18:45:55.143555 12931 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.116s user 0.071s sys 0.050s
W20260619 18:45:55.118852 12951 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.077s user 0.003s sys 0.011s
W20260619 18:45:55.143493 12960 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.086s user 0.005s sys 0.009s
W20260619 18:45:55.146744 12969 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.072s user 0.007s sys 0.008s
W20260619 18:45:55.145407 12949 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:50.905773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51928)
0619 18:45:51.063165 (+157392us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b4400023f4c. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383d68a95 00007f1383d694b2 00007f138a346511 00007f138a341e1a 00007f1383e385fe 00007f138cc63a39 00007f1383e558bb 00007f1383e53cbf 00007f1383e55e22 00007f138892cc48
0619 18:45:51.424656 (+361491us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.426869 (+ 2213us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.433045 (+ 6176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.485455 (+ 52410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.486495 (+ 1040us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.492548 (+ 6053us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:54.637509 (+3144961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:54.637576 (+ 67us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.961423 (+323847us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":446394,"mutex_wait_us":2879776,"spinlock_wait_cycles":27723648,"thread_start_us":209456,"threads_started":1}
W20260619 18:45:55.118608 12975 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.467s user 0.003s sys 0.013s
W20260619 18:45:55.163857 12950 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.054311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48746)
0619 18:45:51.246898 (+192587us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.246954 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.247285 (+ 331us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:52.006298 (+759013us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:52.008191 (+ 1893us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:52.008251 (+ 60us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:54.957150 (+2948899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:54.965443 (+ 8293us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.067234 (+101791us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":184768,"mutex_wait_us":2392042,"thread_start_us":63369,"threads_started":1}
W20260619 18:45:55.157191 12681 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.018761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52092)
0619 18:45:52.158749 (+139988us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:52.160038 (+ 1289us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:52.168861 (+ 8823us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:52.187897 (+ 19036us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:52.187939 (+ 42us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:52.188195 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:54.673984 (+2485789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:54.728487 (+ 54503us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.053187 (+324700us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1677,"mutex_wait_us":2444658}
W20260619 18:45:55.156397 12975 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.505s user 0.003s sys 0.013s
W20260619 18:45:55.151116 12951 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.109s user 0.003s sys 0.012s
W20260619 18:45:55.162468 12970 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.530399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48780 (local address 127.6.120.193:37901)
0619 18:45:52.506178 (+975779us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:52.506228 (+ 50us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:52.970576 (+464348us) server_negotiation.cc:407] Connection header received
0619 18:45:52.982113 (+ 11537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:52.982151 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:53.082023 (+ 99872us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:53.113781 (+ 31758us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:55.044225 (+1930444us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48780: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1171872,"server-negotiator.queue_time_us":865020,"thread_start_us":1575766,"threads_started":1}
W20260619 18:45:55.178407 12933 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:50.971920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48732 (local address 127.6.120.193:37901)
0619 18:45:51.227884 (+255964us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.229065 (+ 1181us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.247762 (+ 18697us) server_negotiation.cc:407] Connection header received
0619 18:45:51.291590 (+ 43828us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.298627 (+ 7037us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.321494 (+ 22867us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.331352 (+ 9858us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:55.065789 (+3734437us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48732: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":3132184,"server-negotiator.queue_time_us":168908,"thread_start_us":240801,"threads_started":1}
W20260619 18:45:55.258267 10948 thread.cc:636] server-negotiator [worker] (thread pool) Time spent creating pthread: real 1.423s user 0.008s sys 0.003s
W20260619 18:45:55.259262 10948 thread.cc:602] server-negotiator [worker] (thread pool) Time spent starting thread: real 1.430s user 0.008s sys 0.004s
W20260619 18:45:55.286670 12141 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.209s user 0.009s sys 0.003s
W20260619 18:45:55.287293 12141 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.209s user 0.009s sys 0.004s
W20260619 18:45:55.288442 12165 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.225s user 0.005s sys 0.008s
W20260619 18:45:55.288992 12165 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.226s user 0.005s sys 0.009s
W20260619 18:45:55.289721 12135 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.859s user 0.021s sys 0.022s
W20260619 18:45:55.290218 12135 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.859s user 0.021s sys 0.022s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:55.294567 12229 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 256956us
W20260619 18:45:55.296679 12234 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.513s user 0.007s sys 0.007s
W20260619 18:45:55.297137 12234 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.513s user 0.007s sys 0.007s
W20260619 18:45:55.045460 12248 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.943s user 0.004s sys 0.009s
W20260619 18:45:55.299932 12248 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.197s user 0.005s sys 0.009s
W20260619 18:45:55.309581 12317 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 2.072s user 0.004s sys 0.010s
W20260619 18:45:55.310158 12317 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 2.072s user 0.004s sys 0.010s
I20260619 18:45:55.311211 12149 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:55.314456 12369 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.556s user 0.002s sys 0.012s
W20260619 18:45:55.314939 12369 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.557s user 0.002s sys 0.012s
W20260619 18:45:55.322063 12444 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.972117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52076)
0619 18:45:52.032457 (+ 60340us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:52.034023 (+ 1566us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:52.066330 (+ 32307us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:52.220399 (+154069us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:52.296461 (+ 76062us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:52.316444 (+ 19983us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:52.891003 (+574559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.911544 (+ 20541us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.320167 (+2408623us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":5886,"mutex_wait_us":516406}
I20260619 18:45:55.321717 12153 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:55.323686 12153 scanner-internal.cc:458] Time spent opening tablet: real 4.769s user 0.004s sys 0.011s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:55.329540 12485 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.971930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52064)
0619 18:45:51.972557 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.977559 (+ 5002us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.989281 (+ 11722us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:52.164834 (+175553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:52.165757 (+ 923us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:52.165922 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:54.600617 (+2434695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:54.604426 (+ 3809us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.046738 (+442312us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":88,"mutex_wait_us":2371783}
W20260619 18:45:55.333122 12507 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.021478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52090)
0619 18:45:52.164207 (+142729us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:52.164288 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:52.164586 (+ 298us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:52.211536 (+ 46950us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:52.296264 (+ 84728us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:52.311528 (+ 15264us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:53.903900 (+1592372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:53.918480 (+ 14580us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.063383 (+1144903us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":2089,"mutex_wait_us":1544744}
W20260619 18:45:55.337844 12558 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.007970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52090 (local address 127.6.120.254:36501)
0619 18:45:52.137347 (+129377us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:52.138448 (+ 1101us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:52.164410 (+ 25962us) server_negotiation.cc:407] Connection header received
0619 18:45:52.166534 (+ 2124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:52.167693 (+ 1159us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:52.189351 (+ 21658us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:52.210681 (+ 21330us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:53.939221 (+1728540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.091725 (+1152504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:55.109459 (+ 17734us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52090: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1645204,"server-negotiator.queue_time_us":7905}
W20260619 18:45:55.342526 12149 scanner-internal.cc:458] Time spent opening tablet: real 5.564s user 0.028s sys 0.041s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:45:55.345522 12431 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.030966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52120)
0619 18:45:52.156901 (+125935us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:52.156957 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:52.159141 (+ 2184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:53.026901 (+867760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:53.026941 (+ 40us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:53.033447 (+ 6506us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:54.638150 (+1604703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:54.638213 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.319985 (+681772us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":513,"mutex_wait_us":1563966}
W20260619 18:45:55.346668 12628 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.501s user 0.008s sys 0.008s
W20260619 18:45:55.347079 12628 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.502s user 0.008s sys 0.008s
W20260619 18:45:55.347608 12619 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.291995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51986 (local address 127.6.120.254:36501)
0619 18:45:51.357281 (+ 65286us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.358895 (+ 1614us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.359892 (+ 997us) server_negotiation.cc:407] Connection header received
0619 18:45:51.376646 (+ 16754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.383414 (+ 6768us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.414244 (+ 30830us) spinlock_profiling.cc:243] Waited 961 us on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:51.414523 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.414776 (+ 253us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:54.027192 (+2612416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.091438 (+1064246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:55.091964 (+ 526us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51986: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2163128,"server-negotiator.queue_time_us":102,"spinlock_wait_cycles":2210048}
W20260619 18:45:55.367241 12187 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.138947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51970 (local address 127.6.120.254:36501)
0619 18:45:51.232979 (+ 94032us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.233015 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.233077 (+ 62us) server_negotiation.cc:407] Connection header received
0619 18:45:51.233218 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.233253 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.233522 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.235914 (+ 2392us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:51.305031 (+ 69117us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:52.850266 (+1545235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.291093 (+2440827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:55.365428 (+ 74335us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51970: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":3350617,"server-negotiator.queue_time_us":93570,"spinlock_wait_cycles":5273984}
W20260619 18:45:55.592900 12568 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 2.501s user 0.027s sys 0.038s
W20260619 18:45:55.593405 12568 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 2.553s user 0.027s sys 0.038s
W20260619 18:45:55.630565 12981 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.513s user 0.011s sys 0.011s
W20260619 18:45:55.605225 12903 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.541s user 0.007s sys 0.028s
W20260619 18:45:55.623499 12910 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.545s user 0.026s sys 0.009s
W20260619 18:45:55.632263 12991 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.686s user 0.005s sys 0.032s
W20260619 18:45:55.650995 12180 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.722s user 0.013s sys 0.003s
W20260619 18:45:55.651134 12903 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.647s user 0.008s sys 0.029s
W20260619 18:45:55.653177 12947 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.535s user 0.003s sys 0.033s
W20260619 18:45:55.656323 12180 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.810s user 0.014s sys 0.004s
W20260619 18:45:55.653528 12910 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.655s user 0.026s sys 0.010s
W20260619 18:45:55.666186 12549 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.028489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52108)
0619 18:45:52.160549 (+132060us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:52.165055 (+ 4506us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:52.173823 (+ 8768us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:52.849833 (+676010us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:52.849880 (+ 47us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:52.850017 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.338103 (+2488086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.338201 (+ 98us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.664726 (+326525us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1755,"mutex_wait_us":2776235}
W20260619 18:45:55.655479 12991 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.799s user 0.005s sys 0.033s
W20260619 18:45:55.676095 12947 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.585s user 0.003s sys 0.034s
W20260619 18:45:55.707865 12993 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.504s user 0.007s sys 0.009s
W20260619 18:45:55.819947 12992 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.516s user 0.010s sys 0.054s
W20260619 18:45:55.987355 12983 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.205441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48798)
0619 18:45:53.764721 (+1559280us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.775174 (+ 10453us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.849520 (+ 74346us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:53.981809 (+132289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:53.985459 (+ 3650us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:53.996958 (+ 11499us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:55.099783 (+1102825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.099842 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.950363 (+850521us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":941696,"mutex_wait_us":1794774,"thread_start_us":1584537,"threads_started":1}
I20260619 18:45:55.990449 12694 scanner-internal.cc:172] Scan of tablet d63b7834d93346288748391962132228 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:55.991155 12694 scanner-internal.cc:458] Time spent opening tablet: real 4.755s user 0.008s sys 0.019s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:45:56.020664 12967 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.481370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52048)
0619 18:45:52.475657 (+994287us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:52.483464 (+ 7807us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:52.574040 (+ 90576us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:52.625950 (+ 51910us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:52.631186 (+ 5236us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:52.830298 (+199112us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.170727 (+2340429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.171763 (+ 1036us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.917931 (+746168us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":965536,"mutex_wait_us":2475224,"thread_start_us":1636171,"threads_started":1}
W20260619 18:45:56.030503 12604 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.026206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52174 (local address 127.6.120.254:36501)
0619 18:45:53.241105 (+214899us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.247069 (+ 5964us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:53.249053 (+ 1984us) server_negotiation.cc:407] Connection header received
0619 18:45:53.607933 (+358880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:53.622558 (+ 14625us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:53.709365 (+ 86807us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:53.738691 (+ 29326us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:53.992925 (+254234us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:55.021393 (+1028468us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:56.028785 (+1007392us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52174: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1624228,"server-negotiator.queue_time_us":90148,"spinlock_wait_cycles":62796416}
W20260619 18:45:56.034260 12966 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.412330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52010)
0619 18:45:52.431969 (+1019639us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:52.432054 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:52.676250 (+244196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:52.801835 (+125585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:52.812166 (+ 10331us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:52.863117 (+ 50951us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.026088 (+3162971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.026168 (+ 80us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.026812 (+ 644us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":969204,"mutex_wait_us":2925954,"thread_start_us":1459278,"threads_started":1}
W20260619 18:45:56.050570 12977 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.007956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48784)
0619 18:45:53.088546 (+1080590us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.088648 (+ 102us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.089157 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:53.774463 (+685306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:53.784232 (+ 9769us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:53.825873 (+ 41641us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:55.092593 (+1266720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.092651 (+ 58us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.882297 (+789646us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1079925,"mutex_wait_us":1932622,"thread_start_us":387535,"threads_started":1}
I20260619 18:45:56.051789 12714 scanner-internal.cc:172] Scan of tablet d63b7834d93346288748391962132228 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:56.052597 12714 scanner-internal.cc:458] Time spent opening tablet: real 4.805s user 0.011s sys 0.056s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:56.491889 12621 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.531s user 0.017s sys 0.097s
W20260619 18:45:56.506569 11040 thread.cc:636] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.501s user 0.055s sys 0.052s
W20260619 18:45:56.506965 11040 thread.cc:602] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.509s user 0.055s sys 0.052s
W20260619 18:45:56.495893 12621 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.566s user 0.018s sys 0.098s
W20260619 18:45:56.522701 12634 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.062001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51966 (local address 127.6.120.254:36501)
0619 18:45:51.161181 (+ 99180us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.161228 (+ 47us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.161302 (+ 74us) server_negotiation.cc:407] Connection header received
0619 18:45:51.161497 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.163014 (+ 1517us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.164657 (+ 1643us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.164949 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:51.254228 (+ 89279us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:52.485410 (+1231182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.349817 (+2864407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.521240 (+1171423us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51966: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":4773772,"server-negotiator.queue_time_us":77604,"spinlock_wait_cycles":6605184}
W20260619 18:45:56.539043 12480 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.139695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48784 (local address 127.6.120.193:37901)
0619 18:45:53.247798 (+108103us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.249390 (+ 1592us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:53.256638 (+ 7248us) server_negotiation.cc:407] Connection header received
0619 18:45:53.640849 (+384211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:53.653581 (+ 12732us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:53.743850 (+ 90269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:53.772082 (+ 28232us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:56.537568 (+2765486us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48784: BlockingRecv error: recv got EOF from 127.0.0.1:48784 (error 108)
Metrics: {"mutex_wait_us":1439680,"server-negotiator.queue_time_us":85000,"thread_start_us":68985,"threads_started":1}
W20260619 18:45:56.545835 12918 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:49.754144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48710 (local address 127.6.120.193:37901)
0619 18:45:50.516851 (+762707us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:50.516886 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:50.848969 (+332083us) server_negotiation.cc:407] Connection header received
0619 18:45:50.849180 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:50.849217 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:50.849681 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:50.849883 (+ 202us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:52.506044 (+1656161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.148271 (+2642227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.542758 (+1394487us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48710: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":4293794,"server-negotiator.queue_time_us":762229,"thread_start_us":127942,"threads_started":1}
W20260619 18:45:56.542203 12535 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.661157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52222 (local address 127.6.120.254:36501)
0619 18:45:53.879793 (+218636us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.884772 (+ 4979us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:55.096157 (+1211385us) server_negotiation.cc:407] Connection header received
0619 18:45:55.096287 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:55.096312 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.096560 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.096739 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.534031 (+1437292us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52222: received 0 of 154 requested bytes
Metrics: {"mutex_wait_us":88914,"server-negotiator.queue_time_us":53408}
W20260619 18:45:56.576856 12722 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.907840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52130)
0619 18:45:53.113936 (+206096us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.117477 (+ 3541us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.139263 (+ 21786us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:53.661828 (+522565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:53.665829 (+ 4001us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:53.737705 (+ 71876us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.163746 (+1426041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.163811 (+ 65us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.575326 (+1411515us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1165,"mutex_wait_us":1480688}
W20260619 18:45:56.580634 12897 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.229838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52194)
0619 18:45:53.770293 (+540455us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.775730 (+ 5437us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.828473 (+ 52743us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:53.944211 (+115738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:53.949821 (+ 5610us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:53.982097 (+ 32276us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.594817 (+1612720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.594885 (+ 68us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.566753 (+971868us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":11971,"mutex_wait_us":1632674}
W20260619 18:45:56.584689 12441 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.952624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52156)
0619 18:45:53.241730 (+289106us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.247635 (+ 5905us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.622953 (+375318us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:53.803085 (+180132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:53.825573 (+ 22488us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:53.855906 (+ 30333us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.904332 (+2048426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.904439 (+ 107us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.583219 (+678780us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":159737,"mutex_wait_us":2240382}
W20260619 18:45:56.587595 12596 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.234321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52210 (local address 127.6.120.254:36501)
0619 18:45:53.234834 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.234868 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:53.790639 (+555771us) server_negotiation.cc:407] Connection header received
0619 18:45:53.851913 (+ 61274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:53.856843 (+ 4930us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:54.438906 (+582063us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:54.999509 (+560603us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:54.999736 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.000391 (+ 655us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.095691 (+ 95300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.664592 (+568901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.585800 (+921208us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52210: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":749776,"server-negotiator.queue_time_us":90,"spinlock_wait_cycles":55373568}
W20260619 18:45:56.605453 12569 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.026181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52150 (local address 127.6.120.254:36501)
0619 18:45:53.246668 (+220487us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.248470 (+ 1802us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:53.250475 (+ 2005us) server_negotiation.cc:407] Connection header received
0619 18:45:53.623183 (+372708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:53.645965 (+ 22782us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:53.945817 (+299852us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:54.460900 (+515083us) spinlock_profiling.cc:243] Waited 5.17 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:54.477063 (+ 16163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:54.506793 (+ 29730us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.539541 (+2032748us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52150: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1658338,"server-negotiator.queue_time_us":95021,"spinlock_wait_cycles":48769536}
W20260619 18:45:56.606827 12557 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.031355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52120 (local address 127.6.120.254:36501)
0619 18:45:52.966370 (+935015us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:52.966411 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:52.966482 (+ 71us) server_negotiation.cc:407] Connection header received
0619 18:45:52.966638 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:52.966663 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:52.982466 (+ 15803us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:53.029290 (+ 46824us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.515430 (+3486140us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52120: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":3393700,"server-negotiator.queue_time_us":832032}
W20260619 18:45:56.631691 13020 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.535s user 0.014s sys 0.035s
W20260619 18:45:56.632133 13020 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.575s user 0.014s sys 0.036s
W20260619 18:45:56.633582 12979 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.576s user 0.030s sys 0.047s
W20260619 18:45:56.633957 12979 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.600s user 0.030s sys 0.047s
W20260619 18:45:56.634414 12560 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.223886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52182 (local address 127.6.120.254:36501)
0619 18:45:53.226290 (+ 2404us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.226321 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:53.226379 (+ 58us) server_negotiation.cc:407] Connection header received
0619 18:45:53.226518 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:53.226542 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:53.226795 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:53.226999 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:54.089322 (+862323us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1ec6c 00007f1383e1ebd6 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:55.341551 (+1252229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.757998 (+416447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.630713 (+872715us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52182: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1935529,"server-negotiator.queue_time_us":1965,"spinlock_wait_cycles":16205696}
W20260619 18:45:56.637876 12972 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.527786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48780)
0619 18:45:52.951421 (+1423635us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:52.953204 (+ 1783us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:52.972034 (+ 18830us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:53.117310 (+145276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:53.120709 (+ 3399us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:53.130205 (+ 9496us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:56.029447 (+2899242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.029521 (+ 74us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.607357 (+577836us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":979308,"mutex_wait_us":3376574,"thread_start_us":1348621,"threads_started":1}
I20260619 18:45:56.649049 12145 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:56.649641 12145 scanner-internal.cc:458] Time spent opening tablet: real 5.586s user 0.011s sys 0.016s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:56.651010 12516 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.231360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52194 (local address 127.6.120.254:36501)
0619 18:45:53.231940 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.231971 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:53.783546 (+551575us) server_negotiation.cc:407] Connection header received
0619 18:45:53.851691 (+ 68145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:53.856727 (+ 5036us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:53.919759 (+ 63032us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:53.941410 (+ 21651us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.062199 (+1120789us) spinlock_profiling.cc:243] Waited 33 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:55.623283 (+561084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.487087 (+863804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.649142 (+162055us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52194: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2152723,"server-negotiator.queue_time_us":94,"spinlock_wait_cycles":75816832}
W20260619 18:45:56.654584 12974 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.860930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48798 (local address 127.6.120.193:37901)
0619 18:45:53.696719 (+835789us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.706628 (+ 9909us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:53.790133 (+ 83505us) server_negotiation.cc:407] Connection header received
0619 18:45:53.887693 (+ 97560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:53.904665 (+ 16972us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:53.969955 (+ 65290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:53.983413 (+ 13458us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:55.104419 (+1121006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.541968 (+1437549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.652806 (+110838us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48798: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2272947,"server-negotiator.queue_time_us":282713}
W20260619 18:45:56.656452 12577 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.972298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52160 (local address 127.6.120.254:36501)
0619 18:45:53.239236 (+266938us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.241056 (+ 1820us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:53.247626 (+ 6570us) server_negotiation.cc:407] Connection header received
0619 18:45:53.264309 (+ 16683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:53.609136 (+344827us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:53.969792 (+360656us) spinlock_profiling.cc:243] Waited 8.05 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:53.987149 (+ 17357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:54.002476 (+ 15327us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:54.923196 (+920720us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:55.667111 (+743915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.913686 (+246575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.653189 (+739503us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52160: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1893287,"server-negotiator.queue_time_us":141728,"spinlock_wait_cycles":29371008}
W20260619 18:45:56.670179 12941 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.116736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48754 (local address 127.6.120.193:37901)
0619 18:45:51.417382 (+300646us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.419421 (+ 2039us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.591299 (+171878us) server_negotiation.cc:407] Connection header received
0619 18:45:51.591576 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.591618 (+ 42us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.592074 (+ 456us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.646070 (+ 53996us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:53.106078 (+1460008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.182277 (+2076199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.650236 (+1467959us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48754: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":4256353,"server-negotiator.queue_time_us":186845}
W20260619 18:45:56.672441 13000 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.709777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52242)
0619 18:45:54.951740 (+1241963us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:54.951838 (+ 98us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:54.952258 (+ 420us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.545884 (+593626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.565798 (+ 19914us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.570043 (+ 4245us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.632481 (+1062438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.632549 (+ 68us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.670882 (+ 38333us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1230799,"mutex_wait_us":966471,"thread_start_us":1210155,"threads_started":1}
W20260619 18:45:56.674376 12962 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.362297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48764)
0619 18:45:51.591291 (+228994us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.591374 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.591760 (+ 386us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:52.215309 (+623549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:52.215381 (+ 72us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:52.215474 (+ 93us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:55.112485 (+2897011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.114425 (+ 1940us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.606649 (+1492224us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":228213,"mutex_wait_us":3895443,"thread_start_us":87943,"threads_started":1}
W20260619 18:45:56.674700 12463 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.234186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52210)
0619 18:45:53.771259 (+537073us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.776741 (+ 5482us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.834186 (+ 57445us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.000143 (+1165957us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.000181 (+ 38us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.000313 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.095005 (+ 94692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.095060 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.668604 (+573544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:55.668664 (+ 60us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:56.569662 (+900998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.573792 (+ 4130us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.651185 (+ 77393us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":12812,"mutex_wait_us":963461}
W20260619 18:45:56.676542 12185 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.908308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52136)
0619 18:45:53.116559 (+208251us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.120578 (+ 4019us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.141461 (+ 20883us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:54.466043 (+1324582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:54.466083 (+ 40us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:54.466207 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:54.614929 (+148722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:54.614997 (+ 68us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.886620 (+1271623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:55.886716 (+ 96us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:56.052872 (+166156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.052925 (+ 53us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.674974 (+622049us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":672,"mutex_wait_us":904671}
W20260619 18:45:56.676774 12537 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.950078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52150)
0619 18:45:53.136332 (+186254us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.139154 (+ 2822us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.150443 (+ 11289us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:54.511917 (+1361474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:54.514426 (+ 2509us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:54.562594 (+ 48168us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.476724 (+1914130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.476793 (+ 69us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.626693 (+149900us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":999,"mutex_wait_us":1970889}
I20260619 18:45:56.677310 12615 scanner-internal.cc:172] Scan of tablet d63b7834d93346288748391962132228 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:56.677986 12615 scanner-internal.cc:458] Time spent opening tablet: real 5.664s user 0.009s sys 0.009s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:56.679181 12410 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.093712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52174)
0619 18:45:53.149752 (+ 56040us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.149803 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.168928 (+ 19125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:53.738818 (+569890us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:53.738861 (+ 43us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:53.740325 (+ 1464us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.644407 (+2904082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.653015 (+ 8608us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.653743 (+ 728us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":11730,"mutex_wait_us":2839119}
W20260619 18:45:56.682425 13001 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.709898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52238)
0619 18:45:55.187061 (+1477163us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.187128 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.187435 (+ 307us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.540325 (+352890us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.544340 (+ 4015us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.571268 (+ 26928us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.028453 (+457185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.028514 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.676718 (+648204us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1422323,"mutex_wait_us":314094,"thread_start_us":1305127,"threads_started":1}
W20260619 18:45:56.682574 13014 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.725234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52244)
0619 18:45:55.904718 (+2179484us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.904817 (+ 99us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.905186 (+ 369us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.910696 (+ 5510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.914769 (+ 4073us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.919445 (+ 4676us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.635684 (+716239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.635746 (+ 62us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.677166 (+ 41420us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":2153459,"mutex_wait_us":707388,"thread_start_us":1557200,"threads_started":1}
W20260619 18:45:56.683831 12603 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.949984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52136 (local address 127.6.120.254:36501)
0619 18:45:53.238943 (+288959us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.240973 (+ 2030us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:53.247505 (+ 6532us) server_negotiation.cc:407] Connection header received
0619 18:45:53.606574 (+359069us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:53.616488 (+ 9914us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:53.884188 (+267700us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:54.443262 (+559074us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:54.456692 (+ 13430us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:54.465104 (+ 8412us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.089144 (+624040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.835968 (+746824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.665996 (+830028us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52136: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2105269,"server-negotiator.queue_time_us":164284,"spinlock_wait_cycles":75455104}
W20260619 18:45:56.685948 12998 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.661224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52222)
0619 18:45:55.095575 (+1434351us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.095652 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.095943 (+ 291us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.108291 (+ 12348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.110944 (+ 2653us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.133960 (+ 23016us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.054784 (+920824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.054878 (+ 94us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.669499 (+614621us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1397020,"mutex_wait_us":1058928,"thread_start_us":1311390,"threads_started":1}
W20260619 18:45:56.680698 12570 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.995225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52076 (local address 127.6.120.254:36501)
0619 18:45:52.121709 (+126484us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:52.131029 (+ 9320us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:52.133506 (+ 2477us) server_negotiation.cc:407] Connection header received
0619 18:45:52.158531 (+ 25025us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:52.161449 (+ 2918us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:52.173684 (+ 12235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:52.189499 (+ 15815us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:54.675469 (+2485970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.631528 (+1956059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.671372 (+ 39844us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52076: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":4247875,"server-negotiator.queue_time_us":14440}
W20260619 18:45:56.688985 12752 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.658118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48808 (local address 127.6.120.193:37901)
0619 18:45:53.842959 (+184841us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.848362 (+ 5403us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:55.836945 (+1988583us) server_negotiation.cc:407] Connection header received
0619 18:45:55.880216 (+ 43271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:55.881429 (+ 1213us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.898929 (+ 17500us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.906992 (+ 8063us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:56.667281 (+760289us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48808: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":732272,"server-negotiator.queue_time_us":5969}
W20260619 18:45:56.692740 12613 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.120040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52156 (local address 127.6.120.254:36501)
0619 18:45:53.650997 (+530957us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.654199 (+ 3202us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:53.659714 (+ 5515us) server_negotiation.cc:407] Connection header received
0619 18:45:53.682952 (+ 23238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:53.697467 (+ 14515us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:53.766249 (+ 68782us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:53.797157 (+ 30908us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.904965 (+2107808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.688666 (+783701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.689268 (+ 602us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52156: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1892521,"server-negotiator.queue_time_us":22477}
W20260619 18:45:56.696198 12194 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.665477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52266)
0619 18:45:53.850661 (+185184us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.856040 (+ 5379us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.887990 (+ 31950us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:54.034253 (+146263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:54.044617 (+ 10364us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:54.066594 (+ 21977us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.340303 (+1273709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.340396 (+ 93us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.677484 (+1337088us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":184,"mutex_wait_us":1233314}
W20260619 18:45:56.699582 13004 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.237555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48808)
0619 18:45:55.817142 (+2579587us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.818948 (+ 1806us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.833212 (+ 14264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.910258 (+ 77046us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.911111 (+ 853us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.915809 (+ 4698us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:56.697485 (+781676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.697539 (+ 54us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.698129 (+ 590us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":2541934,"mutex_wait_us":741363,"thread_start_us":2072722,"threads_started":1}
W20260619 18:45:56.701120 12612 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.006689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52092 (local address 127.6.120.254:36501)
0619 18:45:52.018099 (+ 11410us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:52.018132 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:52.160510 (+142378us) server_negotiation.cc:407] Connection header received
0619 18:45:52.173971 (+ 13461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:52.174016 (+ 45us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:52.187119 (+ 13103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:52.187330 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:54.736737 (+2549407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.695067 (+1958330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.695746 (+ 679us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52092: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2187008,"server-negotiator.queue_time_us":11003,"spinlock_wait_cycles":1878400}
I20260619 18:45:56.701619 12143 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:56.702229 12143 scanner-internal.cc:458] Time spent opening tablet: real 5.345s user 0.017s sys 0.034s
W20260619 18:45:56.702486 12523 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.653396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52236 (local address 127.6.120.254:36501)
0619 18:45:53.857153 (+203757us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.862623 (+ 5470us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:55.593925 (+1731302us) server_negotiation.cc:407] Connection header received
0619 18:45:55.594196 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:55.594249 (+ 53us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.594612 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.594878 (+ 266us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.680133 (+1085255us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52236: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":463846,"server-negotiator.queue_time_us":45202}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:56.704583 13005 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.651563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52236)
0619 18:45:53.997270 (+345707us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b4400023f4c. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383d68a95 00007f1383d694b2 00007f138a346511 00007f138a341e1a 00007f1383e385fe 00007f138cc63a39 00007f1383e558bb 00007f1383e53cbf 00007f1383e55e22 00007f138892cc48
0619 18:45:55.593011 (+1595741us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.593123 (+ 112us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.593489 (+ 366us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.599079 (+ 5590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.602781 (+ 3702us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.635234 (+ 32453us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.685504 (+1050270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.685562 (+ 58us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.686154 (+ 592us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1940611,"mutex_wait_us":905208,"spinlock_wait_cycles":4868352,"thread_start_us":1515741,"threads_started":1}
W20260619 18:45:56.748452 12014 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.973398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52064 (local address 127.6.120.254:36501)
0619 18:45:52.034504 (+ 61106us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:52.036664 (+ 2160us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:52.058215 (+ 21551us) server_negotiation.cc:407] Connection header received
0619 18:45:52.065619 (+ 7404us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:52.068953 (+ 3334us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:52.138617 (+ 69664us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:52.159987 (+ 21370us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:54.604805 (+2444818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.700232 (+2095427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.724718 (+ 24486us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52064: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2521502,"server-negotiator.queue_time_us":9602}
W20260619 18:45:56.750998 12645 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.751002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52266 (local address 127.6.120.254:36501)
0619 18:45:53.933403 (+182401us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.940346 (+ 6943us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:53.951856 (+ 11510us) server_negotiation.cc:407] Connection header received
0619 18:45:53.969824 (+ 17968us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:53.973743 (+ 3919us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:54.002101 (+ 28358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:54.028898 (+ 26797us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.045100 (+2016202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.714034 (+668934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.714824 (+ 790us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52266: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":2619405,"server-negotiator.queue_time_us":40695}
W20260619 18:45:56.770038 12182 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.768887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52252 (local address 127.6.120.254:36501)
0619 18:45:53.875650 (+106763us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.875686 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:55.296407 (+1420721us) server_negotiation.cc:407] Connection header received
0619 18:45:55.296754 (+ 347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:55.296791 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.297287 (+ 496us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.297606 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.768734 (+1471128us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52252: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":746459,"server-negotiator.queue_time_us":33666}
W20260619 18:45:56.771832 12536 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.941539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52130 (local address 127.6.120.254:36501)
0619 18:45:53.147497 (+205958us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.150021 (+ 2524us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:53.153230 (+ 3209us) server_negotiation.cc:407] Connection header received
0619 18:45:53.162675 (+ 9445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:53.168730 (+ 6055us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:53.262321 (+ 93591us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:53.654742 (+392421us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.428164 (+1773422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.734652 (+1306488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.753514 (+ 18862us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52130: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2746953,"server-negotiator.queue_time_us":74629}
W20260619 18:45:56.783835 12573 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.665102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52270)
0619 18:45:53.900383 (+235281us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.906111 (+ 5728us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.941819 (+ 35708us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:54.840833 (+899014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:54.840874 (+ 41us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:54.841010 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.094226 (+253216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.094281 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.476861 (+1382580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.476924 (+ 63us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:56.744128 (+267204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.744208 (+ 80us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.782243 (+ 38035us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":71526,"mutex_wait_us":506039}
W20260619 18:45:56.789382 12081 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.919845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52270 (local address 127.6.120.254:36501)
0619 18:45:54.029546 (+109701us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:54.032688 (+ 3142us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:54.042402 (+ 9714us) server_negotiation.cc:407] Connection header received
0619 18:45:54.042584 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:54.042612 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:54.757355 (+714743us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:54.777518 (+ 20163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:54.788337 (+ 10819us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.329799 (+541462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.476409 (+1146610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.787754 (+311345us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52270: BlockingRecv error: recv got EOF from 127.0.0.1:52270 (error 108)
Metrics: {"mutex_wait_us":1578886,"server-negotiator.queue_time_us":76903,"spinlock_wait_cycles":5324160}
W20260619 18:45:56.797379 12592 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.793112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52282)
0619 18:45:53.955370 (+162258us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.963299 (+ 7929us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.985995 (+ 22696us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.023129 (+1037134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.026940 (+ 3811us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.040132 (+ 13192us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.639035 (+1598903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.639116 (+ 81us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.768461 (+129345us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":98,"mutex_wait_us":1514669}
W20260619 18:45:56.791867 13002 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.733451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52252)
0619 18:45:55.182741 (+1449290us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.182855 (+ 114us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.183246 (+ 391us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.533247 (+350001us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.540587 (+ 7340us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.565597 (+ 25010us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.789549 (+1223952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.789625 (+ 76us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.790326 (+ 701us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1440921,"mutex_wait_us":1161974,"thread_start_us":1528257,"threads_started":1}
W20260619 18:45:56.817904 12584 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.966638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52160)
0619 18:45:53.141314 (+174676us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.143942 (+ 2628us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.161092 (+ 17150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:54.011438 (+850346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:54.024736 (+ 13298us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:54.052881 (+ 28145us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:54.613881 (+561000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:54.613954 (+ 73us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.916744 (+1302790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:55.916816 (+ 72us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:56.788788 (+871972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.788871 (+ 83us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.815393 (+ 26522us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":4626,"mutex_wait_us":1353573}
W20260619 18:45:56.829066 12556 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.783633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52244 (local address 127.6.120.254:36501)
0619 18:45:53.952564 (+168931us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.957739 (+ 5175us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:55.905029 (+1947290us) server_negotiation.cc:407] Connection header received
0619 18:45:55.905472 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:55.905515 (+ 43us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.905820 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.906072 (+ 252us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.647674 (+741602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.826447 (+178773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.827306 (+ 859us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52244: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":159273,"server-negotiator.queue_time_us":43834}
W20260619 18:45:56.860229 12631 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.855237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52306)
0619 18:45:53.860641 (+ 5404us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.860695 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.860965 (+ 270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:54.428836 (+567871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:54.428873 (+ 37us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:54.429012 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.023187 (+1594175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.023272 (+ 85us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.858873 (+835601us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":472,"mutex_wait_us":1425504}
W20260619 18:45:56.862975 12899 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.868864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52322)
0619 18:45:53.903611 (+ 34747us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.903674 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.909487 (+ 5813us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.426679 (+1517192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.426743 (+ 64us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.426915 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.007345 (+580430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.015828 (+ 8483us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.055727 (+ 39899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.055782 (+ 55us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:56.783456 (+727674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.783515 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.828996 (+ 45481us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":9046,"mutex_wait_us":1158533}
W20260619 18:45:56.890362 12777 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.780245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52298)
0619 18:45:53.939353 (+159108us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.945173 (+ 5820us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.973029 (+ 27856us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:53.999929 (+ 26900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:53.999970 (+ 41us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:54.000093 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.905308 (+1905215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.905383 (+ 75us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.538110 (+632727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.538163 (+ 53us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:56.689459 (+151296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.689532 (+ 73us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.873747 (+184215us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":4336,"mutex_wait_us":2059363}
W20260619 18:45:56.929075 12411 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.681218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52242 (local address 127.6.120.254:36501)
0619 18:45:53.918776 (+237558us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.922589 (+ 3813us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:54.953599 (+1031010us) server_negotiation.cc:407] Connection header received
0619 18:45:54.964961 (+ 11362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:54.994903 (+ 29942us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.066840 (+ 71937us) spinlock_profiling.cc:243] Waited 3.87 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:55.324037 (+257197us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:55.353040 (+ 29003us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.353308 (+ 268us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.633544 (+1280236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.880093 (+246549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.925128 (+ 45035us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52242: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1435291,"server-negotiator.queue_time_us":88095,"spinlock_wait_cycles":586263168}
W20260619 18:45:56.936407 12590 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.826902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52284)
0619 18:45:53.973047 (+146145us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.977348 (+ 4301us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.992864 (+ 15516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:54.560079 (+567215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:54.562288 (+ 2209us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:54.610522 (+ 48234us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:54.611063 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:54.611126 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.872759 (+2261633us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 1179 requested bytes
Metrics: {"client-negotiator.queue_time_us":6804}
W20260619 18:45:56.947311 12502 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.958401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52350 (local address 127.6.120.254:36501)
0619 18:45:54.433258 (+474857us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:54.439404 (+ 6146us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:54.443375 (+ 3971us) server_negotiation.cc:407] Connection header received
0619 18:45:54.453465 (+ 10090us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:54.457609 (+ 4144us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:54.507252 (+ 49643us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:54.522939 (+ 15687us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.349494 (+826555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.595282 (+1245788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.945611 (+350329us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52350: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1336700,"server-negotiator.queue_time_us":60793}
W20260619 18:45:56.952185 12546 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.979676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52284 (local address 127.6.120.254:36501)
0619 18:45:54.446274 (+466598us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:54.449630 (+ 3356us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:54.452828 (+ 3198us) server_negotiation.cc:407] Connection header received
0619 18:45:54.464540 (+ 11712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:54.473556 (+ 9016us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:54.518433 (+ 44877us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:54.553872 (+ 35439us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.057647 (+503775us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:55.898677 (+841030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.868019 (+969342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.950631 (+ 82612us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52284: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"mutex_wait_us":2082263,"server-negotiator.queue_time_us":60571,"spinlock_wait_cycles":12424448}
W20260619 18:45:56.954355 13011 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.983283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52382)
0619 18:45:55.598758 (+1615475us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.611727 (+ 12969us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.626993 (+ 15266us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.650051 (+ 23058us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.651842 (+ 1791us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.683384 (+ 31542us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.475164 (+791780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.475260 (+ 96us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.953003 (+477743us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1582974,"mutex_wait_us":760287,"thread_start_us":1122990,"threads_started":1}
W20260619 18:45:56.960021 13007 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.041245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52398)
0619 18:45:55.581355 (+1540110us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.581438 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.584763 (+ 3325us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.598273 (+ 13510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.598813 (+ 540us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.632232 (+ 33419us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.698856 (+1066624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.698926 (+ 70us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.958604 (+259678us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1532552,"mutex_wait_us":1001778,"thread_start_us":1128801,"threads_started":1}
W20260619 18:45:56.961928 12652 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.911142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52364 (local address 127.6.120.254:36501)
0619 18:45:53.996098 (+ 84956us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.996150 (+ 52us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:54.034642 (+ 38492us) server_negotiation.cc:407] Connection header received
0619 18:45:54.071935 (+ 37293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:54.076055 (+ 4120us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:54.929303 (+853248us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:55.038153 (+108850us) spinlock_profiling.cc:243] Waited 5.15 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:55.046887 (+ 8734us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.058741 (+ 11854us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.643428 (+1584687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.715529 (+ 72101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.960270 (+244741us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52364: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":892627,"server-negotiator.queue_time_us":73698,"spinlock_wait_cycles":22223488}
W20260619 18:45:56.980026 12653 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.838888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52306 (local address 127.6.120.254:36501)
0619 18:45:54.051317 (+212429us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:54.054304 (+ 2987us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:54.055749 (+ 1445us) server_negotiation.cc:407] Connection header received
0619 18:45:54.072948 (+ 17199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:54.076916 (+ 3968us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:54.099320 (+ 22404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:54.427887 (+328567us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:54.947432 (+519545us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:55.041887 (+ 94455us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:55.092727 (+ 50840us) spinlock_profiling.cc:243] Waited 9.47 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:56.029119 (+936392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.889445 (+860326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.943229 (+ 53784us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52306: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1258357,"server-negotiator.queue_time_us":108268,"spinlock_wait_cycles":32816128}
W20260619 18:45:56.991794 12459 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.902236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52372)
0619 18:45:54.025509 (+123273us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:54.027351 (+ 1842us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:54.049042 (+ 21691us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:54.476204 (+427162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:54.495217 (+ 19013us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:54.521174 (+ 25957us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.093170 (+571996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.093227 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.748693 (+1655466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.748767 (+ 74us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:56.863290 (+114523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.863353 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.989156 (+125803us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":3145,"mutex_wait_us":685182}
W20260619 18:45:57.003434 12518 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.896088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52364)
0619 18:45:54.026189 (+130101us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:54.027970 (+ 1781us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:54.054424 (+ 26454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.063178 (+1008754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.064735 (+ 1557us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.068605 (+ 3870us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.641839 (+1573234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.641927 (+ 88us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.715965 (+ 74038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.716008 (+ 43us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.000558 (+284550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.000615 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.001651 (+ 1036us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":9558,"mutex_wait_us":1775760}
W20260619 18:45:57.007426 12719 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.849825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52290)
0619 18:45:53.860720 (+ 10895us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.860793 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.875765 (+ 14972us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:54.604546 (+728781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:54.604591 (+ 45us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:54.604717 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.044053 (+1439336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.044176 (+ 123us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.697668 (+653492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.697711 (+ 43us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.004365 (+306654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.004427 (+ 62us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.005633 (+ 1206us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":5056,"mutex_wait_us":1633583}
W20260619 18:45:57.010286 12551 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.888550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52298 (local address 127.6.120.254:36501)
0619 18:45:53.995363 (+106813us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.995393 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:53.995452 (+ 59us) server_negotiation.cc:407] Connection header received
0619 18:45:53.995592 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:53.995616 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:53.995881 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:53.996076 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.905969 (+1909893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.537777 (+631808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.691325 (+153548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.998003 (+306678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.008385 (+ 10382us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52298: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2741978,"server-negotiator.queue_time_us":78780}
W20260619 18:45:57.042249 12624 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.806094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52282 (local address 127.6.120.254:36501)
0619 18:45:53.896875 (+ 90781us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.896908 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:53.968416 (+ 71508us) server_negotiation.cc:407] Connection header received
0619 18:45:54.001304 (+ 32888us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:54.006210 (+ 4906us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:54.881209 (+874999us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:54.948359 (+ 67150us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:54.965896 (+ 17537us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.017986 (+ 52090us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.066138 (+ 48152us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:56.639352 (+1573214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.012143 (+372791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.018296 (+ 6153us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52282: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":897669,"server-negotiator.queue_time_us":90388,"spinlock_wait_cycles":93618560,"thread_start_us":1430537,"threads_started":1}
W20260619 18:45:57.017613 12533 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.223766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52182)
0619 18:45:53.224527 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.224581 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.224873 (+ 292us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:53.230095 (+ 5222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:53.230129 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:53.230261 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.341027 (+2110766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.341098 (+ 71us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.758540 (+417442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:55.758606 (+ 66us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.001014 (+1242408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.001073 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.001818 (+ 745us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":3223120}
W20260619 18:45:57.022925 12497 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.047854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52372 (local address 127.6.120.254:36501)
0619 18:45:54.430511 (+382657us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:54.430565 (+ 54us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:54.430640 (+ 75us) server_negotiation.cc:407] Connection header received
0619 18:45:54.430807 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:54.430849 (+ 42us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:54.458362 (+ 27513us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:54.474028 (+ 15666us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:54.949819 (+475791us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:55.052891 (+103072us) spinlock_profiling.cc:243] Waited 6.09 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:55.076098 (+ 23207us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f13888caca0 00007f138897f49c 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:55.343218 (+267120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.747550 (+1404332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.869509 (+121959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.008002 (+138493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.008612 (+ 610us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52372: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1729520,"server-negotiator.queue_time_us":27407,"spinlock_wait_cycles":66355840}
W20260619 18:45:57.046372 12816 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.047495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52408)
0619 18:45:54.461498 (+414003us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:54.463802 (+ 2304us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:54.503274 (+ 39472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.423254 (+919980us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.423323 (+ 69us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.423529 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.817923 (+394394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.819351 (+ 1428us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.044740 (+1225389us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":2975,"mutex_wait_us":382873}
W20260619 18:45:57.027628 12591 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.261754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52398 (local address 127.6.120.254:36501)
0619 18:45:55.338445 (+ 76691us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:55.338489 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:55.582870 (+244381us) server_negotiation.cc:407] Connection header received
0619 18:45:55.590890 (+ 8020us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:55.590929 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.591259 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.591539 (+ 280us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.712047 (+120508us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:56.700612 (+988565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.012519 (+311907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.025632 (+ 13113us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52398: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1255212,"server-negotiator.queue_time_us":76102,"spinlock_wait_cycles":8309504}
W20260619 18:45:57.033946 12904 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.064769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48812 (local address 127.6.120.193:37901)
0619 18:45:54.473227 (+408458us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:54.477253 (+ 4026us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:55.185748 (+708495us) server_negotiation.cc:407] Connection header received
0619 18:45:55.185941 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:55.185990 (+ 49us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.186407 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.186593 (+ 186us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:56.925179 (+1738586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.007112 (+ 81933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.032751 (+ 25639us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48812: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1493596,"server-negotiator.queue_time_us":3081}
W20260619 18:45:57.013624 12091 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.035061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52290 (local address 127.6.120.254:36501)
0619 18:45:54.476384 (+441323us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:54.495271 (+ 18887us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:54.499297 (+ 4026us) server_negotiation.cc:407] Connection header received
0619 18:45:54.512251 (+ 12954us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:54.517964 (+ 5713us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:54.581714 (+ 63750us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:54.603830 (+ 22116us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.045136 (+1441306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.697289 (+652153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.007019 (+309730us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52290: BlockingRecv error: recv got EOF from 127.0.0.1:52290 (error 108)
Metrics: {"mutex_wait_us":1239603,"server-negotiator.queue_time_us":33216}
W20260619 18:45:57.055970 12648 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.729504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52238 (local address 127.6.120.254:36501)
0619 18:45:53.939078 (+209574us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.944581 (+ 5503us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:55.348568 (+1403987us) server_negotiation.cc:407] Connection header received
0619 18:45:55.348734 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:55.348758 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.349019 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.349186 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.031276 (+682090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.053499 (+1022223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.054417 (+ 918us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52238: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1672960,"server-negotiator.queue_time_us":58011}
W20260619 18:45:57.080147 12491 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.067195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52418 (local address 127.6.120.254:36501)
0619 18:45:54.599548 (+532353us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:54.601342 (+ 1794us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:54.603909 (+ 2567us) server_negotiation.cc:407] Connection header received
0619 18:45:54.643765 (+ 39856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:54.646504 (+ 2739us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:54.742201 (+ 95697us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:54.751150 (+ 8949us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.844952 (+1093802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.637371 (+792419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.772946 (+135575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.893123 (+120177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.032880 (+139757us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:57.070216 (+ 37336us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52418: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1298289,"server-negotiator.queue_time_us":395372}
W20260619 18:45:57.126780 13012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.102503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48812)
0619 18:45:55.185017 (+1082514us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.185092 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.185509 (+ 417us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.192324 (+ 6815us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.192367 (+ 43us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.192441 (+ 74us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:56.924587 (+1732146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.924665 (+ 78us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.008264 (+ 83599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.008297 (+ 33us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.075413 (+ 67116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.075472 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.124664 (+ 49192us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1068403,"mutex_wait_us":1787632,"thread_start_us":1197506,"threads_started":1}
W20260619 18:45:57.138057 12432 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.923857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52350)
0619 18:45:54.046466 (+122609us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:54.049556 (+ 3090us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:54.071621 (+ 22065us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:54.526115 (+454494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:54.540579 (+ 14464us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:54.598545 (+ 57966us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.345592 (+747047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.345665 (+ 73us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.603866 (+1258201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.604582 (+ 716us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.036345 (+431763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.036431 (+ 86us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.126511 (+ 90080us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1922,"mutex_wait_us":1172463}
I20260619 18:45:57.139415 12146 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:57.140187 12146 scanner-internal.cc:458] Time spent opening tablet: real 4.732s user 0.006s sys 0.016s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:57.143713 12544 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.260641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52322 (local address 127.6.120.254:36501)
0619 18:45:55.333070 (+ 72429us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:55.333115 (+ 45us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:55.333163 (+ 48us) server_negotiation.cc:407] Connection header received
0619 18:45:55.333329 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:55.333360 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.333713 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.333922 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.025302 (+691380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.047298 (+ 21996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.784252 (+736954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.070093 (+285841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.141622 (+ 71529us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52322: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":819321,"server-negotiator.queue_time_us":71630}
W20260619 18:45:57.159505 12792 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.071573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52424)
0619 18:45:54.499348 (+427775us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:54.502821 (+ 3473us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:54.527499 (+ 24678us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:54.856358 (+328859us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:54.858926 (+ 2568us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:54.928368 (+ 69442us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.478292 (+1549924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.478375 (+ 83us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.772218 (+293843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.772257 (+ 39us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.026918 (+254661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.026987 (+ 69us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.037874 (+ 10887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.037911 (+ 37us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.061994 (+ 24083us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:57.106596 (+ 44602us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:57.106639 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:57.106712 (+ 73us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:57.106920 (+ 208us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:57.145373 (+ 38453us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":3879,"mutex_wait_us":1786030}
W20260619 18:45:57.172214 12242 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 249449us
W20260619 18:45:57.176070 12585 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.261289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52382 (local address 127.6.120.254:36501)
0619 18:45:55.337581 (+ 76292us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:55.337637 (+ 56us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:55.622009 (+284372us) server_negotiation.cc:407] Connection header received
0619 18:45:55.630938 (+ 8929us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:55.630989 (+ 51us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.631320 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.631612 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.642464 (+1010852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.097787 (+455323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.125030 (+ 27243us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52382: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1356925,"server-negotiator.queue_time_us":75736}
W20260619 18:45:57.203956 12524 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.959992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52406)
0619 18:45:54.042574 (+ 82582us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:54.042625 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:54.042860 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:54.845453 (+802593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:54.845490 (+ 37us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:54.845620 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.443346 (+597726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.471127 (+ 27781us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.056191 (+585064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.056237 (+ 46us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:56.826685 (+770448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.826770 (+ 85us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.829280 (+ 2510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.829313 (+ 33us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:56.869750 (+ 40437us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:57.036712 (+166962us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:57.036740 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:57.036796 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:57.036910 (+ 114us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:57.201786 (+164876us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":5820,"mutex_wait_us":1594723}
W20260619 18:45:57.242290 12636 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.262672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52408 (local address 127.6.120.254:36501)
0619 18:45:55.346320 (+ 83648us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:55.346380 (+ 60us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:55.346458 (+ 78us) server_negotiation.cc:407] Connection header received
0619 18:45:55.346663 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:55.346698 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.347004 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.347201 (+ 197us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.025171 (+677970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.163744 (+1138573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.240556 (+ 76812us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52408: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1714513,"server-negotiator.queue_time_us":82996}
W20260619 18:45:57.264164 12087 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.429986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52424 (local address 127.6.120.254:36501)
0619 18:45:54.762142 (+332156us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:54.763514 (+ 1372us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:54.779007 (+ 15493us) server_negotiation.cc:407] Connection header received
0619 18:45:54.784839 (+ 5832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:54.788914 (+ 4075us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:54.847450 (+ 58536us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:54.847671 (+ 221us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.484518 (+1636847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.768360 (+283842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.028908 (+260548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.030549 (+ 1641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.030933 (+ 384us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:57.220724 (+189791us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52424: BlockingRecv error: recv got EOF from 127.0.0.1:52424 (error 108)
Metrics: {"mutex_wait_us":1265741,"server-negotiator.queue_time_us":189097}
W20260619 18:45:57.274173 12058 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.429425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52406 (local address 127.6.120.254:36501)
0619 18:45:54.757225 (+327800us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:54.759504 (+ 2279us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:54.761714 (+ 2210us) server_negotiation.cc:407] Connection header received
0619 18:45:54.778838 (+ 17124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:54.780695 (+ 1857us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:54.844899 (+ 64204us) spinlock_profiling.cc:243] Waited 53.7 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:54.845143 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:54.845375 (+ 232us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.525332 (+679957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.049023 (+523691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.827064 (+778041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.828362 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.828695 (+ 333us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:57.270149 (+441454us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52406: BlockingRecv error: recv got EOF from 127.0.0.1:52406 (error 108)
Metrics: {"mutex_wait_us":941526,"server-negotiator.queue_time_us":170566,"spinlock_wait_cycles":123567104}
W20260619 18:45:57.275741 12195 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 237153us
W20260619 18:45:57.278232 12896 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.092491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52428)
0619 18:45:54.527284 (+434793us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:54.541238 (+ 13954us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:54.593818 (+ 52580us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.534736 (+940918us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.540421 (+ 5685us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.557181 (+ 16760us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.807303 (+1250122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.807367 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.016905 (+209538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.016955 (+ 50us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.173569 (+156614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.173638 (+ 69us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.276713 (+103075us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":4616,"mutex_wait_us":1372272}
W20260619 18:45:57.315696 12828 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.057244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52418)
0619 18:45:54.465451 (+408207us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:54.465499 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:54.465714 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:54.755271 (+289557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:54.757431 (+ 2160us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:54.782210 (+ 24779us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.831815 (+1049605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.835360 (+ 3545us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.640292 (+804932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.640336 (+ 44us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:56.772613 (+132277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.772665 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.896725 (+124060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.896775 (+ 50us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.177047 (+280272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:57.190778 (+ 13731us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:57.190815 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:57.190870 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:57.190991 (+ 121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:57.313059 (+122068us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":7794,"mutex_wait_us":1456258}
W20260619 18:45:57.354056 12632 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.263106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52428 (local address 127.6.120.254:36501)
0619 18:45:55.348094 (+ 84988us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:55.348148 (+ 54us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:55.348209 (+ 61us) server_negotiation.cc:407] Connection header received
0619 18:45:55.348369 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:55.348407 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.348708 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.348871 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.808245 (+1459374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.016505 (+208260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.352416 (+335911us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52428: BlockingRecv error: recv got EOF from 127.0.0.1:52428 (error 108)
Metrics: {"mutex_wait_us":1405223,"server-negotiator.queue_time_us":84450,"spinlock_wait_cycles":19840}
W20260619 18:45:57.580322 12405 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.428396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52434)
0619 18:45:54.429018 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:54.429072 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:54.429328 (+ 256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:54.848279 (+418951us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:54.848318 (+ 39us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:54.848463 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.630256 (+1781793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.630352 (+ 96us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.924986 (+294634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.925035 (+ 49us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.232612 (+307577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.243639 (+ 11027us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.471568 (+227929us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":2063119}
W20260619 18:45:57.585381 12241 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 186017us
W20260619 18:45:57.640982 12528 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 150055us
W20260619 18:45:57.701833 12490 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.463550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52434 (local address 127.6.120.254:36501)
0619 18:45:54.778727 (+315177us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:54.778771 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:54.782159 (+ 3388us) server_negotiation.cc:407] Connection header received
0619 18:45:54.790675 (+ 8516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:54.846516 (+ 55841us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:54.846778 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:54.847011 (+ 233us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.059790 (+212779us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:55.093113 (+ 33323us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1ec6c 00007f1383e1ebd6 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:56.630782 (+1537669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.924719 (+293937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.249590 (+324871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.641547 (+391957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.697936 (+ 56389us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52434: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":798588,"server-negotiator.queue_time_us":175178,"spinlock_wait_cycles":8444544}
W20260619 18:45:57.728456 12825 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 125435us
W20260619 18:45:57.850801 12826 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 187207us
W20260619 18:45:57.861567 12245 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 198362us
W20260619 18:45:57.861934 12191 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 72780.2us
W20260619 18:45:58.001084 12568 scanner-internal.cc:458] Time spent opening tablet: real 5.053s user 0.029s sys 0.039s
W20260619 18:45:58.018008 12455 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.994586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52540)
0619 18:45:55.071127 (+ 76541us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.072927 (+ 1800us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.084428 (+ 11501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.343974 (+259546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.344047 (+ 73us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.344248 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.573022 (+1228774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.577646 (+ 4624us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.012964 (+435318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.013017 (+ 53us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.239782 (+226765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.239841 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.641184 (+401343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.641225 (+ 41us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.822131 (+180906us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:57.987381 (+165250us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:57.987412 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:57.987474 (+ 62us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:57.987620 (+ 146us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:58.016066 (+ 28446us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":6732,"mutex_wait_us":1599554}
W20260619 18:45:58.079793 12233 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 61050.9us
W20260619 18:45:58.106667 12558 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.262069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52540 (local address 127.6.120.254:36501)
0619 18:45:55.338907 (+ 76838us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:55.338935 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:55.339001 (+ 66us) server_negotiation.cc:407] Connection header received
0619 18:45:55.339183 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:55.339214 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.342244 (+ 3030us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.344681 (+ 2437us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.578334 (+1233653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.011892 (+433558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.240238 (+228346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.640225 (+399987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.640583 (+ 358us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:58.105132 (+464549us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52540: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1999324,"server-negotiator.queue_time_us":76309}
W20260619 18:45:58.109102 12628 scanner-internal.cc:458] Time spent opening tablet: real 3.265s user 0.010s sys 0.010s
W20260619 18:45:58.172501 12135 scanner-internal.cc:458] Time spent opening tablet: real 3.742s user 0.022s sys 0.023s
W20260619 18:45:58.213531 12814 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.846709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52514)
0619 18:45:54.847671 (+ 962us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:54.847739 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:54.848020 (+ 281us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.531525 (+683505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.536386 (+ 4861us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.567604 (+ 31218us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.636979 (+1069375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.637040 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.910235 (+273195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.910273 (+ 38us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.734330 (+824057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.734405 (+ 75us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.991785 (+257380us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":379,"mutex_wait_us":1919101}
W20260619 18:45:58.214216 12976 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 309058us
W20260619 18:45:58.214622 12715 scanner-internal.cc:458] Time spent opening tablet: real 4.129s user 0.007s sys 0.010s
W20260619 18:45:58.200886 12663 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 281097us
W20260619 18:45:58.286805 12619 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.263718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52514 (local address 127.6.120.254:36501)
0619 18:45:55.349004 (+ 85286us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:55.349048 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:55.349108 (+ 60us) server_negotiation.cc:407] Connection header received
0619 18:45:55.349295 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:55.349339 (+ 44us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.349707 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.349986 (+ 279us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.623984 (+273998us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1ec6c 00007f1383e1ebd6 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:56.639433 (+1015449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.898697 (+259264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.735630 (+836933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.865510 (+129880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.109889 (+244379us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:58.280474 (+170585us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52514: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"mutex_wait_us":1321337,"server-negotiator.queue_time_us":84700,"spinlock_wait_cycles":8242560}
W20260619 18:45:58.300125 12675 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 522435us
W20260619 18:45:58.321110 12880 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 241067us
W20260619 18:45:58.350360 12851 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 476909us
W20260619 18:45:58.365375 12823 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.133289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52602)
0619 18:45:55.147529 (+ 14240us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.147593 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.154397 (+ 6804us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:56.652437 (+1498040us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:56.652493 (+ 56us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:56.652629 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:57.099037 (+446408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.099112 (+ 75us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.535902 (+436790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.535938 (+ 36us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.844380 (+308442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.844444 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.210748 (+366304us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":705204}
W20260619 18:45:58.373175 12596 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.273128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52602 (local address 127.6.120.254:36501)
0619 18:45:56.632727 (+1359599us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:56.632760 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:56.632809 (+ 49us) server_negotiation.cc:407] Connection header received
0619 18:45:56.632930 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:56.632956 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:56.648920 (+ 15964us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:56.649183 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:56.649412 (+ 229us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:57.100238 (+450826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.534505 (+434267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.846848 (+312343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.349957 (+503109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.350559 (+ 602us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52602: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1179239,"server-negotiator.queue_time_us":1318027,"spinlock_wait_cycles":33527040}
W20260619 18:45:58.374670 12121 meta_cache.cc:1097] Time spent processing table locations response: real 0.065s user 0.000s sys 0.001s
W20260619 18:45:58.378059 12437 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.995095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52528)
0619 18:45:55.030035 (+ 34940us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.032545 (+ 2510us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.037054 (+ 4509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.589892 (+552838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.589983 (+ 91us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.590208 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.693912 (+1103704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.693973 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.039143 (+345170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.039194 (+ 51us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.269689 (+230495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.269740 (+ 51us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.833113 (+563373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.833168 (+ 55us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.847888 (+ 14720us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:58.161217 (+313329us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:58.161252 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:58.161324 (+ 72us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:58.165369 (+ 4045us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:58.304465 (+139096us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":6870,"mutex_wait_us":1623874}
W20260619 18:45:58.380182 12485 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.340856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52656)
0619 18:45:55.341869 (+ 1013us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.341920 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.342235 (+ 315us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:56.720248 (+1378013us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:56.720283 (+ 35us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:56.720435 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:57.083283 (+362848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.083340 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.450748 (+367408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.451349 (+ 601us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:58.180416 (+729067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:58.181674 (+ 1258us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.378767 (+197093us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":463,"mutex_wait_us":1002775}
W20260619 18:45:58.381726 12535 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.272709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52586 (local address 127.6.120.254:36501)
0619 18:45:56.603050 (+1330341us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:56.603090 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:56.603153 (+ 63us) server_negotiation.cc:407] Connection header received
0619 18:45:56.604475 (+ 1322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:56.605331 (+ 856us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:56.606060 (+ 729us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:56.609004 (+ 2944us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.672691 (+ 63687us) spinlock_profiling.cc:243] Waited 8.66 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:56.774178 (+101487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.862330 (+ 88152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.070543 (+208213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.631430 (+560887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.706919 (+ 75489us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:58.379834 (+672915us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52586: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":918944,"server-negotiator.queue_time_us":1289614,"spinlock_wait_cycles":19910528}
W20260619 18:45:58.383091 12552 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 751332us
W20260619 18:45:58.385346 12569 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.274726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52556 (local address 127.6.120.254:36501)
0619 18:45:56.606483 (+1331757us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:56.606520 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:56.607829 (+ 1309us) server_negotiation.cc:407] Connection header received
0619 18:45:56.623394 (+ 15565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:56.625249 (+ 1855us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:56.667112 (+ 41863us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:56.667323 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.989148 (+321825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.022306 (+ 33158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.650478 (+628172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.848046 (+197568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.848454 (+ 408us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:58.383861 (+535407us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52556: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":669311,"server-negotiator.queue_time_us":1331302}
W20260619 18:45:58.444602 12907 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.051288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52586)
0619 18:45:55.104310 (+ 53022us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.104361 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.104587 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:56.630716 (+1526129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:56.630760 (+ 44us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:56.630917 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.703460 (+ 72543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.703533 (+ 73us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.866714 (+163181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.866757 (+ 43us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.070196 (+203439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.070255 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.635125 (+564870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.635168 (+ 43us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:58.110865 (+475697us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:58.183552 (+ 72687us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:58.184720 (+ 1168us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:58.189476 (+ 4756us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:58.196547 (+ 7071us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:58.372909 (+176362us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":4661,"mutex_wait_us":847009}
W20260619 18:45:58.467962 12187 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.264040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52528 (local address 127.6.120.254:36501)
0619 18:45:55.529759 (+265719us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:55.531459 (+ 1700us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:55.534252 (+ 2793us) server_negotiation.cc:407] Connection header received
0619 18:45:55.540456 (+ 6204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:55.542881 (+ 2425us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.575397 (+ 32516us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.583368 (+ 7971us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.694281 (+1110913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.038755 (+344474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.271891 (+233136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.830287 (+558396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.830783 (+ 496us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:58.366874 (+536091us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52528: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1326742,"server-negotiator.queue_time_us":143703}
W20260619 18:45:58.499960 12226 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 368770us
W20260619 18:45:58.501531 12225 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 108510us
W20260619 18:45:58.507210 12554 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.324818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52654)
0619 18:45:55.339323 (+ 14505us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.339393 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.339863 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:56.723216 (+1383353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:56.723260 (+ 44us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:56.732013 (+ 8753us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:57.048770 (+316757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.048842 (+ 72us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.419195 (+370353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.419249 (+ 54us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:58.504910 (+1085661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:58.504969 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.505743 (+ 774us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":11176,"mutex_wait_us":1234806}
W20260619 18:45:58.515802 12444 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.399008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52712)
0619 18:45:55.540243 (+141235us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.542607 (+ 2364us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.574482 (+ 31875us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:56.778389 (+1203907us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:56.779236 (+ 847us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:56.781749 (+ 2513us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.889847 (+108098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.889941 (+ 94us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.639152 (+749211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.641433 (+ 2281us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:58.461648 (+820215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:58.461745 (+ 97us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.514169 (+ 52424us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":35501,"mutex_wait_us":828638}
W20260619 18:45:58.627735 12906 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 159338us
W20260619 18:45:58.632854 12235 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 397007us
W20260619 18:45:58.844537 12182 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.549768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52712 (local address 127.6.120.254:36501)
0619 18:45:56.770985 (+1221217us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:56.771025 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:56.771082 (+ 57us) server_negotiation.cc:407] Connection header received
0619 18:45:56.771206 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:56.771240 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:56.771500 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:56.777281 (+ 5781us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.995168 (+217887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.635124 (+639956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.605497 (+970373us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52712: BlockingRecv error: recv got EOF from 127.0.0.1:52712 (error 108)
Metrics: {"mutex_wait_us":734367,"server-negotiator.queue_time_us":1213734}
W20260619 18:45:58.885290 12613 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.394302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52654 (local address 127.6.120.254:36501)
0619 18:45:56.720352 (+1326050us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:56.720383 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:56.720429 (+ 46us) server_negotiation.cc:407] Connection header received
0619 18:45:56.720555 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:56.720583 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:56.720862 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:56.721074 (+ 212us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.773336 (+ 52262us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:57.049101 (+275765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.418540 (+369439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.479591 (+1061051us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52654: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":475455,"server-negotiator.queue_time_us":1324294,"spinlock_wait_cycles":4684160}
W20260619 18:45:58.929463 12141 scanner-internal.cc:458] Time spent opening tablet: real 4.879s user 0.010s sys 0.006s
W20260619 18:45:58.935573 12523 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.442383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52670 (local address 127.6.120.254:36501)
0619 18:45:56.740210 (+1297827us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:56.740245 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:56.740307 (+ 62us) server_negotiation.cc:407] Connection header received
0619 18:45:56.740468 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:56.740497 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:56.740752 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:56.741033 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:57.138136 (+397103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.305217 (+167081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.832299 (+527082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.323808 (+491509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.440165 (+116357us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:58.933600 (+493435us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52670: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1176193,"server-negotiator.queue_time_us":1289993}
W20260619 18:45:59.020588 13070 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.889110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52730)
0619 18:45:56.051488 (+162378us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:56.051542 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:56.051842 (+ 300us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:56.791498 (+739656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:56.791540 (+ 42us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:56.791692 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.813674 (+ 21982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.813746 (+ 72us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.116221 (+302475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.116278 (+ 57us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.735181 (+618903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.735253 (+ 72us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.174841 (+439588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.177930 (+ 3089us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:58.494302 (+316372us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:58.947147 (+452845us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:58.947899 (+ 752us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:58.949192 (+ 1293us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:58.953845 (+ 4653us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:59.018264 (+ 64419us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":92757,"mutex_wait_us":1277676,"thread_start_us":52164,"threads_started":1}
W20260619 18:45:59.023397 12180 scanner-internal.cc:458] Time spent opening tablet: real 4.178s user 0.015s sys 0.005s
W20260619 18:45:59.044504 12620 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.883487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52730 (local address 127.6.120.254:36501)
0619 18:45:56.785967 (+902480us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:56.786001 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:56.786051 (+ 50us) server_negotiation.cc:407] Connection header received
0619 18:45:56.786172 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:56.786196 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:56.786453 (+ 257us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:56.786644 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.996695 (+210051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.107579 (+110884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.737655 (+630076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.165450 (+427795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.247759 (+ 82309us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:58.929153 (+681394us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52730: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1037290,"server-negotiator.queue_time_us":901048}
W20260619 18:45:59.053118 12556 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.956880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52752 (local address 127.6.120.254:36501)
0619 18:45:56.872425 (+915545us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:56.872461 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:56.872508 (+ 47us) server_negotiation.cc:407] Connection header received
0619 18:45:56.872646 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:56.872678 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:56.872941 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:56.873144 (+ 203us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:57.167819 (+294675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.501709 (+333890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.274784 (+773075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.854000 (+579216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.854334 (+ 334us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:58.981363 (+127029us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52752: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1152492,"server-negotiator.queue_time_us":888855}
W20260619 18:45:59.068941 12570 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.389438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52656 (local address 127.6.120.254:36501)
0619 18:45:56.719289 (+1329851us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:56.719333 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:56.719416 (+ 83us) server_negotiation.cc:407] Connection header received
0619 18:45:56.719586 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:56.719612 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:56.719883 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:56.720510 (+ 627us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:57.083673 (+363163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.423852 (+340179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.186454 (+762602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.032612 (+846158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.067564 (+ 34952us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52656: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1447274,"server-negotiator.queue_time_us":1328359}
W20260619 18:45:59.101408 12507 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.343213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52670)
0619 18:45:55.352216 (+ 9003us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.352291 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.352693 (+ 402us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:56.741825 (+1389132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:56.741863 (+ 38us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:56.742021 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:57.135064 (+393043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.137552 (+ 2488us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.306401 (+168849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.308736 (+ 2335us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.831116 (+522380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.831187 (+ 71us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.346087 (+514900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.351852 (+ 5765us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:58.466810 (+114958us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:58.997741 (+530931us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:58.997773 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:58.997848 (+ 75us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:58.997987 (+ 139us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:59.099206 (+101219us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":8291,"mutex_wait_us":1521451}
W20260619 18:45:59.098294 13074 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.987810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48892 (local address 127.6.120.193:37901)
0619 18:45:56.538548 (+550738us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:56.538583 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:56.538634 (+ 51us) server_negotiation.cc:407] Connection header received
0619 18:45:56.538793 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:56.538819 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:56.539160 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:56.540093 (+ 933us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:56.696485 (+156392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.802994 (+106509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.836778 (+1033784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.281702 (+444924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.427160 (+145458us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:58.848552 (+421392us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 18:45:59.021641 (+173089us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 18:45:59.096628 (+ 74987us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48892: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1407219,"server-negotiator.queue_time_us":539145,"thread_start_us":518492,"threads_started":1}
W20260619 18:45:59.135761 12536 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.782526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52718 (local address 127.6.120.254:36501)
0619 18:45:56.780487 (+997961us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:56.780517 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:56.780572 (+ 55us) server_negotiation.cc:407] Connection header received
0619 18:45:56.780695 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:56.780721 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:56.781009 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:56.781217 (+ 208us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:57.032249 (+251032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.276549 (+244300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.869184 (+592635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.440486 (+571302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.928271 (+487785us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.129958 (+201687us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52718: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1365108,"server-negotiator.queue_time_us":984394}
W20260619 18:45:59.175921 13071 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.952744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52752)
0619 18:45:56.023538 (+ 70794us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:56.023601 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:56.023907 (+ 306us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:56.880148 (+856241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:56.882309 (+ 2161us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:56.882470 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:57.159836 (+277366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.162995 (+ 3159us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.507852 (+344857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.508829 (+ 977us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:58.273525 (+764696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:58.273629 (+ 104us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.855318 (+581689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.855366 (+ 48us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.098006 (+242640us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.115448 (+ 17442us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:59.119229 (+ 3781us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:59.121262 (+ 2033us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:59.131161 (+ 9899us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:59.144393 (+ 13232us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":70258,"mutex_wait_us":1148217,"thread_start_us":27867,"threads_started":1}
W20260619 18:45:59.176136 12836 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.006926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52556)
0619 18:45:55.007765 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.007834 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.008099 (+ 265us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:56.667717 (+1659618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:56.667767 (+ 50us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:56.667960 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.986409 (+318449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.986478 (+ 69us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.035892 (+ 49414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.035929 (+ 37us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.647703 (+611774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.649038 (+ 1335us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.860171 (+211133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.860213 (+ 42us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:58.502922 (+642709us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.063180 (+560258us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:59.066168 (+ 2988us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:59.069909 (+ 3741us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:59.078608 (+ 8699us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:59.148311 (+ 69703us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":378,"mutex_wait_us":2040653}
W20260619 18:45:59.187799 12502 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.058293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52774 (local address 127.6.120.254:36501)
0619 18:45:56.949291 (+890998us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:56.949324 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:56.949386 (+ 62us) server_negotiation.cc:407] Connection header received
0619 18:45:56.949538 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:56.949563 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:56.977686 (+ 28123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:56.978870 (+ 1184us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:57.127835 (+148965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.628458 (+500623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.863721 (+235263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.436020 (+572299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.436402 (+ 382us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.121672 (+685270us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52774: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":994634,"server-negotiator.queue_time_us":890103}
W20260619 18:45:59.201018 13072 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.955086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48892)
0619 18:45:56.057047 (+101961us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:56.057112 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:56.057433 (+ 321us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:56.542295 (+484862us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:56.542331 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:56.542393 (+ 62us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:56.549201 (+ 6808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.553916 (+ 4715us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.804075 (+250159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.804156 (+ 81us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.836348 (+1032192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.836545 (+ 197us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.299093 (+462548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.301744 (+ 2651us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:58.441805 (+140061us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:58.441989 (+ 184us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 18:45:59.080941 (+638952us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":86867,"mutex_wait_us":1165904,"thread_start_us":62541,"threads_started":1}
I20260619 18:45:59.208330 12587 scanner-internal.cc:172] Scan of tablet d63b7834d93346288748391962132228 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:59.208601 12978 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 701731us
W20260619 18:45:59.208935 12587 scanner-internal.cc:458] Time spent opening tablet: real 4.107s user 0.007s sys 0.014s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:45:59.204286 13081 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.036767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52774)
0619 18:45:56.631076 (+594309us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:56.631126 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:56.631393 (+ 267us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:56.978993 (+347600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:56.979035 (+ 42us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:56.979174 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:57.125621 (+146447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.125669 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.629376 (+503707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.629413 (+ 37us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.861463 (+232050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.861549 (+ 86us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.439820 (+578271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.439855 (+ 35us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.068706 (+628851us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.182700 (+113994us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:59.182742 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:59.182811 (+ 69us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:59.182985 (+ 174us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:59.186861 (+ 3876us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":531361,"mutex_wait_us":913355,"thread_start_us":492812,"threads_started":1}
W20260619 18:45:59.303579 12165 scanner-internal.cc:458] Time spent opening tablet: real 5.242s user 0.006s sys 0.010s
W20260619 18:45:59.314366 12549 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.761046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52718)
0619 18:45:55.834251 (+ 73205us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.834327 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.834742 (+ 415us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:56.781421 (+946679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:56.781455 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:56.781580 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:57.031502 (+249922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.031563 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.276885 (+245322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.276927 (+ 42us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.868891 (+591964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.868940 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.440840 (+571900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.440876 (+ 36us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.052451 (+611575us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.238955 (+186504us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:59.239017 (+ 62us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:59.239104 (+ 87us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:59.239259 (+ 155us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:59.301444 (+ 62185us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":26511,"mutex_wait_us":1466435}
W20260619 18:45:59.322041 12975 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 95249.4us
W20260619 18:45:59.347620 12973 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 127628us
W20260619 18:45:59.477794 12925 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 132740us
W20260619 18:45:59.502691 13083 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.474487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52790)
0619 18:45:56.630979 (+156492us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:56.631058 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:56.631338 (+ 280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:56.981352 (+350014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:56.981397 (+ 45us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:56.982313 (+ 916us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:57.208635 (+226322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.211759 (+ 3124us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.835064 (+623305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.835100 (+ 36us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.095398 (+1260298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.097060 (+ 1662us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.491232 (+394172us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":155899,"mutex_wait_us":1313224,"thread_start_us":130460,"threads_started":1}
W20260619 18:45:59.487334 12204 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 283005us
W20260619 18:45:59.638876 12652 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.475797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52790 (local address 127.6.120.254:36501)
0619 18:45:56.962807 (+487010us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:56.963115 (+ 308us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:56.963173 (+ 58us) server_negotiation.cc:407] Connection header received
0619 18:45:56.963323 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:56.963349 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:56.979204 (+ 15855us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:56.979454 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:56.979701 (+ 247us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:57.220769 (+241068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.831629 (+610860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.097408 (+1265779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.636176 (+538768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.636686 (+ 510us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52790: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1211398,"server-negotiator.queue_time_us":486601,"spinlock_wait_cycles":29315840}
W20260619 18:45:59.647398 12980 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 74579us
W20260619 18:45:59.682886 12551 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.517029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52810 (local address 127.6.120.254:36501)
0619 18:45:57.041788 (+524759us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:57.041832 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:57.041902 (+ 70us) server_negotiation.cc:407] Connection header received
0619 18:45:57.042056 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:57.042093 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:57.042389 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:57.048313 (+ 5924us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:57.087962 (+ 39649us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:57.275056 (+187094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.830565 (+555509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.131793 (+1301228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.403990 (+272197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.614036 (+210046us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.679447 (+ 65411us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52810: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1190467,"server-negotiator.queue_time_us":524196,"spinlock_wait_cycles":3525760}
W20260619 18:45:59.690083 13026 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 285729us
W20260619 18:45:59.711845 12091 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.566717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52854 (local address 127.6.120.254:36501)
0619 18:45:57.053872 (+487155us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:57.053906 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:57.053958 (+ 52us) server_negotiation.cc:407] Connection header received
0619 18:45:57.054101 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:57.054126 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:57.054371 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:57.054594 (+ 223us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:57.248378 (+193784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.797724 (+549346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.167086 (+1369362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.386107 (+219021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.636932 (+250825us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.710415 (+ 73483us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52854: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1096658,"server-negotiator.queue_time_us":484647}
W20260619 18:45:59.755070 12087 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.715849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52930 (local address 127.6.120.254:36501)
0619 18:45:57.265157 (+549308us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:57.265201 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:57.265254 (+ 53us) server_negotiation.cc:407] Connection header received
0619 18:45:57.265401 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:57.265431 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:57.331637 (+ 66206us) spinlock_profiling.cc:243] Waited 5.22 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:57.348524 (+ 16887us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:57.358730 (+ 10206us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:57.397099 (+ 38369us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:57.412979 (+ 15880us) spinlock_profiling.cc:243] Waited 8.32 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:57.534646 (+121667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.786132 (+251486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.347070 (+560938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.860073 (+513003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.036834 (+176761us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.752884 (+716050us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52930: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":952437,"server-negotiator.queue_time_us":548854,"spinlock_wait_cycles":54615424}
W20260619 18:45:59.794836 13092 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.547492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52854)
0619 18:45:56.603226 (+ 55734us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b4400023f4c. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383d68a95 00007f1383d694b2 00007f138a346511 00007f138a341e1a 00007f1383e385fe 00007f138cc63a39 00007f1383e558bb 00007f1383e53cbf 00007f1383e55e22 00007f138892cc48
0619 18:45:56.835497 (+232271us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:56.836372 (+ 875us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:56.838184 (+ 1812us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:57.054864 (+216680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:57.054900 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:57.055022 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:57.242604 (+187582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.242668 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.798139 (+555471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.798178 (+ 39us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.159603 (+1361425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.159658 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.387993 (+228335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.392185 (+ 4192us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.769388 (+377203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.774281 (+ 4893us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:59.774324 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:59.774400 (+ 76us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:59.774579 (+ 179us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:59.785046 (+ 10467us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":281351,"mutex_wait_us":1728357,"spinlock_wait_cycles":7659776,"thread_start_us":202483,"threads_started":1}
W20260619 18:45:59.813617 12985 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 132536us
W20260619 18:45:59.818861 12410 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.693925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52930)
0619 18:45:56.710819 (+ 16894us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:56.710882 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:56.711192 (+ 310us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:57.361265 (+650073us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:57.362239 (+ 974us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:57.362367 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:57.510434 (+148067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.512340 (+ 1906us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.788193 (+275853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.788231 (+ 38us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:58.329937 (+541706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:58.331855 (+ 1918us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.886616 (+554761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.886674 (+ 58us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.671794 (+785120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.784662 (+112868us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:59.784966 (+ 304us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:59.785509 (+ 543us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:59.791090 (+ 5581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:59.791843 (+ 753us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":12081,"mutex_wait_us":1451157}
W20260619 18:45:59.825495 12369 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 156436us
W20260619 18:45:59.838348 12780 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 199621us
W20260619 18:45:59.863170 12604 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.808569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52998 (local address 127.6.120.254:36501)
0619 18:45:57.651714 (+843145us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:57.651759 (+ 45us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:57.651817 (+ 58us) server_negotiation.cc:407] Connection header received
0619 18:45:57.651953 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:57.651983 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:57.652332 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:57.652509 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:57.771823 (+119314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.319614 (+547791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.133396 (+813782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.315740 (+182344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.316855 (+ 1115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.857210 (+540355us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52998: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":751697,"server-negotiator.queue_time_us":816297}
W20260619 18:45:59.885432 12979 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 845813us
W20260619 18:45:59.904484 12847 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 267630us
W20260619 18:45:59.918526 12966 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.519455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52810)
0619 18:45:56.538793 (+ 19338us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:56.538842 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:56.539088 (+ 246us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:57.043403 (+504315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:57.043454 (+ 51us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:57.043624 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:57.086441 (+ 42817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.086518 (+ 77us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.831144 (+744626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.831195 (+ 51us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.130315 (+1299120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.130378 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.410685 (+280307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.410734 (+ 49us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.736496 (+325762us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.874538 (+138042us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:59.874569 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:59.874634 (+ 65us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:59.874754 (+ 120us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:59.896258 (+ 21504us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":7393,"mutex_wait_us":1579804}
W20260619 18:45:59.931892 12014 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.897721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53024 (local address 127.6.120.254:36501)
0619 18:45:57.762057 (+864336us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:57.762093 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:57.762152 (+ 59us) server_negotiation.cc:407] Connection header received
0619 18:45:57.762290 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:57.762321 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:57.762572 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:57.762807 (+ 235us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:57.868896 (+106089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.068943 (+1200047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.519918 (+450975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.774800 (+254882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.775242 (+ 442us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.929174 (+153932us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53024: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1512707,"server-negotiator.queue_time_us":863301}
W20260619 18:45:59.933185 12855 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 74807.7us
W20260619 18:45:59.980813 12128 scanner-internal.cc:458] Time spent opening tablet: real 2.574s user 0.009s sys 0.006s
W20260619 18:45:59.996454 13114 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.918629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53040)
0619 18:45:57.114641 (+196012us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.114720 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.115065 (+ 345us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:57.859733 (+744668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:57.859780 (+ 47us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:57.859909 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:58.377049 (+517140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:58.377119 (+ 70us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.245606 (+868487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.248858 (+ 3252us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.692863 (+444005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.692919 (+ 56us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.994670 (+301751us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":195238,"mutex_wait_us":903563,"thread_start_us":193176,"threads_started":1}
W20260619 18:46:00.010119 12687 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 398763us
W20260619 18:46:00.011611 12765 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 286455us
W20260619 18:46:00.025537 12100 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 348288us
W20260619 18:46:00.037930 12759 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 240278us
W20260619 18:46:00.040504 12631 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.909254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53024)
0619 18:45:56.910784 (+ 1530us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:56.910835 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:56.911112 (+ 277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:57.764338 (+853226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:57.764370 (+ 32us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:57.764494 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:57.868317 (+103823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.868392 (+ 75us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.076991 (+1208599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.078639 (+ 1648us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.519081 (+440442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.519133 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.775178 (+256045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.775225 (+ 47us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.917837 (+142612us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.922589 (+ 4752us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:59.922639 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:59.922705 (+ 66us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:59.930907 (+ 8202us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:46:00.006407 (+ 75500us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1031,"mutex_wait_us":684038}
W20260619 18:46:00.113958 12573 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.807770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52998)
0619 18:45:56.814838 (+ 7068us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:56.814891 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:56.815159 (+ 268us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:57.661526 (+846367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:57.662113 (+ 587us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:57.679900 (+ 17787us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:57.769215 (+ 89315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.769280 (+ 65us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.319968 (+550688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.320009 (+ 41us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.130683 (+810674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.130738 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.318734 (+187996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.319107 (+ 373us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.717476 (+398369us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.913421 (+195945us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:59.914089 (+ 668us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:59.916587 (+ 2498us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:59.921579 (+ 4992us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:46:00.050750 (+129171us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":6570,"mutex_wait_us":1509406}
W20260619 18:46:00.120081 12781 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 716691us
W20260619 18:46:00.135767 12645 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.014175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53108 (local address 127.6.120.254:36501)
0619 18:45:58.197324 (+1183149us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:58.197366 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:58.201829 (+ 4463us) server_negotiation.cc:407] Connection header received
0619 18:45:58.216623 (+ 14794us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:58.220857 (+ 4234us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:58.248688 (+ 27831us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:58.266867 (+ 18179us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.046186 (+779319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.719411 (+673225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.844360 (+124949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.031315 (+186955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.133794 (+102479us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53108: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1047456,"server-negotiator.queue_time_us":1181584}
W20260619 18:46:00.139618 12558 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.968703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53082 (local address 127.6.120.254:36501)
0619 18:45:58.107673 (+1138970us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:58.107710 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:58.107772 (+ 62us) server_negotiation.cc:407] Connection header received
0619 18:45:58.107926 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:58.107958 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:58.126440 (+ 18482us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:58.140257 (+ 13817us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:58.517802 (+377545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.300306 (+782504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.484533 (+184227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.672964 (+188431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.847834 (+174870us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.111079 (+263245us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53082: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1658711,"server-negotiator.queue_time_us":1138482}
W20260619 18:46:00.160980 12079 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 441541us
W20260619 18:46:00.162079 12577 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.941351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53040 (local address 127.6.120.254:36501)
0619 18:45:57.858724 (+917373us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:57.858767 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:57.858823 (+ 56us) server_negotiation.cc:407] Connection header received
0619 18:45:57.858976 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:57.859013 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:57.859381 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:57.859610 (+ 229us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:58.383863 (+524253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.236726 (+852863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.693148 (+456422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.054666 (+361518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.115239 (+ 60573us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53040: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1677534,"server-negotiator.queue_time_us":885145}
W20260619 18:46:00.178745 12560 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.968277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53068 (local address 127.6.120.254:36501)
0619 18:45:57.848618 (+880341us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:57.848662 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:57.848735 (+ 73us) server_negotiation.cc:407] Connection header received
0619 18:45:57.848896 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:57.848937 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:57.855113 (+ 6176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:57.859896 (+ 4783us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:57.966620 (+106724us) spinlock_profiling.cc:243] Waited 872 us on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:58.382454 (+415834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.384163 (+ 1709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.379726 (+995563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.738272 (+358546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.820007 (+ 81735us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.119698 (+299691us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53068: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":617174,"server-negotiator.queue_time_us":879877,"spinlock_wait_cycles":2004736}
W20260619 18:46:00.184460 13011 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.963630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53082)
0619 18:45:56.964667 (+ 1037us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:56.964737 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:56.964984 (+ 247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:58.145696 (+1180712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:58.148484 (+ 2788us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:58.162029 (+ 13545us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:58.509196 (+347167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:58.509252 (+ 56us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.304241 (+794989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.307632 (+ 3391us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.483703 (+176071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.483764 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.675408 (+191644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.675460 (+ 52us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.851349 (+175889us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.859920 (+ 8571us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:59.859952 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:59.860010 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:59.860205 (+ 195us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:46:00.106111 (+245906us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":570,"mutex_wait_us":762233}
W20260619 18:46:00.179782 12173 scanner-internal.cc:458] Time spent opening tablet: real 2.891s user 0.006s sys 0.007s
W20260619 18:46:00.182143 12590 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.965048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53092)
0619 18:45:56.966698 (+ 1650us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:56.966747 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:56.967076 (+ 329us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:57.862597 (+895521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:57.862639 (+ 42us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:57.863709 (+ 1070us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:58.853052 (+989343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:58.853114 (+ 62us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.344752 (+491638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.344795 (+ 43us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.860505 (+515710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.861641 (+ 1136us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.138093 (+276452us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1224,"mutex_wait_us":1508201}
W20260619 18:46:00.194573 12619 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.046352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53116 (local address 127.6.120.254:36501)
0619 18:45:58.299784 (+1253432us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:58.299825 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:58.299907 (+ 82us) server_negotiation.cc:407] Connection header received
0619 18:45:58.300139 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:58.300167 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:58.300443 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:58.300654 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:58.936841 (+636187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.605291 (+668450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.793197 (+187906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.945032 (+151835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.945376 (+ 344us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.176028 (+230652us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53116: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1350392,"server-negotiator.queue_time_us":1241002}
W20260619 18:46:00.205525 12243 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 407750us
W20260619 18:46:00.209113 12466 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.056524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53120 (local address 127.6.120.254:36501)
0619 18:45:58.372613 (+1316089us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:58.372654 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:58.372721 (+ 67us) server_negotiation.cc:407] Connection header received
0619 18:45:58.372895 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:58.372926 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:58.373190 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:58.373406 (+ 216us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.132499 (+759093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.672261 (+539762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.201595 (+529334us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53120: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1214537,"server-negotiator.queue_time_us":1312272}
W20260619 18:46:00.210752 12182 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.183407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53148 (local address 127.6.120.254:36501)
0619 18:45:58.886243 (+1702836us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:58.886293 (+ 50us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:58.887197 (+ 904us) server_negotiation.cc:407] Connection header received
0619 18:45:58.887318 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:58.887342 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:58.887579 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:58.890214 (+ 2635us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.372177 (+481963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.640636 (+268459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.657474 (+ 16838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.884284 (+226810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.911292 (+ 27008us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.209345 (+298053us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53148: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":983576,"server-negotiator.queue_time_us":1691822}
W20260619 18:46:00.218880 12634 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.968930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53096 (local address 127.6.120.254:36501)
0619 18:45:58.245997 (+1277067us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:58.248031 (+ 2034us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:58.263190 (+ 15159us) server_negotiation.cc:407] Connection header received
0619 18:45:58.271014 (+ 7824us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:58.277060 (+ 6046us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:58.301080 (+ 24020us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:58.307520 (+ 6440us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.197488 (+889968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.734258 (+536770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.174875 (+440617us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53096: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":832140,"server-negotiator.queue_time_us":1213924}
W20260619 18:46:00.220402 12545 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 387850us
W20260619 18:46:00.223398 12459 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.013337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53108)
0619 18:45:57.019207 (+ 5870us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.019259 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.019507 (+ 248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:58.270687 (+1251180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:58.274867 (+ 4180us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:58.275048 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.044860 (+769812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.044941 (+ 81us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.720821 (+675880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.721191 (+ 370us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.839327 (+118136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.839384 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.185853 (+346469us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":5391,"mutex_wait_us":1011677}
W20260619 18:46:00.291584 12523 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.253463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53186 (local address 127.6.120.254:36501)
0619 18:45:58.989099 (+1735636us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:58.997473 (+ 8374us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:58.999563 (+ 2090us) server_negotiation.cc:407] Connection header received
0619 18:45:58.999751 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:58.999791 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.001687 (+ 1896us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.008773 (+ 7086us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.719244 (+710471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.925787 (+206543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.289854 (+364067us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53186: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":293622,"server-negotiator.queue_time_us":1690287}
W20260619 18:46:00.291713 12535 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.066004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53132 (local address 127.6.120.254:36501)
0619 18:45:58.382618 (+1316614us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:58.382654 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:58.382706 (+ 52us) server_negotiation.cc:407] Connection header received
0619 18:45:58.382826 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:58.382849 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:58.383087 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:58.383288 (+ 201us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.017944 (+634656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.664285 (+646341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.920343 (+256058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.034646 (+114303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.165314 (+130668us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.275072 (+109758us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53132: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":937562,"server-negotiator.queue_time_us":1316135}
W20260619 18:46:00.298627 12792 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.172626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53162)
0619 18:45:57.179492 (+ 6866us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.179538 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.179798 (+ 260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:58.472365 (+1292567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:58.472414 (+ 49us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:58.472604 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.509718 (+1037114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.509787 (+ 69us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.822508 (+312721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.822566 (+ 58us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.985874 (+163308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.986583 (+ 709us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.290827 (+304244us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1572,"mutex_wait_us":1030836}
W20260619 18:46:00.291409 13082 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 43985.2us
W20260619 18:46:00.311815 13019 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 396865us
W20260619 18:46:00.325986 12612 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.965871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53092 (local address 127.6.120.254:36501)
0619 18:45:57.857656 (+891785us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:57.857712 (+ 56us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:57.857787 (+ 75us) server_negotiation.cc:407] Connection header received
0619 18:45:57.857958 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:57.857990 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:57.858267 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:57.858506 (+ 239us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:58.854619 (+996113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.344308 (+489689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.862126 (+517818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.142301 (+280175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.260369 (+118068us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53092: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1125674,"server-negotiator.queue_time_us":880624}
W20260619 18:46:00.401845 12569 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.151618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53142 (local address 127.6.120.254:36501)
0619 18:45:58.386218 (+1234600us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:58.386253 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:58.386299 (+ 46us) server_negotiation.cc:407] Connection header received
0619 18:45:58.386421 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:58.386447 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:58.386700 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:58.386881 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.071189 (+684308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.594427 (+523238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.940351 (+345924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.285800 (+345449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.335916 (+ 50116us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53142: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":877713,"server-negotiator.queue_time_us":1234185}
W20260619 18:46:00.469347 12183 scanner-internal.cc:458] Time spent opening tablet: real 2.359s user 0.001s sys 0.014s
W20260619 18:46:00.486603 13136 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.256274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53190)
0619 18:45:57.398380 (+142106us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.398429 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.398681 (+ 252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.096808 (+1698127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.096847 (+ 39us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.096967 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.373078 (+276111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.373125 (+ 47us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.669016 (+295891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.669049 (+ 33us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.173655 (+504606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:00.173721 (+ 66us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.485163 (+311442us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":108591,"mutex_wait_us":962162,"thread_start_us":19581,"threads_started":1}
W20260619 18:46:00.492617 13116 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.931485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53068)
0619 18:45:57.004808 (+ 73323us) spinlock_profiling.cc:243] Waited 7.01 ms on lock 0x7b18003bc680. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f138cce98b1 00007f138ccf6661 00007f1383e56638 00007f1383e59b11 00007f1383e59ac9 00007f1383e59a59 00007f1383e59a21 00007f1383e58d1d 00007f138d0ae204 00007f138d0ae039 00007f1383e38dc6
0619 18:45:57.005217 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.005282 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.005552 (+ 270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:57.866184 (+860632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:57.866231 (+ 47us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:57.866365 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:58.376533 (+510168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:58.376591 (+ 58us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.392829 (+ 16238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.392877 (+ 48us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.379359 (+986482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.379449 (+ 90us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.740508 (+361059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.740554 (+ 46us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.973153 (+232599us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.251163 (+278010us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:46:00.251206 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:46:00.253474 (+ 2268us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:46:00.260345 (+ 6871us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:46:00.483344 (+222999us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":65334,"mutex_wait_us":2062637,"spinlock_wait_cycles":16125184,"thread_start_us":59461,"threads_started":1}
W20260619 18:46:00.496459 12719 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.045535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53116)
0619 18:45:57.060873 (+ 15338us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.060919 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.061135 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:58.305361 (+1244226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:58.307385 (+ 2024us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:58.317218 (+ 9833us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:58.934289 (+617071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:58.934357 (+ 68us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.605562 (+671205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.605609 (+ 47us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.792482 (+186873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.792545 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.947961 (+155416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.948991 (+ 1030us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.315952 (+366961us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.326308 (+ 10356us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:46:00.326337 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:46:00.326395 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:46:00.326512 (+ 117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:46:00.494323 (+167811us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1988,"mutex_wait_us":1300478}
W20260619 18:46:00.496827 12413 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.424996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35012 (local address 127.6.120.254:36501)
0619 18:45:59.139992 (+1714996us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.140044 (+ 52us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.140087 (+ 43us) server_negotiation.cc:407] Connection header received
0619 18:45:59.140236 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.140260 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.140534 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.140723 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.619930 (+479207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.709698 (+ 89768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.495312 (+785614us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35012: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":593059,"server-negotiator.queue_time_us":1712895}
W20260619 18:46:00.501590 12411 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.211489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53170 (local address 127.6.120.254:36501)
0619 18:45:58.880048 (+1668559us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:58.880088 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:58.880159 (+ 71us) server_negotiation.cc:407] Connection header received
0619 18:45:58.880306 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:58.880329 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:58.880608 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:58.880821 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.249164 (+368343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.952493 (+703329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.329369 (+376876us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53170: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1014335,"server-negotiator.queue_time_us":1668118}
W20260619 18:46:00.512351 12432 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.177888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53148)
0619 18:45:57.178666 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.178729 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.179043 (+ 314us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:58.889894 (+1710851us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:58.889949 (+ 55us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:58.890117 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.344872 (+454755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.345580 (+ 708us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.643465 (+297885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.643509 (+ 44us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.646071 (+ 2562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.646143 (+ 72us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.886431 (+240288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.886480 (+ 49us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.075144 (+188664us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.267992 (+192848us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:46:00.268025 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:46:00.268083 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:46:00.268249 (+ 166us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:46:00.316156 (+ 47907us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":347,"mutex_wait_us":825792}
W20260619 18:46:00.522732 12620 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.259119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53190 (local address 127.6.120.254:36501)
0619 18:45:59.092850 (+1833731us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.093897 (+ 1047us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.093942 (+ 45us) server_negotiation.cc:407] Connection header received
0619 18:45:59.094643 (+ 701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.095374 (+ 731us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.096302 (+ 928us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.096568 (+ 266us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.392298 (+295730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.666375 (+274077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.175409 (+509034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.506020 (+330611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.520955 (+ 14935us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53190: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":884722,"server-negotiator.queue_time_us":1785870,"spinlock_wait_cycles":29440}
W20260619 18:46:00.564615 12216 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 514266us
W20260619 18:46:00.572328 12809 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 79509.7us
W20260619 18:46:00.574535 13007 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.966031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53096)
0619 18:45:56.967083 (+ 1052us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:56.967126 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:56.967322 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:58.309934 (+1342612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:58.315791 (+ 5857us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:58.339784 (+ 23993us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.196708 (+856924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.196794 (+ 86us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.736160 (+539366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.736201 (+ 41us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.464753 (+728552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:00.467226 (+ 2473us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.530626 (+ 63400us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":527,"mutex_wait_us":1561102}
W20260619 18:46:00.582439 12187 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.177549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53162 (local address 127.6.120.254:36501)
0619 18:45:58.469290 (+1291741us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:58.469335 (+ 45us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:58.469401 (+ 66us) server_negotiation.cc:407] Connection header received
0619 18:45:58.469599 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:58.469635 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:58.469952 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:58.474308 (+ 4356us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:58.624245 (+149937us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:59.510194 (+885949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.821966 (+311772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.988071 (+166105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.490554 (+502483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.567349 (+ 76795us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53162: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1315641,"server-negotiator.queue_time_us":1291164,"spinlock_wait_cycles":6996352}
W20260619 18:46:00.580163 13125 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.151514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53142)
0619 18:45:57.210123 (+ 58609us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.210172 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.223052 (+ 12880us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:58.387371 (+1164319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:58.387406 (+ 35us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:58.389139 (+ 1733us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.069475 (+680336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.069540 (+ 65us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.596089 (+526549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.596163 (+ 74us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.940032 (+343869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.940093 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.436269 (+496176us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":58071,"mutex_wait_us":1176608,"thread_start_us":42923,"threads_started":1}
W20260619 18:46:00.586500 13152 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.420879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35020)
0619 18:45:57.446131 (+ 25252us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.446199 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.446459 (+ 260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.138433 (+1691974us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.138467 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.138602 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.368602 (+230000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.368678 (+ 76us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.677861 (+309183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.677902 (+ 41us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.486251 (+808349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:00.486327 (+ 76us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.584951 (+ 98624us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":5720,"mutex_wait_us":1076931,"thread_start_us":2098,"threads_started":1}
W20260619 18:46:00.590029 12896 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.397072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35010)
0619 18:45:57.464659 (+ 67587us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.466455 (+ 1796us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.472715 (+ 6260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.131891 (+1659176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.132611 (+ 720us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.135166 (+ 2555us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.686712 (+551546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.686768 (+ 56us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.927079 (+240311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.927115 (+ 36us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.173947 (+246832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:00.174001 (+ 54us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.588718 (+414717us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":12170,"mutex_wait_us":971552}
W20260619 18:46:00.603847 12536 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.421091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35020 (local address 127.6.120.254:36501)
0619 18:45:59.137384 (+1716293us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.137416 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.137464 (+ 48us) server_negotiation.cc:407] Connection header received
0619 18:45:59.137592 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.137616 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.137858 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.138176 (+ 318us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.369415 (+231239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.676057 (+306642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.530650 (+854593us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35020: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":515389,"server-negotiator.queue_time_us":1715886}
W20260619 18:46:00.606446 12570 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.383115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35010 (local address 127.6.120.254:36501)
0619 18:45:59.091807 (+1708692us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.092709 (+ 902us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.094473 (+ 1764us) server_negotiation.cc:407] Connection header received
0619 18:45:59.102121 (+ 7648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.108863 (+ 6742us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.119889 (+ 11026us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.129245 (+ 9356us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.688311 (+559066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.926828 (+238517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.174839 (+248011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.500878 (+326039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.564241 (+ 63363us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35010: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":801041,"server-negotiator.queue_time_us":1686327}
W20260619 18:46:00.608421 12524 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.256244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53186)
0619 18:45:57.266796 (+ 10552us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.266849 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.267128 (+ 279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.004845 (+1737717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.004880 (+ 35us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.005026 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.718125 (+713099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.718409 (+ 284us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.926113 (+207704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.926152 (+ 39us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.499319 (+573167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:00.499379 (+ 60us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.567672 (+ 68293us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":5831,"mutex_wait_us":1286633}
W20260619 18:46:00.726698 13146 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.383111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35012)
0619 18:45:57.446962 (+ 63851us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.447010 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.447244 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.140947 (+1693703us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.140981 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.141105 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.480254 (+339149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.481085 (+ 831us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.710576 (+229491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.710630 (+ 54us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.497716 (+787086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:00.497773 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.568214 (+ 70441us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":40719,"mutex_wait_us":1083589,"thread_start_us":18343,"threads_started":1}
W20260619 18:46:00.749627 12405 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.642396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35040)
0619 18:45:57.644698 (+ 2302us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.644754 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.645059 (+ 305us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.142810 (+1497751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.142847 (+ 37us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.142970 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.605809 (+462839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.605887 (+ 78us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.794408 (+188521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.794449 (+ 41us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.313233 (+518784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:00.313296 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.497252 (+183956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.497289 (+ 37us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.604777 (+107488us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.635534 (+ 30757us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:46:00.635564 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:46:00.635640 (+ 76us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:46:00.635799 (+ 159us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:46:00.696144 (+ 60345us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":466,"mutex_wait_us":1066668}
W20260619 18:46:00.753140 12653 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.628502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35024 (local address 127.6.120.254:36501)
0619 18:45:59.140981 (+1512479us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.141028 (+ 47us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.141076 (+ 48us) server_negotiation.cc:407] Connection header received
0619 18:45:59.141192 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.141220 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.141448 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.141642 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.265984 (+124342us) spinlock_profiling.cc:243] Waited 7.94 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:59.274708 (+ 8724us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1ec6c 00007f1383e1ebd6 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:59.511441 (+236733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.701518 (+190077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.095167 (+393649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.270962 (+175795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.311991 (+ 41029us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.737447 (+425456us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35024: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":699992,"server-negotiator.queue_time_us":1512085,"spinlock_wait_cycles":24128512}
W20260619 18:46:00.755496 12490 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.645371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35040 (local address 127.6.120.254:36501)
0619 18:45:59.141900 (+1496529us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.141936 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.141979 (+ 43us) server_negotiation.cc:407] Connection header received
0619 18:45:59.142110 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.142141 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.142387 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.142592 (+ 205us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.608396 (+465804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.793746 (+185350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.314198 (+520452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.495533 (+181335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.495854 (+ 321us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.636616 (+140762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 18:46:00.636698 (+ 82us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 18:46:00.637940 (+ 1242us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 18:46:00.671966 (+ 34026us) server_negotiation.cc:922] calling sasl_server_start()
0619 18:46:00.676797 (+ 4831us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 18:46:00.680200 (+ 3403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 18:46:00.721192 (+ 40992us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35040: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":577583,"server-negotiator.queue_time_us":1496138}
W20260619 18:46:00.797279 12910 scanner-internal.cc:458] Time spent opening tablet: real 2.588s user 0.031s sys 0.019s
W20260619 18:46:01.307325 12546 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.662972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35048 (local address 127.6.120.254:36501)
0619 18:45:59.157945 (+1494973us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.157976 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.158024 (+ 48us) server_negotiation.cc:407] Connection header received
0619 18:45:59.158157 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.158185 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.158453 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.158653 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.506192 (+347539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.785549 (+279357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.483248 (+697699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.586260 (+103012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.586587 (+ 327us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.821964 (+235377us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35048: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":753823,"server-negotiator.queue_time_us":1494397}
W20260619 18:46:01.308058 12783 meta_cache.cc:1097] Time spent processing table locations response: real 0.324s user 0.000s sys 0.007s
W20260619 18:46:01.308892 12655 scanner-internal.cc:458] Time spent opening tablet: real 2.677s user 0.011s sys 0.007s
W20260619 18:46:01.311355 12148 meta_cache.cc:1097] Time spent processing table locations response: real 0.325s user 0.002s sys 0.005s
W20260619 18:46:01.321543 12655 client.cc:2034] Couldn't close scanner df14fd0916f14962b65b0fd16dfa5261: Aborted: reactor is shutting down (error 108)
W20260619 18:46:01.323977 12518 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.062430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53132)
0619 18:45:57.085023 (+ 22593us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.085087 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.085423 (+ 336us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:58.384729 (+1299306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:58.384775 (+ 46us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:58.384916 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.002934 (+618018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.014244 (+ 11310us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.666024 (+651780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.667266 (+ 1242us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.919387 (+252121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.919444 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.035515 (+116071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.035554 (+ 39us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.497232 (+461678us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.636073 (+138841us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:46:00.636131 (+ 58us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:46:00.636187 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:46:00.636301 (+ 114us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:46:01.321910 (+685609us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":572,"mutex_wait_us":2067163}
W20260619 18:46:01.328677 12502 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.706025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35056 (local address 127.6.120.254:36501)
0619 18:45:59.223232 (+1517207us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.223279 (+ 47us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.223341 (+ 62us) server_negotiation.cc:407] Connection header received
0619 18:45:59.223488 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.227239 (+ 3751us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.241380 (+ 14141us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:59.249421 (+ 8041us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.259117 (+ 9696us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.967041 (+707924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.311738 (+344697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.327165 (+1015427us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35056: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":966416,"server-negotiator.queue_time_us":1497069,"spinlock_wait_cycles":3088128}
W20260619 18:46:01.374039 12500 scanner-internal.cc:458] Time spent opening tablet: real 3.608s user 0.011s sys 0.000s
W20260619 18:46:01.375577 13204 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.009810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:55498)
0619 18:45:58.255040 (+245230us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.255106 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.255548 (+ 442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:58.391832 (+136284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:58.399854 (+ 8022us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:58.404190 (+ 4336us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:58.508603 (+104413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:58.508663 (+ 60us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.578172 (+1069509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.581624 (+ 3452us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.818964 (+237340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.819044 (+ 80us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.193406 (+374362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.193443 (+ 37us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.518522 (+325079us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.518769 (+ 247us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 18:46:01.371661 (+852892us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":206717,"mutex_wait_us":952690,"thread_start_us":176860,"threads_started":1}
I20260619 18:46:01.376304 12161 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:46:01.377038 12161 scanner-internal.cc:458] Time spent opening tablet: real 3.619s user 0.011s sys 0.005s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:46:01.384096 13059 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.278892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55498 (local address 127.6.120.193:37901)
0619 18:45:58.350172 (+ 71280us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:58.350213 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:58.350277 (+ 64us) server_negotiation.cc:407] Connection header received
0619 18:45:58.350435 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:58.350461 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:58.369844 (+ 19383us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:58.390196 (+ 20352us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:58.517430 (+127234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.576430 (+1059000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.819284 (+242854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.189397 (+370113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.313688 (+124291us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.519784 (+206096us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 18:46:01.331463 (+811679us) spinlock_profiling.cc:243] Waited 4.9 ms on lock 0x7b24002c79c8. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fba81a 00007f13889765fc 00007f1388973a57 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:46:01.331599 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 18:46:01.382305 (+ 50706us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:55498: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1845934,"server-negotiator.queue_time_us":70845,"spinlock_wait_cycles":11271552,"thread_start_us":130240,"threads_started":1}
W20260619 18:46:01.387566 12614 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.173609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35100 (local address 127.6.120.254:36501)
0619 18:45:59.388406 (+1214797us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.392255 (+ 3849us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.392308 (+ 53us) server_negotiation.cc:407] Connection header received
0619 18:45:59.392435 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.392457 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.392702 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.392876 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.860485 (+467609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.194790 (+334305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.724857 (+530067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.385626 (+660769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.386160 (+ 534us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35100: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1260573,"server-negotiator.queue_time_us":1187969}
W20260619 18:46:01.428377 13205 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.037843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35070)
0619 18:45:58.277562 (+239719us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.279615 (+ 2053us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.302114 (+ 22499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.353537 (+1051423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.354359 (+ 822us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.354527 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.663857 (+309330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.663913 (+ 56us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.045690 (+381777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.045737 (+ 47us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.512882 (+467145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:00.514401 (+ 1519us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.426869 (+912468us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":197751,"mutex_wait_us":964451,"thread_start_us":153038,"threads_started":1}
W20260619 18:46:01.430964 13215 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.235765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35100)
0619 18:45:58.430021 (+194256us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.431294 (+ 1273us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.433938 (+ 2644us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.393121 (+959183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.393157 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.393293 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.856037 (+462744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.857363 (+ 1326us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.197472 (+340109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.197507 (+ 35us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.712631 (+515124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:00.717729 (+ 5098us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.429087 (+711358us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":90669,"mutex_wait_us":1061591,"thread_start_us":8681,"threads_started":1}
W20260619 18:46:01.436347 12819 scanner-internal.cc:458] Time spent opening tablet: real 3.286s user 0.008s sys 0.011s
W20260619 18:46:01.439353 12933 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.024628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55466 (local address 127.6.120.193:37901)
0619 18:45:58.146393 (+121765us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:58.148801 (+ 2408us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:58.314651 (+165850us) server_negotiation.cc:407] Connection header received
0619 18:45:58.365868 (+ 51217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:58.367216 (+ 1348us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:58.495111 (+127895us) spinlock_profiling.cc:243] Waited 8.12 ms on lock 0x7b4800081e18. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:58.524393 (+ 29282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:58.566354 (+ 41961us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:59.216502 (+650148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.721497 (+504995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.432592 (+1711095us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:55466: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1314063,"server-negotiator.queue_time_us":131,"spinlock_wait_cycles":18679680}
W20260619 18:46:01.447885 12817 scanner-internal.cc:458] Time spent opening tablet: real 3.621s user 0.001s sys 0.013s
W20260619 18:46:01.452941 12455 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.140198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35084)
0619 18:45:58.173329 (+ 33131us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.173385 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.173669 (+ 284us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.363734 (+1190065us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.363772 (+ 38us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.363923 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.901945 (+538022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.902008 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.275875 (+373867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.283142 (+ 7267us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.379198 (+1096056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.379265 (+ 67us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.416782 (+ 37517us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":18735,"mutex_wait_us":1542668}
W20260619 18:46:01.454676 13196 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.931413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35060)
0619 18:45:58.174422 (+243009us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.174492 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.187132 (+ 12640us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.323490 (+1136358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.323534 (+ 44us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.323713 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.670571 (+346858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.670935 (+ 364us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.783560 (+112625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.783808 (+ 248us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.390991 (+1607183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.391044 (+ 53us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.453086 (+ 62042us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":209595,"mutex_wait_us":1834401,"thread_start_us":63446,"threads_started":1}
W20260619 18:46:01.456166 13176 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.633677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35024)
0619 18:45:57.704528 (+ 70851us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.704596 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.704841 (+ 245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.142318 (+1437477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.142358 (+ 40us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.142475 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.510627 (+368152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.510698 (+ 71us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.701808 (+191110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.701856 (+ 48us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.087401 (+385545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:00.090266 (+ 2865us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.275722 (+185456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.280346 (+ 4624us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.590578 (+310232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.746549 (+155971us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:46:00.746581 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:46:00.746638 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:46:00.746781 (+ 143us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:46:01.409978 (+663197us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":61536,"mutex_wait_us":1795722,"thread_start_us":48382,"threads_started":1}
W20260619 18:46:01.462766 12585 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.399674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35170 (local address 127.6.120.254:36501)
0619 18:45:59.597360 (+1197686us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.597393 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.597441 (+ 48us) server_negotiation.cc:407] Connection header received
0619 18:45:59.597585 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.597615 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.597899 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.598074 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.717367 (+119293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.566926 (+849559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.452316 (+885390us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35170: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":899493,"server-negotiator.queue_time_us":1183186}
W20260619 18:46:01.468477 13202 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.000945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:55466)
0619 18:45:58.307504 (+306559us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.308979 (+ 1475us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.346375 (+ 37396us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:58.567023 (+220648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:58.597374 (+ 30351us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:58.607374 (+ 10000us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:59.216093 (+608719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.216194 (+ 101us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.722793 (+506599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.723208 (+ 415us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.387297 (+1664089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.387378 (+ 81us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.466373 (+ 78995us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":214827,"mutex_wait_us":2183714,"thread_start_us":169205,"threads_started":1}
I20260619 18:46:01.470880 12179 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:46:01.471356 12179 scanner-internal.cc:458] Time spent opening tablet: real 3.759s user 0.002s sys 0.003s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:46:01.475574 12563 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.931555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35060 (local address 127.6.120.254:36501)
0619 18:45:59.320735 (+1389180us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.320772 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.320819 (+ 47us) server_negotiation.cc:407] Connection header received
0619 18:45:59.320946 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.320971 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.321238 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.321416 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.671195 (+349779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.781448 (+110253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.466314 (+1684866us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35060: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":595021,"server-negotiator.queue_time_us":1388750}
W20260619 18:46:01.484687 13218 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.286779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35114)
0619 18:45:58.434506 (+147727us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.434559 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.434790 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.391231 (+956441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.391268 (+ 37us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.391388 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.689805 (+298417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.689867 (+ 62us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.732878 (+ 43011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.734924 (+ 2046us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.684724 (+949800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:00.687514 (+ 2790us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.465767 (+778253us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":140011,"mutex_wait_us":1264640,"thread_start_us":71576,"threads_started":1}
W20260619 18:46:01.502489 12636 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.323536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35130 (local address 127.6.120.254:36501)
0619 18:45:59.488766 (+1165230us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.488803 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.488848 (+ 45us) server_negotiation.cc:407] Connection header received
0619 18:45:59.493423 (+ 4575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.494473 (+ 1050us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.508197 (+ 13724us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.508410 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.761854 (+253444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.053178 (+291324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.491804 (+1438626us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35130: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":489699,"server-negotiator.queue_time_us":1162505}
W20260619 18:46:01.505931 12907 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.462355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35198)
0619 18:45:58.626157 (+163802us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.626219 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.626504 (+ 285us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.678078 (+1051574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.678113 (+ 35us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.678236 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.871145 (+192909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.871202 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.195311 (+324109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.195349 (+ 38us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.378811 (+1183462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.378875 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.504595 (+125720us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":4237,"mutex_wait_us":1389580}
W20260619 18:46:01.499717 12831 client.cc:2034] Couldn't close scanner 7b3c2a400e9e4074bdee786a43da5d5a: Service unavailable: reactor is shutting down (error 108)
W20260619 18:46:01.527588 12516 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.447701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35178 (local address 127.6.120.254:36501)
0619 18:45:59.602656 (+1154955us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.602699 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.603584 (+ 885us) server_negotiation.cc:407] Connection header received
0619 18:45:59.604693 (+ 1109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.604721 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.604985 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.605170 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.959153 (+353983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.487747 (+528594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.526400 (+1038653us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35178: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":569934,"server-negotiator.queue_time_us":1152249}
W20260619 18:46:01.541977 12480 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.491436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55542 (local address 127.6.120.193:37901)
0619 18:45:58.885231 (+393795us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:58.885266 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:58.885314 (+ 48us) server_negotiation.cc:407] Connection header received
0619 18:45:58.885450 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:58.885478 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:58.885822 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:58.886074 (+ 252us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:59.614707 (+728633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.823145 (+208438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.489534 (+666389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.747653 (+258119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.396217 (+648564us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:01.518937 (+122720us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:55542: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1123820,"server-negotiator.queue_time_us":393381,"thread_start_us":276310,"threads_started":1}
W20260619 18:46:01.543175 12544 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.446452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35186 (local address 127.6.120.254:36501)
0619 18:45:59.598680 (+1152228us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.598720 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.599504 (+ 784us) server_negotiation.cc:407] Connection header received
0619 18:45:59.603602 (+ 4098us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.604197 (+ 595us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.606920 (+ 2723us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.610194 (+ 3274us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.969901 (+359707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.500569 (+530668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.528984 (+1028415us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35186: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":637268,"server-negotiator.queue_time_us":1149576}
W20260619 18:46:01.543632 12595 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.511443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35180 (local address 127.6.120.254:36501)
0619 18:45:59.633727 (+1122284us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.633767 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.633837 (+ 70us) server_negotiation.cc:407] Connection header received
0619 18:45:59.634006 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.634035 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.634298 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.634513 (+ 215us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.874638 (+240125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.449245 (+574607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.502093 (+1052848us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35180: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":631671,"server-negotiator.queue_time_us":1115996}
W20260619 18:46:01.545017 12824 scanner-internal.cc:458] Time spent opening tablet: real 3.106s user 0.029s sys 0.060s
W20260619 18:46:01.547112 12591 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.105629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35084 (local address 127.6.120.254:36501)
0619 18:45:59.347128 (+1241499us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.347164 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.347221 (+ 57us) server_negotiation.cc:407] Connection header received
0619 18:45:59.347369 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.347398 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.356736 (+ 9338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.366375 (+ 9639us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.902318 (+535943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.271164 (+368846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.485475 (+1214311us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35084: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":981456,"server-negotiator.queue_time_us":1241058}
W20260619 18:46:01.541283 12816 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.055838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53120)
0619 18:45:57.060305 (+ 4467us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.060360 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.060590 (+ 230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:58.373938 (+1313348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:58.373978 (+ 40us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:58.374114 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.122609 (+748495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.129170 (+ 6561us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.673430 (+544260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.673474 (+ 44us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.359507 (+1686033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.359586 (+ 79us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.465327 (+105741us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":3952,"mutex_wait_us":2453039,"thread_start_us":61050,"threads_started":1}
W20260619 18:46:01.551537 12648 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.038046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35070 (local address 127.6.120.254:36501)
0619 18:45:59.351151 (+1313105us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.351204 (+ 53us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.351296 (+ 92us) server_negotiation.cc:407] Connection header received
0619 18:45:59.351900 (+ 604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.351950 (+ 50us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.352323 (+ 373us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.353457 (+ 1134us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.665914 (+312457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.043156 (+377242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.525399 (+482243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.549600 (+1024201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.550185 (+ 585us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35070: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1569858,"server-negotiator.queue_time_us":1305622}
W20260619 18:46:01.566533 13229 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.427761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35178)
0619 18:45:58.895484 (+467723us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.895553 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.895930 (+ 377us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.605716 (+709786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.605748 (+ 32us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.605906 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.957826 (+351920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.957887 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.488303 (+530416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.488338 (+ 35us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.479374 (+991036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.480924 (+ 1550us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.564675 (+ 83751us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":467044,"mutex_wait_us":1324129,"thread_start_us":136747,"threads_started":1}
W20260619 18:46:01.626538 13225 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.309890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35130)
0619 18:45:58.489690 (+179800us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.489760 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.490098 (+ 338us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.508509 (+1018411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.508543 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.508685 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.761449 (+252764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.761542 (+ 93us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.061757 (+300215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.063476 (+ 1719us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.613701 (+1550225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.613756 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.614552 (+ 796us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":175686,"mutex_wait_us":1725148,"thread_start_us":140592,"threads_started":1}
W20260619 18:46:01.626179 12058 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.630079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35198 (local address 127.6.120.254:36501)
0619 18:45:59.673453 (+1043374us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.673487 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.674337 (+ 850us) server_negotiation.cc:407] Connection header received
0619 18:45:59.675958 (+ 1621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.676022 (+ 64us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.676679 (+ 657us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.677836 (+ 1157us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.871478 (+193642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.193734 (+322256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.379557 (+1185823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.602657 (+223100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.624511 (+ 21854us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35198: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":569978,"server-negotiator.queue_time_us":1042969}
W20260619 18:46:01.655573 11040 connection.cc:441] server connection from 127.0.0.1:55512 torn down before Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:55512 (request call id 2) could send its response
W20260619 18:46:01.656509 12652 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.513833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35200 (local address 127.6.120.254:36501)
0619 18:45:59.639770 (+1125937us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.639794 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.639830 (+ 36us) server_negotiation.cc:407] Connection header received
0619 18:45:59.639957 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.639998 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.640242 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.640955 (+ 713us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:46:00.011358 (+370403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.314025 (+302667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.652909 (+1338884us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35200: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":405468,"server-negotiator.queue_time_us":1125554}
W20260619 18:46:01.660899 12222 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 46245.6us
W20260619 18:46:01.665306 13185 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.707075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35056)
0619 18:45:58.006849 (+299774us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.006913 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.007251 (+ 338us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.265355 (+1258104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.266285 (+ 930us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.274455 (+ 8170us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.963019 (+688564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.964729 (+ 1710us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.312667 (+347938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.312705 (+ 38us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.526207 (+1213502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.526268 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.663563 (+137295us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":263702,"mutex_wait_us":1909308,"thread_start_us":212598,"threads_started":1}
W20260619 18:46:01.671007 13134 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.232235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53170)
0619 18:45:57.364777 (+132542us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.364839 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.365106 (+ 267us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:58.884287 (+1519181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:58.884323 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:58.884474 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.239913 (+355439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.239977 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.952806 (+712829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.952844 (+ 38us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.457024 (+1504180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.457086 (+ 62us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.669155 (+212069us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":131415,"mutex_wait_us":1952211,"thread_start_us":42486,"threads_started":1}
W20260619 18:46:01.672313 13163 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 217878us
W20260619 18:46:01.676371 12437 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.466854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35180)
0619 18:45:58.497067 (+ 30213us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.497116 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.497373 (+ 257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.634749 (+1137376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.634789 (+ 40us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.634917 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.873416 (+238499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.873498 (+ 82us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.453554 (+580056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.456604 (+ 3050us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.532926 (+1076322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.534871 (+ 1945us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.674934 (+140063us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":16026,"mutex_wait_us":1367207}
W20260619 18:46:01.679901 13177 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.645545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35048)
0619 18:45:57.770170 (+124625us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.779041 (+ 8871us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.794127 (+ 15086us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.158741 (+1364614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.158777 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.158930 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.159736 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.159821 (+ 85us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.791813 (+631992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.791854 (+ 41us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.475887 (+684033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:00.475954 (+ 67us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.587062 (+111108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.587099 (+ 37us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.521228 (+934129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:01.538149 (+ 16921us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:46:01.538169 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:46:01.538234 (+ 65us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:46:01.538397 (+ 163us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:46:01.670046 (+131649us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":70222,"mutex_wait_us":1697978,"thread_start_us":37261,"threads_started":1}
W20260619 18:46:01.684487 12823 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.472020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35200)
0619 18:45:58.473636 (+ 1616us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.473703 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.474032 (+ 329us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.640547 (+1166515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.640580 (+ 33us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.640711 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:46:00.008887 (+368176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:00.010465 (+ 1578us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.314485 (+304020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.314519 (+ 34us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.560597 (+1246078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.560655 (+ 58us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.683065 (+122410us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1009,"mutex_wait_us":1348194}
W20260619 18:46:01.688227 13231 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.444819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35186)
0619 18:45:58.490646 (+ 45827us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.490714 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.490978 (+ 264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.610535 (+1119557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.610594 (+ 59us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.610795 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.968311 (+357516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.969562 (+ 1251us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.500883 (+531321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.500922 (+ 39us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.570602 (+1069680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.572797 (+ 2195us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.686686 (+113889us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":45326,"mutex_wait_us":1469811,"thread_start_us":43309,"threads_started":1}
W20260619 18:46:01.742625 12624 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.309179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35114 (local address 127.6.120.254:36501)
0619 18:45:59.389691 (+1080512us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.389724 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.389773 (+ 49us) server_negotiation.cc:407] Connection header received
0619 18:45:59.389923 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.389952 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.390216 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.390401 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.600932 (+210531us) spinlock_profiling.cc:243] Waited 984 us on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:59.713391 (+112459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.725994 (+ 12603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.691882 (+965888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.554476 (+862594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.714507 (+160031us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35114: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1317200,"server-negotiator.queue_time_us":1078326,"spinlock_wait_cycles":2263296}
W20260619 18:46:01.744408 12170 scanner-internal.cc:458] Time spent opening tablet: real 2.325s user 0.013s sys 0.001s
W20260619 18:46:01.744370 12162 scanner-internal.cc:458] Time spent opening tablet: real 2.655s user 0.003s sys 0.000s
W20260619 18:46:01.779081 13233 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.491300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:55542)
0619 18:45:58.778006 (+286706us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.778113 (+ 107us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.778700 (+ 587us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:58.887026 (+108326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:58.887078 (+ 52us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:58.887149 (+ 71us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:59.612288 (+725139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.612366 (+ 78us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.825341 (+212975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.825403 (+ 62us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.488264 (+662861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:00.488317 (+ 53us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.821149 (+332832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.883892 (+ 62743us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.568436 (+684544us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:01.598172 (+ 29736us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 18:46:01.761409 (+163237us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":35921,"mutex_wait_us":2149710,"thread_start_us":561,"threads_started":1}
I20260619 18:46:01.804332 12642 scanner-internal.cc:172] Scan of tablet d63b7834d93346288748391962132228 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:46:01.804841 12642 scanner-internal.cc:458] Time spent opening tablet: real 3.457s user 0.024s sys 0.049s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:46:01.818928 12947 scanner-internal.cc:458] Time spent opening tablet: real 2.590s user 0.012s sys 0.006s
W20260619 18:46:01.825019 12121 scanner-internal.cc:458] Time spent opening tablet: real 3.394s user 0.028s sys 0.032s
W20260619 18:46:01.835263 12903 scanner-internal.cc:458] Time spent opening tablet: real 2.446s user 0.025s sys 0.019s
W20260619 18:46:01.835891 13190 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 223206us
W20260619 18:46:01.878750 12157 scanner-internal.cc:458] Time spent opening tablet: real 3.019s user 0.016s sys 0.033s
W20260619 18:46:01.898666 12869 scanner-internal.cc:458] Time spent opening tablet: real 2.779s user 0.021s sys 0.018s
W20260619 18:46:01.908521 12155 scanner-internal.cc:458] Time spent opening tablet: real 3.051s user 0.021s sys 0.023s
W20260619 18:46:01.909549 12474 scanner-internal.cc:458] Time spent opening tablet: real 2.969s user 0.013s sys 0.026s
W20260619 18:46:01.914377 12936 scanner-internal.cc:458] Time spent opening tablet: real 2.539s user 0.001s sys 0.008s
W20260619 18:46:01.936954 12485 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.424906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35170)
0619 18:45:58.434852 (+ 9946us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.434903 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.435116 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.600276 (+1165160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.600312 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.600436 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.716469 (+116033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.716533 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.575916 (+859383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.576969 (+ 1053us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.911654 (+1334685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.911713 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.929218 (+ 17505us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1857,"mutex_wait_us":1404608}
W20260619 18:46:01.983678 12798 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 315017us
W20260619 18:46:01.988534 12240 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 114648us
W20260619 18:46:01.992623 12850 scanner-internal.cc:458] Time spent opening tablet: real 3.059s user 0.007s sys 0.015s
W20260619 18:46:02.093825 12086 scanner-internal.cc:458] Time spent opening tablet: real 1.956s user 0.014s sys 0.005s
W20260619 18:46:02.104362 12186 scanner-internal.cc:458] Time spent opening tablet: real 2.214s user 0.001s sys 0.005s
W20260619 18:46:02.112442 13030 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 137767us
W20260619 18:46:02.124945 13070 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:59.090753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35246)
0619 18:45:59.129331 (+ 38578us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:59.131251 (+ 1920us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:59.143801 (+ 12550us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.759387 (+615586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.759423 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.759582 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.934660 (+175078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.934720 (+ 60us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.503643 (+568923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.503689 (+ 46us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.652337 (+1148648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.652388 (+ 51us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.811260 (+158872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.811296 (+ 36us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:02.045249 (+233953us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:02.054615 (+ 9366us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:46:02.055554 (+ 939us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:46:02.056748 (+ 1194us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:46:02.059547 (+ 2799us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:46:02.068934 (+ 9387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 18:46:02.069302 (+ 368us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 18:46:02.070821 (+ 1519us) client_negotiation.cc:769] Sending connection context
0619 18:46:02.115051 (+ 44230us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":1534443}
W20260619 18:46:02.149168 12902 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 69356.6us
W20260619 18:46:02.174908 12960 scanner-internal.cc:458] Time spent opening tablet: real 2.205s user 0.002s sys 0.002s
W20260619 18:46:02.187062 12163 scanner-internal.cc:458] Time spent opening tablet: real 2.473s user 0.008s sys 0.000s
W20260619 18:46:02.194175 12081 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:59.068026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35246 (local address 127.6.120.254:36501)
0619 18:45:59.758258 (+690232us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.758303 (+ 45us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.758384 (+ 81us) server_negotiation.cc:407] Connection header received
0619 18:45:59.758568 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.758613 (+ 45us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.759007 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.759284 (+ 277us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.936944 (+177660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.496023 (+559079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.656587 (+1160564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.809997 (+153410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.838072 (+ 28075us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:02.065585 (+227513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 18:46:02.065640 (+ 55us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 18:46:02.065668 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 18:46:02.065730 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0619 18:46:02.065823 (+ 93us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 18:46:02.065897 (+ 74us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 18:46:02.066056 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0619 18:46:02.119641 (+ 53585us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35246: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":913311,"server-negotiator.queue_time_us":689564}
W20260619 18:46:02.194247 12137 scanner-internal.cc:458] Time spent opening tablet: real 2.581s user 0.005s sys 0.001s
W20260619 18:46:02.194800 12608 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:59.039959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35232 (local address 127.6.120.254:36501)
0619 18:45:59.740597 (+700638us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.740633 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.740684 (+ 51us) server_negotiation.cc:407] Connection header received
0619 18:45:59.740807 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.740831 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.741085 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.741265 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:46:00.143428 (+402163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.647966 (+504538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.689413 (+1041447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:02.002927 (+313514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:02.081115 (+ 78188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:02.120262 (+ 39147us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35232: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1051472,"server-negotiator.queue_time_us":688985}
W20260619 18:46:02.194561 13015 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:59.121940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35250 (local address 127.6.120.254:36501)
0619 18:45:59.765568 (+643628us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.765614 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.765676 (+ 62us) server_negotiation.cc:407] Connection header received
0619 18:45:59.765854 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.765897 (+ 43us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.766399 (+ 502us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.769652 (+ 3253us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.779830 (+ 10178us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:59.978024 (+198194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.506531 (+528507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.634603 (+1128072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.960948 (+326345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:02.011176 (+ 50228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:02.191013 (+179837us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35250: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1113794,"server-negotiator.queue_time_us":642990,"spinlock_wait_cycles":4909312}
W20260619 18:46:02.222476 12868 scanner-internal.cc:458] Time spent opening tablet: real 2.702s user 0.017s sys 0.032s
W20260619 18:46:02.246364 12773 scanner-internal.cc:458] Time spent opening tablet: real 2.351s user 0.001s sys 0.003s
W20260619 18:46:02.270345 12507 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:59.122298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35250)
0619 18:45:59.184867 (+ 62569us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:59.185582 (+ 715us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:59.189608 (+ 4026us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.768724 (+579116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.768760 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.768895 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.832903 (+ 64008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.832985 (+ 82us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.506848 (+673863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.506888 (+ 40us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.623655 (+1116767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.634299 (+ 10644us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.962850 (+328551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.962888 (+ 38us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:02.074746 (+111858us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:02.138111 (+ 63365us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:46:02.138140 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:46:02.138198 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:46:02.138320 (+ 122us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:46:02.208700 (+ 70380us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":414,"mutex_wait_us":1346567}
W20260619 18:46:02.272359 13251 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:59.022224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35232)
0619 18:45:59.157143 (+134919us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:59.157192 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:59.157551 (+ 359us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.746906 (+589355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.746952 (+ 46us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.747086 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:46:00.133735 (+386649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:00.140445 (+ 6710us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.677517 (+537072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.678828 (+ 1311us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.689048 (+1010220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.689111 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:02.005489 (+316378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:02.006556 (+ 1067us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:02.131283 (+124727us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:02.138637 (+ 7354us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:46:02.139377 (+ 740us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:46:02.140044 (+ 667us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:46:02.143856 (+ 3812us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:46:02.249509 (+105653us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":112734,"mutex_wait_us":1511278,"thread_start_us":72473,"threads_started":1}
W20260619 18:46:02.272851 13013 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 46562.7us
W20260619 18:46:02.286136 12133 scanner-internal.cc:458] Time spent opening tablet: real 2.911s user 0.008s sys 0.012s
W20260619 18:46:02.297443 12212 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 88096.6us
W20260619 18:46:02.298117 12991 scanner-internal.cc:458] Time spent opening tablet: real 2.585s user 0.000s sys 0.003s
W20260619 18:46:02.321272 12931 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 138425us
W20260619 18:46:02.367213 12829 scanner-internal.cc:458] Time spent opening tablet: real 2.360s user 0.001s sys 0.021s
W20260619 18:46:02.374517 12833 scanner-internal.cc:458] Time spent opening tablet: real 2.414s user 0.017s sys 0.013s
W20260619 18:46:02.445456 12198 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 82562.2us
W20260619 18:46:02.449011 13100 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 64834.3us
W20260619 18:46:02.527503 13089 scanner-internal.cc:458] Time spent opening tablet: real 2.053s user 0.003s sys 0.022s
W20260619 18:46:02.554453 12961 scanner-internal.cc:458] Time spent opening tablet: real 2.614s user 0.006s sys 0.007s
W20260619 18:46:02.561806 13162 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 108531us
W20260619 18:46:02.592054 13156 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 124073us
W20260619 18:46:02.624631 12801 scanner-internal.cc:458] Time spent opening tablet: real 1.229s user 0.010s sys 0.009s
W20260619 18:46:02.624789 13020 scanner-internal.cc:458] Time spent opening tablet: real 2.102s user 0.007s sys 0.037s
W20260619 18:46:02.624897 12237 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 149782us
W20260619 18:46:02.631681 12992 scanner-internal.cc:458] Time spent opening tablet: real 2.095s user 0.002s sys 0.005s
W20260619 18:46:02.639791 12920 scanner-internal.cc:458] Time spent opening tablet: real 2.832s user 0.004s sys 0.008s
W20260619 18:46:02.633064 12886 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 129037us
W20260619 18:46:02.695062 12951 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 177346us
W20260619 18:46:02.710259 13086 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 140533us
W20260619 18:46:02.770807 13137 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 44832.9us
W20260619 18:46:02.775449 12197 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 129986us
W20260619 18:46:02.753682 13097 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 108923us
W20260619 18:46:02.779629 13191 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 90526us
W20260619 18:46:02.802192 12060 scanner-internal.cc:458] Time spent opening tablet: real 2.407s user 0.011s sys 0.007s
W20260619 18:46:02.802946 13135 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 205827us
W20260619 18:46:02.817807 13085 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 61639.6us
W20260619 18:46:02.848964 12220 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 92043.6us
W20260619 18:46:02.866639 12207 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 259516us
W20260619 18:46:02.930025 12672 scanner-internal.cc:458] Time spent opening tablet: real 2.721s user 0.013s sys 0.022s
W20260619 18:46:02.976752 12156 scanner-internal.cc:458] Time spent opening tablet: real 2.402s user 0.006s sys 0.015s
W20260619 18:46:02.985278 12280 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 176819us
W20260619 18:46:02.987723 12767 scanner-internal.cc:458] Time spent opening tablet: real 2.791s user 0.005s sys 0.006s
W20260619 18:46:02.998129 12578 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 260075us
W20260619 18:46:03.035023 12859 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 327273us
W20260619 18:46:03.049872 12189 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 358433us
W20260619 18:46:03.046686 12514 scanner-internal.cc:458] Time spent opening tablet: real 2.459s user 0.042s sys 0.019s
W20260619 18:46:03.072419 12731 scanner-internal.cc:458] Time spent opening tablet: real 2.875s user 0.011s sys 0.024s
W20260619 18:46:03.072633 12745 scanner-internal.cc:458] Time spent opening tablet: real 2.876s user 0.009s sys 0.009s
W20260619 18:46:03.116083 12969 scanner-internal.cc:458] Time spent opening tablet: real 0.771s user 0.009s sys 0.001s
W20260619 18:46:03.116387 12206 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 251311us
W20260619 18:46:03.125262 12233 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 141132us
W20260619 18:46:03.144677 12783 scanner-internal.cc:458] Time spent opening tablet: real 1.769s user 0.001s sys 0.011s
W20260619 18:46:03.177753 13117 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 387524us
W20260619 18:46:03.224834 12789 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 148294us
W20260619 18:46:03.232326 13159 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 320619us
W20260619 18:46:03.256145 12689 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 432657us
W20260619 18:46:03.257493 12174 scanner-internal.cc:458] Time spent opening tablet: real 1.238s user 0.008s sys 0.013s
W20260619 18:46:03.259678 12211 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 150063us
W20260619 18:46:03.304600 12127 scanner-internal.cc:458] Time spent opening tablet: real 0.943s user 0.011s sys 0.005s
W20260619 18:46:03.323374 12788 scanner-internal.cc:458] Time spent opening tablet: real 1.312s user 0.009s sys 0.003s
W20260619 18:46:03.360152 12148 scanner-internal.cc:458] Time spent opening tablet: real 2.029s user 0.008s sys 0.005s
W20260619 18:46:03.386521 13128 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 332441us
W20260619 18:46:03.406448 13166 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 496166us
W20260619 18:46:03.437857 13096 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 348283us
W20260619 18:46:03.513428 12803 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 162861us
W20260619 18:46:03.521111 12152 scanner-internal.cc:458] Time spent opening tablet: real 1.777s user 0.003s sys 0.019s
W20260619 18:46:03.547542 13151 scanner-internal.cc:458] Time spent opening tablet: real 1.865s user 0.007s sys 0.004s
W20260619 18:46:03.597856 13169 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 225450us
W20260619 18:46:03.762169 12956 scanner-internal.cc:458] Time spent opening tablet: real 1.415s user 0.003s sys 0.002s
W20260619 18:46:03.765724 12251 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 232898us
W20260619 18:46:03.781483 12771 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 376974us
W20260619 18:46:03.866501 12968 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 253053us
W20260619 18:46:03.971501 12860 scanner-internal.cc:458] Time spent opening tablet: real 1.614s user 0.009s sys 0.004s
W20260619 18:46:04.007313 12875 scanner-internal.cc:458] Time spent opening tablet: real 1.736s user 0.013s sys 0.007s
W20260619 18:46:04.010100 12129 scanner-internal.cc:458] Time spent opening tablet: real 1.550s user 0.001s sys 0.007s
W20260619 18:46:04.017809 12993 scanner-internal.cc:458] Time spent opening tablet: real 1.795s user 0.016s sys 0.002s
W20260619 18:46:04.028967 12981 scanner-internal.cc:458] Time spent opening tablet: real 1.678s user 0.023s sys 0.006s
W20260619 18:46:04.059809 13155 scanner-internal.cc:458] Time spent opening tablet: real 1.186s user 0.007s sys 0.013s
W20260619 18:46:04.061364 13167 scanner-internal.cc:458] Time spent opening tablet: real 2.143s user 0.005s sys 0.008s
W20260619 18:46:04.088626 13170 scanner-internal.cc:458] Time spent opening tablet: real 1.568s user 0.002s sys 0.002s
W20260619 18:46:04.174047 12841 scanner-internal.cc:458] Time spent opening tablet: real 1.446s user 0.015s sys 0.015s
W20260619 18:46:04.186373 13127 scanner-internal.cc:458] Time spent opening tablet: real 1.583s user 0.005s sys 0.014s
W20260619 18:46:04.197918 13042 scanner-internal.cc:458] Time spent opening tablet: real 1.738s user 0.007s sys 0.012s
W20260619 18:46:04.209712 13230 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 407484us
W20260619 18:46:04.255657 12172 scanner-internal.cc:458] Time spent opening tablet: real 1.542s user 0.009s sys 0.025s
W20260619 18:46:04.280877 13113 scanner-internal.cc:458] Time spent opening tablet: real 1.402s user 0.003s sys 0.009s
W20260619 18:46:04.282954 12126 scanner-internal.cc:458] Time spent opening tablet: real 1.636s user 0.012s sys 0.010s
W20260619 18:46:04.294473 13132 scanner-internal.cc:458] Time spent opening tablet: real 1.682s user 0.012s sys 0.008s
W20260619 18:46:04.312145 13047 scanner-internal.cc:458] Time spent opening tablet: real 1.329s user 0.041s sys 0.033s
W20260619 18:46:04.346256 12668 scanner-internal.cc:458] Time spent opening tablet: real 0.824s user 0.004s sys 0.012s
W20260619 18:46:04.374409 13130 scanner-internal.cc:458] Time spent opening tablet: real 1.543s user 0.005s sys 0.004s
W20260619 18:46:04.419595 12151 scanner-internal.cc:458] Time spent opening tablet: real 1.380s user 0.053s sys 0.009s
W20260619 18:46:04.423527 12130 scanner-internal.cc:458] Time spent opening tablet: real 1.487s user 0.004s sys 0.005s
W20260619 18:46:04.437445 13054 scanner-internal.cc:458] Time spent opening tablet: real 1.613s user 0.012s sys 0.015s
W20260619 18:46:04.446051 12465 scanner-internal.cc:458] Time spent opening tablet: real 1.237s user 0.013s sys 0.021s
W20260619 18:46:04.457394 12882 scanner-internal.cc:458] Time spent opening tablet: real 1.582s user 0.003s sys 0.012s
W20260619 18:46:04.480468 13148 scanner-internal.cc:458] Time spent opening tablet: real 0.988s user 0.011s sys 0.013s
W20260619 18:46:04.502683 12138 scanner-internal.cc:458] Time spent opening tablet: real 1.130s user 0.012s sys 0.020s
W20260619 18:46:04.518020 12117 scanner-internal.cc:458] Time spent opening tablet: real 1.212s user 0.004s sys 0.028s
W20260619 18:46:04.519985 13079 scanner-internal.cc:458] Time spent opening tablet: real 0.978s user 0.007s sys 0.042s
W20260619 18:46:04.541155 13171 scanner-internal.cc:458] Time spent opening tablet: real 1.605s user 0.001s sys 0.021s
W20260619 18:46:04.546574 12139 scanner-internal.cc:458] Time spent opening tablet: real 1.258s user 0.019s sys 0.006s
W20260619 18:46:04.573974 12167 scanner-internal.cc:458] Time spent opening tablet: real 1.236s user 0.013s sys 0.018s
W20260619 18:46:04.582521 12835 scanner-internal.cc:458] Time spent opening tablet: real 1.228s user 0.039s sys 0.013s
W20260619 18:46:04.583818 12779 scanner-internal.cc:458] Time spent opening tablet: real 1.049s user 0.004s sys 0.014s
W20260619 18:46:04.621649 12184 scanner-internal.cc:458] Time spent opening tablet: real 0.649s user 0.010s sys 0.007s
W20260619 18:46:04.640833 13109 scanner-internal.cc:458] Time spent opening tablet: real 1.244s user 0.003s sys 0.008s
W20260619 18:46:04.647011 13140 scanner-internal.cc:458] Time spent opening tablet: real 0.883s user 0.013s sys 0.005s
W20260619 18:46:04.671082 12169 scanner-internal.cc:458] Time spent opening tablet: real 1.084s user 0.019s sys 0.015s
W20260619 18:46:04.675485 12134 scanner-internal.cc:458] Time spent opening tablet: real 1.177s user 0.004s sys 0.011s
W20260619 18:46:04.676275 12761 scanner-internal.cc:458] Time spent opening tablet: real 0.707s user 0.008s sys 0.013s
W20260619 18:46:04.679025 13084 scanner-internal.cc:458] Time spent opening tablet: real 1.746s user 0.011s sys 0.016s
W20260619 18:46:04.682729 13149 scanner-internal.cc:458] Time spent opening tablet: real 0.944s user 0.013s sys 0.001s
W20260619 18:46:04.707201 12795 scanner-internal.cc:458] Time spent opening tablet: real 0.944s user 0.021s sys 0.008s
W20260619 18:46:04.728281 13102 scanner-internal.cc:458] Time spent opening tablet: real 1.158s user 0.014s sys 0.016s
W20260619 18:46:04.735358 12908 scanner-internal.cc:458] Time spent opening tablet: real 0.750s user 0.007s sys 0.000s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:9066: Failure
Expected equality of these values:
1000
CountRows(tokens)
Which is: 715
I20260619 18:46:04.814723 6627 tablet_server.cc:178] TabletServer@127.6.120.193:0 shutting down...
I20260619 18:46:04.868147 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:46:04.869688 6627 tablet_replica.cc:330] T 1f02be074be240fa8534ef577aa46f77 P 67aa5c51d6d845d49abea1320970e12b: stopping tablet replica
I20260619 18:46:04.870831 6627 raft_consensus.cc:2229] T 1f02be074be240fa8534ef577aa46f77 P 67aa5c51d6d845d49abea1320970e12b [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:04.872030 6627 raft_consensus.cc:2258] T 1f02be074be240fa8534ef577aa46f77 P 67aa5c51d6d845d49abea1320970e12b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:04.889951 6627 tablet_replica.cc:330] T c679675f7d9c42e9ad71c188c7a6c595 P 67aa5c51d6d845d49abea1320970e12b: stopping tablet replica
I20260619 18:46:04.891033 6627 raft_consensus.cc:2229] T c679675f7d9c42e9ad71c188c7a6c595 P 67aa5c51d6d845d49abea1320970e12b [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:04.891798 6627 raft_consensus.cc:2258] T c679675f7d9c42e9ad71c188c7a6c595 P 67aa5c51d6d845d49abea1320970e12b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:04.895174 6627 tablet_replica.cc:330] T ece711fecbcf44beae2a210da7b57926 P 67aa5c51d6d845d49abea1320970e12b: stopping tablet replica
I20260619 18:46:04.896040 6627 raft_consensus.cc:2229] T ece711fecbcf44beae2a210da7b57926 P 67aa5c51d6d845d49abea1320970e12b [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:04.896991 6627 raft_consensus.cc:2258] T ece711fecbcf44beae2a210da7b57926 P 67aa5c51d6d845d49abea1320970e12b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:04.912392 6627 tablet_replica.cc:330] T d63b7834d93346288748391962132228 P 67aa5c51d6d845d49abea1320970e12b: stopping tablet replica
I20260619 18:46:04.913365 6627 raft_consensus.cc:2229] T d63b7834d93346288748391962132228 P 67aa5c51d6d845d49abea1320970e12b [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:04.914402 6627 raft_consensus.cc:2258] T d63b7834d93346288748391962132228 P 67aa5c51d6d845d49abea1320970e12b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:04.928805 6627 tablet_replica.cc:330] T 77f5f95c233a4022baf5b4992e90172d P 67aa5c51d6d845d49abea1320970e12b: stopping tablet replica
I20260619 18:46:04.929629 6627 raft_consensus.cc:2229] T 77f5f95c233a4022baf5b4992e90172d P 67aa5c51d6d845d49abea1320970e12b [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:04.930338 6627 raft_consensus.cc:2258] T 77f5f95c233a4022baf5b4992e90172d P 67aa5c51d6d845d49abea1320970e12b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:04.934314 6627 tablet_replica.cc:330] T 4161914b7a5e40a888261cedc6398a73 P 67aa5c51d6d845d49abea1320970e12b: stopping tablet replica
I20260619 18:46:04.935012 6627 raft_consensus.cc:2229] T 4161914b7a5e40a888261cedc6398a73 P 67aa5c51d6d845d49abea1320970e12b [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:04.935787 6627 raft_consensus.cc:2258] T 4161914b7a5e40a888261cedc6398a73 P 67aa5c51d6d845d49abea1320970e12b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 18:46:06.007267 6627 thread.cc:536] Waited for 1000ms trying to join with diag-logger (tid 11105)
W20260619 18:46:07.008078 6627 thread.cc:536] Waited for 2000ms trying to join with diag-logger (tid 11105)
W20260619 18:46:08.008591 6627 thread.cc:536] Waited for 3000ms trying to join with diag-logger (tid 11105)
W20260619 18:46:09.009084 6627 thread.cc:536] Waited for 4000ms trying to join with diag-logger (tid 11105)
W20260619 18:46:10.009582 6627 thread.cc:536] Waited for 5000ms trying to join with diag-logger (tid 11105)
W20260619 18:46:11.010067 6627 thread.cc:536] Waited for 6000ms trying to join with diag-logger (tid 11105)
W20260619 18:46:12.010571 6627 thread.cc:536] Waited for 7000ms trying to join with diag-logger (tid 11105)
W20260619 18:46:13.011056 6627 thread.cc:536] Waited for 8000ms trying to join with diag-logger (tid 11105)
I20260619 18:46:13.363319 6627 tablet_server.cc:194] TabletServer@127.6.120.193:0 shutdown complete.
I20260619 18:46:13.410322 6627 master.cc:537] Master@127.6.120.254:36501 shutting down...
I20260619 18:46:13.445815 6627 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 9ac8849341bc4dca9b41f97708342079 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:13.446699 6627 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 9ac8849341bc4dca9b41f97708342079 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:13.447103 6627 tablet_replica.cc:330] T 00000000000000000000000000000000 P 9ac8849341bc4dca9b41f97708342079: stopping tablet replica
I20260619 18:46:13.553608 6627 master.cc:552] Master@127.6.120.254:36501 shutdown complete.
I20260619 18:46:13.595350 6627 test_util.cc:175] -----------------------------------------------
I20260619 18:46:13.595640 6627 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.TableKeyRangeTest.TestGetTableKeyRange.1781894682485826-6627-0
Note: This is test shard 7 of 8.
[==========] Running 28 tests from 8 test suites.
[----------] Global test environment set-up.
[----------] 20 tests from ClientTest
[ RUN ] ClientTest.ConnectToClusterNoMasterAddressSpecified
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260619 18:44:42.659734 6627 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.120.254:37573
I20260619 18:44:42.661099 6627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 18:44:42.662103 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:42.681313 6634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:42.681550 6636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:42.683171 6627 server_base.cc:1034] running on GCE node
W20260619 18:44:42.681303 6633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:44.010190 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:44.010442 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:44.010701 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894684010676 us; error 0 us; skew 500 ppm
I20260619 18:44:44.011554 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:44.024837 6627 webserver.cc:460] Webserver started at http://127.6.120.254:36417/ using document root <none> and password file <none>
I20260619 18:44:44.025723 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:44.025980 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:44.026456 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:44.032877 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.ConnectToClusterNoMasterAddressSpecified.1781894682485826-6627-0/minicluster-data/master-0-root/instance:
uuid: "3476c9b77cbc45a8ad78fbaa229e6324"
format_stamp: "Formatted at 2026-06-19 18:44:44 on dist-test-slave-90mn"
I20260619 18:44:44.040591 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260619 18:44:44.045799 6642 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:44.046890 6627 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260619 18:44:44.047281 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.ConnectToClusterNoMasterAddressSpecified.1781894682485826-6627-0/minicluster-data/master-0-root
uuid: "3476c9b77cbc45a8ad78fbaa229e6324"
format_stamp: "Formatted at 2026-06-19 18:44:44 on dist-test-slave-90mn"
I20260619 18:44:44.047643 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.ConnectToClusterNoMasterAddressSpecified.1781894682485826-6627-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.ConnectToClusterNoMasterAddressSpecified.1781894682485826-6627-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.ConnectToClusterNoMasterAddressSpecified.1781894682485826-6627-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:44.094197 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:44.095741 6627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 18:44:44.096292 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:44.179698 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.254:37573
I20260619 18:44:44.179782 6703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.254:37573 every 8 connection(s)
I20260619 18:44:44.185992 6704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:44.208514 6704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3476c9b77cbc45a8ad78fbaa229e6324: Bootstrap starting.
I20260619 18:44:44.213995 6704 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3476c9b77cbc45a8ad78fbaa229e6324: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:44.215798 6704 log.cc:824] T 00000000000000000000000000000000 P 3476c9b77cbc45a8ad78fbaa229e6324: Log is configured to *not* fsync() on all Append() calls
I20260619 18:44:44.220242 6704 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3476c9b77cbc45a8ad78fbaa229e6324: No bootstrap required, opened a new log
I20260619 18:44:44.242549 6704 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3476c9b77cbc45a8ad78fbaa229e6324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3476c9b77cbc45a8ad78fbaa229e6324" member_type: VOTER }
I20260619 18:44:44.243176 6704 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3476c9b77cbc45a8ad78fbaa229e6324 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:44.243451 6704 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3476c9b77cbc45a8ad78fbaa229e6324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3476c9b77cbc45a8ad78fbaa229e6324, State: Initialized, Role: FOLLOWER
I20260619 18:44:44.244305 6704 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3476c9b77cbc45a8ad78fbaa229e6324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3476c9b77cbc45a8ad78fbaa229e6324" member_type: VOTER }
I20260619 18:44:44.244901 6704 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3476c9b77cbc45a8ad78fbaa229e6324 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:44.245195 6704 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3476c9b77cbc45a8ad78fbaa229e6324 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:44.245548 6704 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3476c9b77cbc45a8ad78fbaa229e6324 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:44.249398 6704 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3476c9b77cbc45a8ad78fbaa229e6324 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3476c9b77cbc45a8ad78fbaa229e6324" member_type: VOTER }
I20260619 18:44:44.250099 6704 leader_election.cc:302] T 00000000000000000000000000000000 P 3476c9b77cbc45a8ad78fbaa229e6324 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3476c9b77cbc45a8ad78fbaa229e6324; no voters:
I20260619 18:44:44.251747 6704 leader_election.cc:288] T 00000000000000000000000000000000 P 3476c9b77cbc45a8ad78fbaa229e6324 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:44.252187 6707 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3476c9b77cbc45a8ad78fbaa229e6324 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:44.254396 6707 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3476c9b77cbc45a8ad78fbaa229e6324 [term 1 LEADER]: Becoming Leader. State: Replica: 3476c9b77cbc45a8ad78fbaa229e6324, State: Running, Role: LEADER
I20260619 18:44:44.255223 6707 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3476c9b77cbc45a8ad78fbaa229e6324 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3476c9b77cbc45a8ad78fbaa229e6324" member_type: VOTER }
I20260619 18:44:44.256208 6704 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3476c9b77cbc45a8ad78fbaa229e6324 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 18:44:44.266556 6708 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3476c9b77cbc45a8ad78fbaa229e6324 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3476c9b77cbc45a8ad78fbaa229e6324" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3476c9b77cbc45a8ad78fbaa229e6324" member_type: VOTER } }
I20260619 18:44:44.266675 6709 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3476c9b77cbc45a8ad78fbaa229e6324 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3476c9b77cbc45a8ad78fbaa229e6324. Latest consensus state: current_term: 1 leader_uuid: "3476c9b77cbc45a8ad78fbaa229e6324" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3476c9b77cbc45a8ad78fbaa229e6324" member_type: VOTER } }
I20260619 18:44:44.267755 6709 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3476c9b77cbc45a8ad78fbaa229e6324 [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:44.269181 6708 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3476c9b77cbc45a8ad78fbaa229e6324 [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:44.271538 6717 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 18:44:44.284564 6717 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 18:44:44.286664 6627 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260619 18:44:44.300835 6717 catalog_manager.cc:1347] Generated new cluster ID: f229b98af1cf41ab9520107b41a77910
I20260619 18:44:44.301164 6717 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 18:44:44.333735 6717 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 18:44:44.335603 6717 catalog_manager.cc:1504] Loading token signing keys...
I20260619 18:44:44.351776 6717 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3476c9b77cbc45a8ad78fbaa229e6324: Generated new TSK 0
I20260619 18:44:44.352792 6717 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 18:44:44.417629 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:44.426780 6726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:44.429345 6727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:44.432672 6627 server_base.cc:1034] running on GCE node
W20260619 18:44:44.433411 6729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:44.434257 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:44.434471 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:44.434661 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894684434646 us; error 0 us; skew 500 ppm
I20260619 18:44:44.435235 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:44.441039 6627 webserver.cc:460] Webserver started at http://127.6.120.193:34949/ using document root <none> and password file <none>
I20260619 18:44:44.441613 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:44.441828 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:44.442117 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:44.443346 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.ConnectToClusterNoMasterAddressSpecified.1781894682485826-6627-0/minicluster-data/ts-0-root/instance:
uuid: "b559cd7f08b74fa1a64561a8bd1e6aba"
format_stamp: "Formatted at 2026-06-19 18:44:44 on dist-test-slave-90mn"
I20260619 18:44:44.449396 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260619 18:44:44.454041 6734 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:44.454921 6627 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260619 18:44:44.455204 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.ConnectToClusterNoMasterAddressSpecified.1781894682485826-6627-0/minicluster-data/ts-0-root
uuid: "b559cd7f08b74fa1a64561a8bd1e6aba"
format_stamp: "Formatted at 2026-06-19 18:44:44 on dist-test-slave-90mn"
I20260619 18:44:44.455475 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.ConnectToClusterNoMasterAddressSpecified.1781894682485826-6627-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.ConnectToClusterNoMasterAddressSpecified.1781894682485826-6627-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.ConnectToClusterNoMasterAddressSpecified.1781894682485826-6627-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:44.477830 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:44.479358 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:44.496722 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:44:44.497053 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:44.497395 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:44:44.497615 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:44.610764 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.193:34063
I20260619 18:44:44.610903 6804 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.193:34063 every 8 connection(s)
I20260619 18:44:44.617515 6805 heartbeater.cc:347] Connected to a master server at 127.6.120.254:37573
I20260619 18:44:44.617988 6805 heartbeater.cc:464] Registering TS with master...
I20260619 18:44:44.618935 6805 heartbeater.cc:511] Master 127.6.120.254:37573 requested a full tablet report, sending...
I20260619 18:44:44.621573 6659 ts_manager.cc:194] Registered new tserver with Master: b559cd7f08b74fa1a64561a8bd1e6aba (127.6.120.193:34063)
I20260619 18:44:44.622346 6627 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.006093057s
I20260619 18:44:44.624435 6659 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52848
I20260619 18:44:44.638118 6805 heartbeater.cc:503] Master 127.6.120.254:37573 was elected leader, sending a full tablet report...
I20260619 18:44:44.657722 6659 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52860:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 18:44:44.729398 6770 tablet_service.cc:1467] Processing CreateTablet for tablet 65efe167ba6e4f7eb0e27af55dd99bde (DEFAULT_TABLE table=client-testtb [id=897b101965734d8fb46f7dcc51ca1b45]), partition=RANGE (key) PARTITION VALUES < 9
I20260619 18:44:44.729722 6769 tablet_service.cc:1467] Processing CreateTablet for tablet 9de8bd9df8954978a9f388ba490b7afe (DEFAULT_TABLE table=client-testtb [id=897b101965734d8fb46f7dcc51ca1b45]), partition=RANGE (key) PARTITION 9 <= VALUES
I20260619 18:44:44.731263 6770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65efe167ba6e4f7eb0e27af55dd99bde. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:44.731844 6769 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9de8bd9df8954978a9f388ba490b7afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:44.747972 6815 tablet_bootstrap.cc:492] T 9de8bd9df8954978a9f388ba490b7afe P b559cd7f08b74fa1a64561a8bd1e6aba: Bootstrap starting.
I20260619 18:44:44.752792 6815 tablet_bootstrap.cc:654] T 9de8bd9df8954978a9f388ba490b7afe P b559cd7f08b74fa1a64561a8bd1e6aba: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:44.758631 6815 tablet_bootstrap.cc:492] T 9de8bd9df8954978a9f388ba490b7afe P b559cd7f08b74fa1a64561a8bd1e6aba: No bootstrap required, opened a new log
I20260619 18:44:44.759007 6815 ts_tablet_manager.cc:1397] T 9de8bd9df8954978a9f388ba490b7afe P b559cd7f08b74fa1a64561a8bd1e6aba: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.003s
I20260619 18:44:44.760916 6815 raft_consensus.cc:348] T 9de8bd9df8954978a9f388ba490b7afe P b559cd7f08b74fa1a64561a8bd1e6aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b559cd7f08b74fa1a64561a8bd1e6aba" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34063 } }
I20260619 18:44:44.761384 6815 raft_consensus.cc:374] T 9de8bd9df8954978a9f388ba490b7afe P b559cd7f08b74fa1a64561a8bd1e6aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:44.761622 6815 raft_consensus.cc:729] T 9de8bd9df8954978a9f388ba490b7afe P b559cd7f08b74fa1a64561a8bd1e6aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b559cd7f08b74fa1a64561a8bd1e6aba, State: Initialized, Role: FOLLOWER
I20260619 18:44:44.762151 6815 consensus_queue.cc:260] T 9de8bd9df8954978a9f388ba490b7afe P b559cd7f08b74fa1a64561a8bd1e6aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b559cd7f08b74fa1a64561a8bd1e6aba" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34063 } }
I20260619 18:44:44.762640 6815 raft_consensus.cc:388] T 9de8bd9df8954978a9f388ba490b7afe P b559cd7f08b74fa1a64561a8bd1e6aba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:44.762876 6815 raft_consensus.cc:482] T 9de8bd9df8954978a9f388ba490b7afe P b559cd7f08b74fa1a64561a8bd1e6aba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:44.763125 6815 raft_consensus.cc:3037] T 9de8bd9df8954978a9f388ba490b7afe P b559cd7f08b74fa1a64561a8bd1e6aba [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:44.767587 6815 raft_consensus.cc:504] T 9de8bd9df8954978a9f388ba490b7afe P b559cd7f08b74fa1a64561a8bd1e6aba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b559cd7f08b74fa1a64561a8bd1e6aba" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34063 } }
I20260619 18:44:44.768339 6815 leader_election.cc:302] T 9de8bd9df8954978a9f388ba490b7afe P b559cd7f08b74fa1a64561a8bd1e6aba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b559cd7f08b74fa1a64561a8bd1e6aba; no voters:
I20260619 18:44:44.771018 6817 raft_consensus.cc:2781] T 9de8bd9df8954978a9f388ba490b7afe P b559cd7f08b74fa1a64561a8bd1e6aba [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:44.770605 6815 leader_election.cc:288] T 9de8bd9df8954978a9f388ba490b7afe P b559cd7f08b74fa1a64561a8bd1e6aba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:44.773582 6817 raft_consensus.cc:686] T 9de8bd9df8954978a9f388ba490b7afe P b559cd7f08b74fa1a64561a8bd1e6aba [term 1 LEADER]: Becoming Leader. State: Replica: b559cd7f08b74fa1a64561a8bd1e6aba, State: Running, Role: LEADER
I20260619 18:44:44.774509 6817 consensus_queue.cc:237] T 9de8bd9df8954978a9f388ba490b7afe P b559cd7f08b74fa1a64561a8bd1e6aba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b559cd7f08b74fa1a64561a8bd1e6aba" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34063 } }
I20260619 18:44:44.777878 6815 ts_tablet_manager.cc:1428] T 9de8bd9df8954978a9f388ba490b7afe P b559cd7f08b74fa1a64561a8bd1e6aba: Time spent starting tablet: real 0.019s user 0.013s sys 0.005s
I20260619 18:44:44.778950 6815 tablet_bootstrap.cc:492] T 65efe167ba6e4f7eb0e27af55dd99bde P b559cd7f08b74fa1a64561a8bd1e6aba: Bootstrap starting.
I20260619 18:44:44.785302 6815 tablet_bootstrap.cc:654] T 65efe167ba6e4f7eb0e27af55dd99bde P b559cd7f08b74fa1a64561a8bd1e6aba: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:44.787696 6659 catalog_manager.cc:5495] T 9de8bd9df8954978a9f388ba490b7afe P b559cd7f08b74fa1a64561a8bd1e6aba reported cstate change: term changed from 0 to 1, leader changed from <none> to b559cd7f08b74fa1a64561a8bd1e6aba (127.6.120.193). New cstate: current_term: 1 leader_uuid: "b559cd7f08b74fa1a64561a8bd1e6aba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b559cd7f08b74fa1a64561a8bd1e6aba" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34063 } health_report { overall_health: HEALTHY } } }
I20260619 18:44:44.792524 6815 tablet_bootstrap.cc:492] T 65efe167ba6e4f7eb0e27af55dd99bde P b559cd7f08b74fa1a64561a8bd1e6aba: No bootstrap required, opened a new log
I20260619 18:44:44.792896 6815 ts_tablet_manager.cc:1397] T 65efe167ba6e4f7eb0e27af55dd99bde P b559cd7f08b74fa1a64561a8bd1e6aba: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.005s
I20260619 18:44:44.795046 6815 raft_consensus.cc:348] T 65efe167ba6e4f7eb0e27af55dd99bde P b559cd7f08b74fa1a64561a8bd1e6aba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b559cd7f08b74fa1a64561a8bd1e6aba" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34063 } }
I20260619 18:44:44.795603 6815 raft_consensus.cc:374] T 65efe167ba6e4f7eb0e27af55dd99bde P b559cd7f08b74fa1a64561a8bd1e6aba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:44.795872 6815 raft_consensus.cc:729] T 65efe167ba6e4f7eb0e27af55dd99bde P b559cd7f08b74fa1a64561a8bd1e6aba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b559cd7f08b74fa1a64561a8bd1e6aba, State: Initialized, Role: FOLLOWER
I20260619 18:44:44.796478 6815 consensus_queue.cc:260] T 65efe167ba6e4f7eb0e27af55dd99bde P b559cd7f08b74fa1a64561a8bd1e6aba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b559cd7f08b74fa1a64561a8bd1e6aba" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34063 } }
I20260619 18:44:44.797106 6815 raft_consensus.cc:388] T 65efe167ba6e4f7eb0e27af55dd99bde P b559cd7f08b74fa1a64561a8bd1e6aba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:44.797389 6815 raft_consensus.cc:482] T 65efe167ba6e4f7eb0e27af55dd99bde P b559cd7f08b74fa1a64561a8bd1e6aba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:44.797770 6815 raft_consensus.cc:3037] T 65efe167ba6e4f7eb0e27af55dd99bde P b559cd7f08b74fa1a64561a8bd1e6aba [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:44.802601 6815 raft_consensus.cc:504] T 65efe167ba6e4f7eb0e27af55dd99bde P b559cd7f08b74fa1a64561a8bd1e6aba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b559cd7f08b74fa1a64561a8bd1e6aba" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34063 } }
I20260619 18:44:44.803277 6815 leader_election.cc:302] T 65efe167ba6e4f7eb0e27af55dd99bde P b559cd7f08b74fa1a64561a8bd1e6aba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b559cd7f08b74fa1a64561a8bd1e6aba; no voters:
I20260619 18:44:44.803866 6815 leader_election.cc:288] T 65efe167ba6e4f7eb0e27af55dd99bde P b559cd7f08b74fa1a64561a8bd1e6aba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:44.804023 6817 raft_consensus.cc:2781] T 65efe167ba6e4f7eb0e27af55dd99bde P b559cd7f08b74fa1a64561a8bd1e6aba [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:44.804661 6817 raft_consensus.cc:686] T 65efe167ba6e4f7eb0e27af55dd99bde P b559cd7f08b74fa1a64561a8bd1e6aba [term 1 LEADER]: Becoming Leader. State: Replica: b559cd7f08b74fa1a64561a8bd1e6aba, State: Running, Role: LEADER
I20260619 18:44:44.805344 6817 consensus_queue.cc:237] T 65efe167ba6e4f7eb0e27af55dd99bde P b559cd7f08b74fa1a64561a8bd1e6aba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b559cd7f08b74fa1a64561a8bd1e6aba" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34063 } }
I20260619 18:44:44.806172 6815 ts_tablet_manager.cc:1428] T 65efe167ba6e4f7eb0e27af55dd99bde P b559cd7f08b74fa1a64561a8bd1e6aba: Time spent starting tablet: real 0.013s user 0.010s sys 0.003s
I20260619 18:44:44.815376 6659 catalog_manager.cc:5495] T 65efe167ba6e4f7eb0e27af55dd99bde P b559cd7f08b74fa1a64561a8bd1e6aba reported cstate change: term changed from 0 to 1, leader changed from <none> to b559cd7f08b74fa1a64561a8bd1e6aba (127.6.120.193). New cstate: current_term: 1 leader_uuid: "b559cd7f08b74fa1a64561a8bd1e6aba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b559cd7f08b74fa1a64561a8bd1e6aba" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34063 } health_report { overall_health: HEALTHY } } }
I20260619 18:44:44.846486 6627 tablet_server.cc:178] TabletServer@127.6.120.193:0 shutting down...
I20260619 18:44:44.872875 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:44:44.873765 6627 tablet_replica.cc:330] T 65efe167ba6e4f7eb0e27af55dd99bde P b559cd7f08b74fa1a64561a8bd1e6aba: stopping tablet replica
I20260619 18:44:44.874496 6627 raft_consensus.cc:2229] T 65efe167ba6e4f7eb0e27af55dd99bde P b559cd7f08b74fa1a64561a8bd1e6aba [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:44.875023 6627 raft_consensus.cc:2258] T 65efe167ba6e4f7eb0e27af55dd99bde P b559cd7f08b74fa1a64561a8bd1e6aba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:44.877847 6627 tablet_replica.cc:330] T 9de8bd9df8954978a9f388ba490b7afe P b559cd7f08b74fa1a64561a8bd1e6aba: stopping tablet replica
I20260619 18:44:44.878423 6627 raft_consensus.cc:2229] T 9de8bd9df8954978a9f388ba490b7afe P b559cd7f08b74fa1a64561a8bd1e6aba [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:44.878849 6627 raft_consensus.cc:2258] T 9de8bd9df8954978a9f388ba490b7afe P b559cd7f08b74fa1a64561a8bd1e6aba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:45.021389 6627 tablet_server.cc:194] TabletServer@127.6.120.193:0 shutdown complete.
I20260619 18:44:45.033660 6627 master.cc:537] Master@127.6.120.254:37573 shutting down...
I20260619 18:44:45.057844 6627 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 3476c9b77cbc45a8ad78fbaa229e6324 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:45.058377 6627 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 3476c9b77cbc45a8ad78fbaa229e6324 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:45.058701 6627 tablet_replica.cc:330] T 00000000000000000000000000000000 P 3476c9b77cbc45a8ad78fbaa229e6324: stopping tablet replica
I20260619 18:44:45.077437 6627 master.cc:552] Master@127.6.120.254:37573 shutdown complete.
[ OK ] ClientTest.ConnectToClusterNoMasterAddressSpecified (2446 ms)
[ RUN ] ClientTest.TestScanAtFutureTimestamp
I20260619 18:44:45.097695 6627 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.120.254:44019
I20260619 18:44:45.098663 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:45.103636 6828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:45.105254 6829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:45.107348 6831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:45.107442 6627 server_base.cc:1034] running on GCE node
I20260619 18:44:45.108374 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:45.108564 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:45.108733 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894685108718 us; error 0 us; skew 500 ppm
I20260619 18:44:45.109236 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:45.111750 6627 webserver.cc:460] Webserver started at http://127.6.120.254:40627/ using document root <none> and password file <none>
I20260619 18:44:45.112314 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:45.112515 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:45.112771 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:45.113776 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestScanAtFutureTimestamp.1781894682485826-6627-0/minicluster-data/master-0-root/instance:
uuid: "b26fabafb87f43feb7e615db06495393"
format_stamp: "Formatted at 2026-06-19 18:44:45 on dist-test-slave-90mn"
I20260619 18:44:45.118129 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260619 18:44:45.121397 6836 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:45.122203 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260619 18:44:45.122465 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestScanAtFutureTimestamp.1781894682485826-6627-0/minicluster-data/master-0-root
uuid: "b26fabafb87f43feb7e615db06495393"
format_stamp: "Formatted at 2026-06-19 18:44:45 on dist-test-slave-90mn"
I20260619 18:44:45.122706 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestScanAtFutureTimestamp.1781894682485826-6627-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestScanAtFutureTimestamp.1781894682485826-6627-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestScanAtFutureTimestamp.1781894682485826-6627-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:45.145831 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:45.146970 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:45.203038 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.254:44019
I20260619 18:44:45.203127 6897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.254:44019 every 8 connection(s)
I20260619 18:44:45.207069 6898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:45.215583 6898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b26fabafb87f43feb7e615db06495393: Bootstrap starting.
I20260619 18:44:45.219234 6898 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b26fabafb87f43feb7e615db06495393: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:45.223016 6898 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b26fabafb87f43feb7e615db06495393: No bootstrap required, opened a new log
I20260619 18:44:45.225063 6898 raft_consensus.cc:348] T 00000000000000000000000000000000 P b26fabafb87f43feb7e615db06495393 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b26fabafb87f43feb7e615db06495393" member_type: VOTER }
I20260619 18:44:45.225448 6898 raft_consensus.cc:374] T 00000000000000000000000000000000 P b26fabafb87f43feb7e615db06495393 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:45.225706 6898 raft_consensus.cc:729] T 00000000000000000000000000000000 P b26fabafb87f43feb7e615db06495393 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b26fabafb87f43feb7e615db06495393, State: Initialized, Role: FOLLOWER
I20260619 18:44:45.226284 6898 consensus_queue.cc:260] T 00000000000000000000000000000000 P b26fabafb87f43feb7e615db06495393 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b26fabafb87f43feb7e615db06495393" member_type: VOTER }
I20260619 18:44:45.226719 6898 raft_consensus.cc:388] T 00000000000000000000000000000000 P b26fabafb87f43feb7e615db06495393 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:45.226953 6898 raft_consensus.cc:482] T 00000000000000000000000000000000 P b26fabafb87f43feb7e615db06495393 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:45.227210 6898 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b26fabafb87f43feb7e615db06495393 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:45.230845 6898 raft_consensus.cc:504] T 00000000000000000000000000000000 P b26fabafb87f43feb7e615db06495393 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b26fabafb87f43feb7e615db06495393" member_type: VOTER }
I20260619 18:44:45.231343 6898 leader_election.cc:302] T 00000000000000000000000000000000 P b26fabafb87f43feb7e615db06495393 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b26fabafb87f43feb7e615db06495393; no voters:
I20260619 18:44:45.232589 6898 leader_election.cc:288] T 00000000000000000000000000000000 P b26fabafb87f43feb7e615db06495393 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:45.232888 6901 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b26fabafb87f43feb7e615db06495393 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:45.234642 6901 raft_consensus.cc:686] T 00000000000000000000000000000000 P b26fabafb87f43feb7e615db06495393 [term 1 LEADER]: Becoming Leader. State: Replica: b26fabafb87f43feb7e615db06495393, State: Running, Role: LEADER
I20260619 18:44:45.235347 6901 consensus_queue.cc:237] T 00000000000000000000000000000000 P b26fabafb87f43feb7e615db06495393 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b26fabafb87f43feb7e615db06495393" member_type: VOTER }
I20260619 18:44:45.236006 6898 sys_catalog.cc:564] T 00000000000000000000000000000000 P b26fabafb87f43feb7e615db06495393 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 18:44:45.238276 6902 sys_catalog.cc:455] T 00000000000000000000000000000000 P b26fabafb87f43feb7e615db06495393 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b26fabafb87f43feb7e615db06495393" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b26fabafb87f43feb7e615db06495393" member_type: VOTER } }
I20260619 18:44:45.238833 6902 sys_catalog.cc:458] T 00000000000000000000000000000000 P b26fabafb87f43feb7e615db06495393 [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:45.246971 6903 sys_catalog.cc:455] T 00000000000000000000000000000000 P b26fabafb87f43feb7e615db06495393 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b26fabafb87f43feb7e615db06495393. Latest consensus state: current_term: 1 leader_uuid: "b26fabafb87f43feb7e615db06495393" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b26fabafb87f43feb7e615db06495393" member_type: VOTER } }
I20260619 18:44:45.247742 6903 sys_catalog.cc:458] T 00000000000000000000000000000000 P b26fabafb87f43feb7e615db06495393 [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:45.251543 6907 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 18:44:45.265637 6907 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 18:44:45.278085 6627 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260619 18:44:45.279213 6907 catalog_manager.cc:1347] Generated new cluster ID: c95b42d68d54485dbbb3a308e9334db8
I20260619 18:44:45.279496 6907 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 18:44:45.325090 6907 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 18:44:45.326574 6907 catalog_manager.cc:1504] Loading token signing keys...
I20260619 18:44:45.348632 6907 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b26fabafb87f43feb7e615db06495393: Generated new TSK 0
I20260619 18:44:45.349310 6907 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 18:44:45.408466 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:45.414795 6920 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:45.414947 6921 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:45.417892 6923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:45.418565 6627 server_base.cc:1034] running on GCE node
I20260619 18:44:45.419334 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:45.419556 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:45.419711 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894685419697 us; error 0 us; skew 500 ppm
I20260619 18:44:45.420253 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:45.423045 6627 webserver.cc:460] Webserver started at http://127.6.120.193:45583/ using document root <none> and password file <none>
I20260619 18:44:45.423483 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:45.423676 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:45.423951 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:45.425043 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestScanAtFutureTimestamp.1781894682485826-6627-0/minicluster-data/ts-0-root/instance:
uuid: "a9c651647ab64528a69355e50173cef5"
format_stamp: "Formatted at 2026-06-19 18:44:45 on dist-test-slave-90mn"
I20260619 18:44:45.429389 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260619 18:44:45.432839 6928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:45.433679 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.002s
I20260619 18:44:45.434021 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestScanAtFutureTimestamp.1781894682485826-6627-0/minicluster-data/ts-0-root
uuid: "a9c651647ab64528a69355e50173cef5"
format_stamp: "Formatted at 2026-06-19 18:44:45 on dist-test-slave-90mn"
I20260619 18:44:45.434382 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestScanAtFutureTimestamp.1781894682485826-6627-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestScanAtFutureTimestamp.1781894682485826-6627-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestScanAtFutureTimestamp.1781894682485826-6627-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:45.465725 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:45.467029 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:45.485889 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:44:45.486183 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:45.486464 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:44:45.486665 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:45.558656 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.193:45307
I20260619 18:44:45.558697 6998 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.193:45307 every 8 connection(s)
I20260619 18:44:45.563807 6999 heartbeater.cc:347] Connected to a master server at 127.6.120.254:44019
I20260619 18:44:45.564188 6999 heartbeater.cc:464] Registering TS with master...
I20260619 18:44:45.564845 6999 heartbeater.cc:511] Master 127.6.120.254:44019 requested a full tablet report, sending...
I20260619 18:44:45.566666 6853 ts_manager.cc:194] Registered new tserver with Master: a9c651647ab64528a69355e50173cef5 (127.6.120.193:45307)
I20260619 18:44:45.567355 6627 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.00483028s
I20260619 18:44:45.569129 6853 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34894
I20260619 18:44:45.582813 6999 heartbeater.cc:503] Master 127.6.120.254:44019 was elected leader, sending a full tablet report...
I20260619 18:44:45.592327 6853 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34926:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 18:44:45.629266 6960 tablet_service.cc:1467] Processing CreateTablet for tablet 25bec6ff8a044aa3b1eddc836062972e (DEFAULT_TABLE table=client-testtb [id=93fa2d3e0b6244ca839e31346523ee05]), partition=RANGE (key) PARTITION VALUES < 9
I20260619 18:44:45.629788 6959 tablet_service.cc:1467] Processing CreateTablet for tablet e7076d194d4c420cbc391bfe2ce9f4aa (DEFAULT_TABLE table=client-testtb [id=93fa2d3e0b6244ca839e31346523ee05]), partition=RANGE (key) PARTITION 9 <= VALUES
I20260619 18:44:45.630239 6960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25bec6ff8a044aa3b1eddc836062972e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:45.630967 6959 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7076d194d4c420cbc391bfe2ce9f4aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:45.644896 7009 tablet_bootstrap.cc:492] T 25bec6ff8a044aa3b1eddc836062972e P a9c651647ab64528a69355e50173cef5: Bootstrap starting.
I20260619 18:44:45.649286 7009 tablet_bootstrap.cc:654] T 25bec6ff8a044aa3b1eddc836062972e P a9c651647ab64528a69355e50173cef5: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:45.653901 7009 tablet_bootstrap.cc:492] T 25bec6ff8a044aa3b1eddc836062972e P a9c651647ab64528a69355e50173cef5: No bootstrap required, opened a new log
I20260619 18:44:45.654512 7009 ts_tablet_manager.cc:1397] T 25bec6ff8a044aa3b1eddc836062972e P a9c651647ab64528a69355e50173cef5: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260619 18:44:45.656636 7009 raft_consensus.cc:348] T 25bec6ff8a044aa3b1eddc836062972e P a9c651647ab64528a69355e50173cef5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9c651647ab64528a69355e50173cef5" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45307 } }
I20260619 18:44:45.657095 7009 raft_consensus.cc:374] T 25bec6ff8a044aa3b1eddc836062972e P a9c651647ab64528a69355e50173cef5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:45.657326 7009 raft_consensus.cc:729] T 25bec6ff8a044aa3b1eddc836062972e P a9c651647ab64528a69355e50173cef5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9c651647ab64528a69355e50173cef5, State: Initialized, Role: FOLLOWER
I20260619 18:44:45.657852 7009 consensus_queue.cc:260] T 25bec6ff8a044aa3b1eddc836062972e P a9c651647ab64528a69355e50173cef5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9c651647ab64528a69355e50173cef5" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45307 } }
I20260619 18:44:45.658320 7009 raft_consensus.cc:388] T 25bec6ff8a044aa3b1eddc836062972e P a9c651647ab64528a69355e50173cef5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:45.658550 7009 raft_consensus.cc:482] T 25bec6ff8a044aa3b1eddc836062972e P a9c651647ab64528a69355e50173cef5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:45.658808 7009 raft_consensus.cc:3037] T 25bec6ff8a044aa3b1eddc836062972e P a9c651647ab64528a69355e50173cef5 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:45.663365 7009 raft_consensus.cc:504] T 25bec6ff8a044aa3b1eddc836062972e P a9c651647ab64528a69355e50173cef5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9c651647ab64528a69355e50173cef5" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45307 } }
I20260619 18:44:45.664070 7009 leader_election.cc:302] T 25bec6ff8a044aa3b1eddc836062972e P a9c651647ab64528a69355e50173cef5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a9c651647ab64528a69355e50173cef5; no voters:
I20260619 18:44:45.665551 7009 leader_election.cc:288] T 25bec6ff8a044aa3b1eddc836062972e P a9c651647ab64528a69355e50173cef5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:45.666167 7011 raft_consensus.cc:2781] T 25bec6ff8a044aa3b1eddc836062972e P a9c651647ab64528a69355e50173cef5 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:45.668290 7009 ts_tablet_manager.cc:1428] T 25bec6ff8a044aa3b1eddc836062972e P a9c651647ab64528a69355e50173cef5: Time spent starting tablet: real 0.013s user 0.002s sys 0.011s
I20260619 18:44:45.669090 7009 tablet_bootstrap.cc:492] T e7076d194d4c420cbc391bfe2ce9f4aa P a9c651647ab64528a69355e50173cef5: Bootstrap starting.
I20260619 18:44:45.669950 7011 raft_consensus.cc:686] T 25bec6ff8a044aa3b1eddc836062972e P a9c651647ab64528a69355e50173cef5 [term 1 LEADER]: Becoming Leader. State: Replica: a9c651647ab64528a69355e50173cef5, State: Running, Role: LEADER
I20260619 18:44:45.670679 7011 consensus_queue.cc:237] T 25bec6ff8a044aa3b1eddc836062972e P a9c651647ab64528a69355e50173cef5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9c651647ab64528a69355e50173cef5" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45307 } }
I20260619 18:44:45.673830 7009 tablet_bootstrap.cc:654] T e7076d194d4c420cbc391bfe2ce9f4aa P a9c651647ab64528a69355e50173cef5: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:45.678768 6852 catalog_manager.cc:5495] T 25bec6ff8a044aa3b1eddc836062972e P a9c651647ab64528a69355e50173cef5 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9c651647ab64528a69355e50173cef5 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "a9c651647ab64528a69355e50173cef5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9c651647ab64528a69355e50173cef5" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45307 } health_report { overall_health: HEALTHY } } }
I20260619 18:44:45.687115 7009 tablet_bootstrap.cc:492] T e7076d194d4c420cbc391bfe2ce9f4aa P a9c651647ab64528a69355e50173cef5: No bootstrap required, opened a new log
I20260619 18:44:45.687526 7009 ts_tablet_manager.cc:1397] T e7076d194d4c420cbc391bfe2ce9f4aa P a9c651647ab64528a69355e50173cef5: Time spent bootstrapping tablet: real 0.019s user 0.012s sys 0.003s
I20260619 18:44:45.689615 7009 raft_consensus.cc:348] T e7076d194d4c420cbc391bfe2ce9f4aa P a9c651647ab64528a69355e50173cef5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9c651647ab64528a69355e50173cef5" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45307 } }
I20260619 18:44:45.690060 7009 raft_consensus.cc:374] T e7076d194d4c420cbc391bfe2ce9f4aa P a9c651647ab64528a69355e50173cef5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:45.690311 7009 raft_consensus.cc:729] T e7076d194d4c420cbc391bfe2ce9f4aa P a9c651647ab64528a69355e50173cef5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9c651647ab64528a69355e50173cef5, State: Initialized, Role: FOLLOWER
I20260619 18:44:45.690863 7009 consensus_queue.cc:260] T e7076d194d4c420cbc391bfe2ce9f4aa P a9c651647ab64528a69355e50173cef5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9c651647ab64528a69355e50173cef5" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45307 } }
I20260619 18:44:45.691335 7009 raft_consensus.cc:388] T e7076d194d4c420cbc391bfe2ce9f4aa P a9c651647ab64528a69355e50173cef5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:45.691562 7009 raft_consensus.cc:482] T e7076d194d4c420cbc391bfe2ce9f4aa P a9c651647ab64528a69355e50173cef5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:45.691833 7009 raft_consensus.cc:3037] T e7076d194d4c420cbc391bfe2ce9f4aa P a9c651647ab64528a69355e50173cef5 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:45.696753 7009 raft_consensus.cc:504] T e7076d194d4c420cbc391bfe2ce9f4aa P a9c651647ab64528a69355e50173cef5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9c651647ab64528a69355e50173cef5" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45307 } }
I20260619 18:44:45.697384 7009 leader_election.cc:302] T e7076d194d4c420cbc391bfe2ce9f4aa P a9c651647ab64528a69355e50173cef5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a9c651647ab64528a69355e50173cef5; no voters:
I20260619 18:44:45.697883 7009 leader_election.cc:288] T e7076d194d4c420cbc391bfe2ce9f4aa P a9c651647ab64528a69355e50173cef5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:45.698091 7011 raft_consensus.cc:2781] T e7076d194d4c420cbc391bfe2ce9f4aa P a9c651647ab64528a69355e50173cef5 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:45.698740 7011 raft_consensus.cc:686] T e7076d194d4c420cbc391bfe2ce9f4aa P a9c651647ab64528a69355e50173cef5 [term 1 LEADER]: Becoming Leader. State: Replica: a9c651647ab64528a69355e50173cef5, State: Running, Role: LEADER
I20260619 18:44:45.699486 7009 ts_tablet_manager.cc:1428] T e7076d194d4c420cbc391bfe2ce9f4aa P a9c651647ab64528a69355e50173cef5: Time spent starting tablet: real 0.012s user 0.006s sys 0.003s
I20260619 18:44:45.699395 7011 consensus_queue.cc:237] T e7076d194d4c420cbc391bfe2ce9f4aa P a9c651647ab64528a69355e50173cef5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9c651647ab64528a69355e50173cef5" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45307 } }
I20260619 18:44:45.705896 6852 catalog_manager.cc:5495] T e7076d194d4c420cbc391bfe2ce9f4aa P a9c651647ab64528a69355e50173cef5 reported cstate change: term changed from 0 to 1, leader changed from <none> to a9c651647ab64528a69355e50173cef5 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "a9c651647ab64528a69355e50173cef5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9c651647ab64528a69355e50173cef5" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45307 } health_report { overall_health: HEALTHY } } }
W20260619 18:44:45.764886 6950 tablet_service.cc:2970] error setting up scanner b59b98a2544341908a220e6f06f2bfa9 with request: Invalid argument: cannot verify timestamp: Snapshot time P: 1781894745736868 usec, L: 0 in the future. Max allowed timestamp is P: 1781894695764723 usec, L: 0: new_scan_request { tablet_id: "25bec6ff8a044aa3b1eddc836062972e" projected_columns { name: "key" type: INT32 is_key: true is_nullable: false immutable: false } projected_columns { name: "int_val" type: INT32 is_key: false is_nullable: false immutable: false } projected_columns { name: "string_val" type: STRING is_key: false is_nullable: true immutable: false } projected_columns { name: "non_null_with_default" type: INT32 is_key: false is_nullable: false read_default_value: "90\000\000" write_default_value: "90\000\000" immutable: false } read_mode: READ_AT_SNAPSHOT snap_timestamp: 7298640878538211328 propagated_timestamp: 7298640632875548672 cache_blocks: true order_mode: UNORDERED row_format_flags: 0 authz_token { token_data: "\010\311\236\326\321\006\"3\n\005slave\022*\n 93fa2d3e0b6244ca839e31346523ee05\020\001\030\001 \001(\001" signature: "\220*I\271Y\372\252\017\376\264\304@\014\235c\312\307\367\334\325\\\245\202\214\341(E2\351\3713\307\006\021g\032\323u\235\t\360\344j\313\213D\027\377\323n\215\245)4\271\275\217_\242c\023\374\254\227""\220*I\271Y\372\252\017\376\264\304@\014\235c\312\307\367\334\325\\\245\202\214\341(E2\351\3713\307\006\021g\032\323u\235\t\360\344j\313\213D\027\377\323n\215\245)4\271\275\217_\242c\023\374\254\227" signing_key_seq_num: 0 } } call_seq_id: 0 query_id: "2bb37e672e044d53bcc67dfb351802d8"
I20260619 18:44:45.769585 6627 tablet_server.cc:178] TabletServer@127.6.120.193:0 shutting down...
I20260619 18:44:45.795921 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:44:45.796700 6627 tablet_replica.cc:330] T e7076d194d4c420cbc391bfe2ce9f4aa P a9c651647ab64528a69355e50173cef5: stopping tablet replica
I20260619 18:44:45.797370 6627 raft_consensus.cc:2229] T e7076d194d4c420cbc391bfe2ce9f4aa P a9c651647ab64528a69355e50173cef5 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:45.797770 6627 raft_consensus.cc:2258] T e7076d194d4c420cbc391bfe2ce9f4aa P a9c651647ab64528a69355e50173cef5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:45.799854 6627 tablet_replica.cc:330] T 25bec6ff8a044aa3b1eddc836062972e P a9c651647ab64528a69355e50173cef5: stopping tablet replica
I20260619 18:44:45.800326 6627 raft_consensus.cc:2229] T 25bec6ff8a044aa3b1eddc836062972e P a9c651647ab64528a69355e50173cef5 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:45.800679 6627 raft_consensus.cc:2258] T 25bec6ff8a044aa3b1eddc836062972e P a9c651647ab64528a69355e50173cef5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:45.820399 6627 tablet_server.cc:194] TabletServer@127.6.120.193:0 shutdown complete.
I20260619 18:44:45.831655 6627 master.cc:537] Master@127.6.120.254:44019 shutting down...
I20260619 18:44:45.938674 6627 raft_consensus.cc:2229] T 00000000000000000000000000000000 P b26fabafb87f43feb7e615db06495393 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:45.939177 6627 raft_consensus.cc:2258] T 00000000000000000000000000000000 P b26fabafb87f43feb7e615db06495393 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:45.939471 6627 tablet_replica.cc:330] T 00000000000000000000000000000000 P b26fabafb87f43feb7e615db06495393: stopping tablet replica
I20260619 18:44:45.950398 6627 master.cc:552] Master@127.6.120.254:44019 shutdown complete.
[ OK ] ClientTest.TestScanAtFutureTimestamp (880 ms)
[ RUN ] ClientTest.TestInvalidPredicates
I20260619 18:44:45.980754 6627 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.120.254:35599
I20260619 18:44:45.982095 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:45.987655 7019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:45.987720 7020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:45.995517 7022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:45.996783 6627 server_base.cc:1034] running on GCE node
I20260619 18:44:45.997839 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:45.998129 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:45.998353 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894685998336 us; error 0 us; skew 500 ppm
I20260619 18:44:45.999090 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:46.006299 6627 webserver.cc:460] Webserver started at http://127.6.120.254:35577/ using document root <none> and password file <none>
I20260619 18:44:46.006999 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:46.007287 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:46.007647 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:46.009337 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestInvalidPredicates.1781894682485826-6627-0/minicluster-data/master-0-root/instance:
uuid: "02e3c8034d0d4dbd96751e3b2e9f92cb"
format_stamp: "Formatted at 2026-06-19 18:44:46 on dist-test-slave-90mn"
I20260619 18:44:46.016050 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260619 18:44:46.020990 7027 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:46.021979 6627 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 18:44:46.022336 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestInvalidPredicates.1781894682485826-6627-0/minicluster-data/master-0-root
uuid: "02e3c8034d0d4dbd96751e3b2e9f92cb"
format_stamp: "Formatted at 2026-06-19 18:44:46 on dist-test-slave-90mn"
I20260619 18:44:46.022712 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestInvalidPredicates.1781894682485826-6627-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestInvalidPredicates.1781894682485826-6627-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestInvalidPredicates.1781894682485826-6627-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:46.048605 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:46.049615 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:46.103544 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.254:35599
I20260619 18:44:46.103693 7088 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.254:35599 every 8 connection(s)
I20260619 18:44:46.107758 7089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:46.116873 7089 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02e3c8034d0d4dbd96751e3b2e9f92cb: Bootstrap starting.
I20260619 18:44:46.120606 7089 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 02e3c8034d0d4dbd96751e3b2e9f92cb: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:46.124680 7089 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02e3c8034d0d4dbd96751e3b2e9f92cb: No bootstrap required, opened a new log
I20260619 18:44:46.126427 7089 raft_consensus.cc:348] T 00000000000000000000000000000000 P 02e3c8034d0d4dbd96751e3b2e9f92cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02e3c8034d0d4dbd96751e3b2e9f92cb" member_type: VOTER }
I20260619 18:44:46.126822 7089 raft_consensus.cc:374] T 00000000000000000000000000000000 P 02e3c8034d0d4dbd96751e3b2e9f92cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:46.127045 7089 raft_consensus.cc:729] T 00000000000000000000000000000000 P 02e3c8034d0d4dbd96751e3b2e9f92cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02e3c8034d0d4dbd96751e3b2e9f92cb, State: Initialized, Role: FOLLOWER
I20260619 18:44:46.127543 7089 consensus_queue.cc:260] T 00000000000000000000000000000000 P 02e3c8034d0d4dbd96751e3b2e9f92cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02e3c8034d0d4dbd96751e3b2e9f92cb" member_type: VOTER }
I20260619 18:44:46.127972 7089 raft_consensus.cc:388] T 00000000000000000000000000000000 P 02e3c8034d0d4dbd96751e3b2e9f92cb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:46.128259 7089 raft_consensus.cc:482] T 00000000000000000000000000000000 P 02e3c8034d0d4dbd96751e3b2e9f92cb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:46.128520 7089 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 02e3c8034d0d4dbd96751e3b2e9f92cb [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:46.132311 7089 raft_consensus.cc:504] T 00000000000000000000000000000000 P 02e3c8034d0d4dbd96751e3b2e9f92cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02e3c8034d0d4dbd96751e3b2e9f92cb" member_type: VOTER }
I20260619 18:44:46.132802 7089 leader_election.cc:302] T 00000000000000000000000000000000 P 02e3c8034d0d4dbd96751e3b2e9f92cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 02e3c8034d0d4dbd96751e3b2e9f92cb; no voters:
I20260619 18:44:46.134109 7089 leader_election.cc:288] T 00000000000000000000000000000000 P 02e3c8034d0d4dbd96751e3b2e9f92cb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:46.134387 7092 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 02e3c8034d0d4dbd96751e3b2e9f92cb [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:46.136023 7092 raft_consensus.cc:686] T 00000000000000000000000000000000 P 02e3c8034d0d4dbd96751e3b2e9f92cb [term 1 LEADER]: Becoming Leader. State: Replica: 02e3c8034d0d4dbd96751e3b2e9f92cb, State: Running, Role: LEADER
I20260619 18:44:46.136695 7092 consensus_queue.cc:237] T 00000000000000000000000000000000 P 02e3c8034d0d4dbd96751e3b2e9f92cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02e3c8034d0d4dbd96751e3b2e9f92cb" member_type: VOTER }
I20260619 18:44:46.137431 7089 sys_catalog.cc:564] T 00000000000000000000000000000000 P 02e3c8034d0d4dbd96751e3b2e9f92cb [sys.catalog]: configured and running, proceeding with master startup.
I20260619 18:44:46.139328 7093 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02e3c8034d0d4dbd96751e3b2e9f92cb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "02e3c8034d0d4dbd96751e3b2e9f92cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02e3c8034d0d4dbd96751e3b2e9f92cb" member_type: VOTER } }
I20260619 18:44:46.139828 7093 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02e3c8034d0d4dbd96751e3b2e9f92cb [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:46.148473 7097 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 18:44:46.148392 7094 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02e3c8034d0d4dbd96751e3b2e9f92cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 02e3c8034d0d4dbd96751e3b2e9f92cb. Latest consensus state: current_term: 1 leader_uuid: "02e3c8034d0d4dbd96751e3b2e9f92cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02e3c8034d0d4dbd96751e3b2e9f92cb" member_type: VOTER } }
I20260619 18:44:46.149039 7094 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02e3c8034d0d4dbd96751e3b2e9f92cb [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:46.156718 7097 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 18:44:46.157971 6627 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260619 18:44:46.165709 7097 catalog_manager.cc:1347] Generated new cluster ID: 76ace8119e2a42ba8c8a1fb11cb20417
I20260619 18:44:46.165989 7097 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 18:44:46.184015 7097 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 18:44:46.185691 7097 catalog_manager.cc:1504] Loading token signing keys...
I20260619 18:44:46.197784 7097 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 02e3c8034d0d4dbd96751e3b2e9f92cb: Generated new TSK 0
I20260619 18:44:46.198415 7097 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 18:44:46.224967 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:46.231787 7111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:46.232489 7112 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:46.235071 7114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:46.235350 6627 server_base.cc:1034] running on GCE node
I20260619 18:44:46.236490 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:46.236738 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:46.236917 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894686236905 us; error 0 us; skew 500 ppm
I20260619 18:44:46.237550 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:46.240427 6627 webserver.cc:460] Webserver started at http://127.6.120.193:46265/ using document root <none> and password file <none>
I20260619 18:44:46.240967 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:46.241199 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:46.241493 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:46.242838 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestInvalidPredicates.1781894682485826-6627-0/minicluster-data/ts-0-root/instance:
uuid: "805c89a90ba94c04ba1bf0497010a9d5"
format_stamp: "Formatted at 2026-06-19 18:44:46 on dist-test-slave-90mn"
I20260619 18:44:46.248495 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.006s
I20260619 18:44:46.252652 7119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:46.253464 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.002s
I20260619 18:44:46.253772 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestInvalidPredicates.1781894682485826-6627-0/minicluster-data/ts-0-root
uuid: "805c89a90ba94c04ba1bf0497010a9d5"
format_stamp: "Formatted at 2026-06-19 18:44:46 on dist-test-slave-90mn"
I20260619 18:44:46.254127 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestInvalidPredicates.1781894682485826-6627-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestInvalidPredicates.1781894682485826-6627-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestInvalidPredicates.1781894682485826-6627-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:46.297377 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:46.298404 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:46.315335 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:44:46.315681 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:46.316030 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:44:46.316269 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20260619 18:44:46.387698 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.193:39605
I20260619 18:44:46.387842 7189 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.193:39605 every 8 connection(s)
I20260619 18:44:46.392755 7190 heartbeater.cc:347] Connected to a master server at 127.6.120.254:35599
I20260619 18:44:46.393177 7190 heartbeater.cc:464] Registering TS with master...
I20260619 18:44:46.394086 7190 heartbeater.cc:511] Master 127.6.120.254:35599 requested a full tablet report, sending...
I20260619 18:44:46.396184 7044 ts_manager.cc:194] Registered new tserver with Master: 805c89a90ba94c04ba1bf0497010a9d5 (127.6.120.193:39605)
I20260619 18:44:46.397171 6627 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.006007938s
I20260619 18:44:46.398777 7044 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52452
I20260619 18:44:46.412432 7190 heartbeater.cc:503] Master 127.6.120.254:35599 was elected leader, sending a full tablet report...
I20260619 18:44:46.423565 7044 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52468:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 18:44:46.462212 7155 tablet_service.cc:1467] Processing CreateTablet for tablet 3429dbef69ac4d90ae4c93ac9e03b745 (DEFAULT_TABLE table=client-testtb [id=35f6e7b3815b4155bd111db71e8920fa]), partition=RANGE (key) PARTITION VALUES < 9
I20260619 18:44:46.462427 7154 tablet_service.cc:1467] Processing CreateTablet for tablet eb046a5e3db445f49b5a41b48e163d70 (DEFAULT_TABLE table=client-testtb [id=35f6e7b3815b4155bd111db71e8920fa]), partition=RANGE (key) PARTITION 9 <= VALUES
I20260619 18:44:46.463739 7155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3429dbef69ac4d90ae4c93ac9e03b745. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:46.464346 7154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb046a5e3db445f49b5a41b48e163d70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:46.479481 7200 tablet_bootstrap.cc:492] T 3429dbef69ac4d90ae4c93ac9e03b745 P 805c89a90ba94c04ba1bf0497010a9d5: Bootstrap starting.
I20260619 18:44:46.483568 7200 tablet_bootstrap.cc:654] T 3429dbef69ac4d90ae4c93ac9e03b745 P 805c89a90ba94c04ba1bf0497010a9d5: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:46.488029 7200 tablet_bootstrap.cc:492] T 3429dbef69ac4d90ae4c93ac9e03b745 P 805c89a90ba94c04ba1bf0497010a9d5: No bootstrap required, opened a new log
I20260619 18:44:46.488483 7200 ts_tablet_manager.cc:1397] T 3429dbef69ac4d90ae4c93ac9e03b745 P 805c89a90ba94c04ba1bf0497010a9d5: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.005s
I20260619 18:44:46.490209 7200 raft_consensus.cc:348] T 3429dbef69ac4d90ae4c93ac9e03b745 P 805c89a90ba94c04ba1bf0497010a9d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "805c89a90ba94c04ba1bf0497010a9d5" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 39605 } }
I20260619 18:44:46.490598 7200 raft_consensus.cc:374] T 3429dbef69ac4d90ae4c93ac9e03b745 P 805c89a90ba94c04ba1bf0497010a9d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:46.490865 7200 raft_consensus.cc:729] T 3429dbef69ac4d90ae4c93ac9e03b745 P 805c89a90ba94c04ba1bf0497010a9d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 805c89a90ba94c04ba1bf0497010a9d5, State: Initialized, Role: FOLLOWER
I20260619 18:44:46.491350 7200 consensus_queue.cc:260] T 3429dbef69ac4d90ae4c93ac9e03b745 P 805c89a90ba94c04ba1bf0497010a9d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "805c89a90ba94c04ba1bf0497010a9d5" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 39605 } }
I20260619 18:44:46.491796 7200 raft_consensus.cc:388] T 3429dbef69ac4d90ae4c93ac9e03b745 P 805c89a90ba94c04ba1bf0497010a9d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:46.492025 7200 raft_consensus.cc:482] T 3429dbef69ac4d90ae4c93ac9e03b745 P 805c89a90ba94c04ba1bf0497010a9d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:46.492352 7200 raft_consensus.cc:3037] T 3429dbef69ac4d90ae4c93ac9e03b745 P 805c89a90ba94c04ba1bf0497010a9d5 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:46.497375 7200 raft_consensus.cc:504] T 3429dbef69ac4d90ae4c93ac9e03b745 P 805c89a90ba94c04ba1bf0497010a9d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "805c89a90ba94c04ba1bf0497010a9d5" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 39605 } }
I20260619 18:44:46.498028 7200 leader_election.cc:302] T 3429dbef69ac4d90ae4c93ac9e03b745 P 805c89a90ba94c04ba1bf0497010a9d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 805c89a90ba94c04ba1bf0497010a9d5; no voters:
I20260619 18:44:46.499763 7200 leader_election.cc:288] T 3429dbef69ac4d90ae4c93ac9e03b745 P 805c89a90ba94c04ba1bf0497010a9d5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:46.500141 7202 raft_consensus.cc:2781] T 3429dbef69ac4d90ae4c93ac9e03b745 P 805c89a90ba94c04ba1bf0497010a9d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:46.501704 7202 raft_consensus.cc:686] T 3429dbef69ac4d90ae4c93ac9e03b745 P 805c89a90ba94c04ba1bf0497010a9d5 [term 1 LEADER]: Becoming Leader. State: Replica: 805c89a90ba94c04ba1bf0497010a9d5, State: Running, Role: LEADER
I20260619 18:44:46.502626 7202 consensus_queue.cc:237] T 3429dbef69ac4d90ae4c93ac9e03b745 P 805c89a90ba94c04ba1bf0497010a9d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "805c89a90ba94c04ba1bf0497010a9d5" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 39605 } }
I20260619 18:44:46.510542 7043 catalog_manager.cc:5495] T 3429dbef69ac4d90ae4c93ac9e03b745 P 805c89a90ba94c04ba1bf0497010a9d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 805c89a90ba94c04ba1bf0497010a9d5 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "805c89a90ba94c04ba1bf0497010a9d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "805c89a90ba94c04ba1bf0497010a9d5" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 39605 } health_report { overall_health: HEALTHY } } }
I20260619 18:44:46.525729 7200 ts_tablet_manager.cc:1428] T 3429dbef69ac4d90ae4c93ac9e03b745 P 805c89a90ba94c04ba1bf0497010a9d5: Time spent starting tablet: real 0.037s user 0.017s sys 0.019s
I20260619 18:44:46.526516 7200 tablet_bootstrap.cc:492] T eb046a5e3db445f49b5a41b48e163d70 P 805c89a90ba94c04ba1bf0497010a9d5: Bootstrap starting.
I20260619 18:44:46.530881 7200 tablet_bootstrap.cc:654] T eb046a5e3db445f49b5a41b48e163d70 P 805c89a90ba94c04ba1bf0497010a9d5: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:46.535235 7200 tablet_bootstrap.cc:492] T eb046a5e3db445f49b5a41b48e163d70 P 805c89a90ba94c04ba1bf0497010a9d5: No bootstrap required, opened a new log
I20260619 18:44:46.535671 7200 ts_tablet_manager.cc:1397] T eb046a5e3db445f49b5a41b48e163d70 P 805c89a90ba94c04ba1bf0497010a9d5: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260619 18:44:46.537899 7200 raft_consensus.cc:348] T eb046a5e3db445f49b5a41b48e163d70 P 805c89a90ba94c04ba1bf0497010a9d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "805c89a90ba94c04ba1bf0497010a9d5" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 39605 } }
I20260619 18:44:46.538425 7200 raft_consensus.cc:374] T eb046a5e3db445f49b5a41b48e163d70 P 805c89a90ba94c04ba1bf0497010a9d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:46.538741 7200 raft_consensus.cc:729] T eb046a5e3db445f49b5a41b48e163d70 P 805c89a90ba94c04ba1bf0497010a9d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 805c89a90ba94c04ba1bf0497010a9d5, State: Initialized, Role: FOLLOWER
I20260619 18:44:46.539463 7200 consensus_queue.cc:260] T eb046a5e3db445f49b5a41b48e163d70 P 805c89a90ba94c04ba1bf0497010a9d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "805c89a90ba94c04ba1bf0497010a9d5" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 39605 } }
I20260619 18:44:46.540066 7200 raft_consensus.cc:388] T eb046a5e3db445f49b5a41b48e163d70 P 805c89a90ba94c04ba1bf0497010a9d5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:46.540392 7200 raft_consensus.cc:482] T eb046a5e3db445f49b5a41b48e163d70 P 805c89a90ba94c04ba1bf0497010a9d5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:46.540704 7200 raft_consensus.cc:3037] T eb046a5e3db445f49b5a41b48e163d70 P 805c89a90ba94c04ba1bf0497010a9d5 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:46.545399 7200 raft_consensus.cc:504] T eb046a5e3db445f49b5a41b48e163d70 P 805c89a90ba94c04ba1bf0497010a9d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "805c89a90ba94c04ba1bf0497010a9d5" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 39605 } }
I20260619 18:44:46.545872 7200 leader_election.cc:302] T eb046a5e3db445f49b5a41b48e163d70 P 805c89a90ba94c04ba1bf0497010a9d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 805c89a90ba94c04ba1bf0497010a9d5; no voters:
I20260619 18:44:46.546253 7200 leader_election.cc:288] T eb046a5e3db445f49b5a41b48e163d70 P 805c89a90ba94c04ba1bf0497010a9d5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:46.546423 7202 raft_consensus.cc:2781] T eb046a5e3db445f49b5a41b48e163d70 P 805c89a90ba94c04ba1bf0497010a9d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:46.547082 7202 raft_consensus.cc:686] T eb046a5e3db445f49b5a41b48e163d70 P 805c89a90ba94c04ba1bf0497010a9d5 [term 1 LEADER]: Becoming Leader. State: Replica: 805c89a90ba94c04ba1bf0497010a9d5, State: Running, Role: LEADER
I20260619 18:44:46.547688 7200 ts_tablet_manager.cc:1428] T eb046a5e3db445f49b5a41b48e163d70 P 805c89a90ba94c04ba1bf0497010a9d5: Time spent starting tablet: real 0.012s user 0.010s sys 0.000s
I20260619 18:44:46.547735 7202 consensus_queue.cc:237] T eb046a5e3db445f49b5a41b48e163d70 P 805c89a90ba94c04ba1bf0497010a9d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "805c89a90ba94c04ba1bf0497010a9d5" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 39605 } }
I20260619 18:44:46.553485 7043 catalog_manager.cc:5495] T eb046a5e3db445f49b5a41b48e163d70 P 805c89a90ba94c04ba1bf0497010a9d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 805c89a90ba94c04ba1bf0497010a9d5 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "805c89a90ba94c04ba1bf0497010a9d5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "805c89a90ba94c04ba1bf0497010a9d5" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 39605 } health_report { overall_health: HEALTHY } } }
I20260619 18:44:46.569492 6627 tablet_server.cc:178] TabletServer@127.6.120.193:0 shutting down...
I20260619 18:44:46.595486 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:44:46.596412 6627 tablet_replica.cc:330] T eb046a5e3db445f49b5a41b48e163d70 P 805c89a90ba94c04ba1bf0497010a9d5: stopping tablet replica
I20260619 18:44:46.597048 6627 raft_consensus.cc:2229] T eb046a5e3db445f49b5a41b48e163d70 P 805c89a90ba94c04ba1bf0497010a9d5 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:46.597568 6627 raft_consensus.cc:2258] T eb046a5e3db445f49b5a41b48e163d70 P 805c89a90ba94c04ba1bf0497010a9d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:46.599903 6627 tablet_replica.cc:330] T 3429dbef69ac4d90ae4c93ac9e03b745 P 805c89a90ba94c04ba1bf0497010a9d5: stopping tablet replica
I20260619 18:44:46.600467 6627 raft_consensus.cc:2229] T 3429dbef69ac4d90ae4c93ac9e03b745 P 805c89a90ba94c04ba1bf0497010a9d5 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:46.600906 6627 raft_consensus.cc:2258] T 3429dbef69ac4d90ae4c93ac9e03b745 P 805c89a90ba94c04ba1bf0497010a9d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:46.613914 6627 tablet_server.cc:194] TabletServer@127.6.120.193:0 shutdown complete.
I20260619 18:44:46.625142 6627 master.cc:537] Master@127.6.120.254:35599 shutting down...
I20260619 18:44:46.656611 6627 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 02e3c8034d0d4dbd96751e3b2e9f92cb [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:46.657102 6627 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 02e3c8034d0d4dbd96751e3b2e9f92cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:46.657505 6627 tablet_replica.cc:330] T 00000000000000000000000000000000 P 02e3c8034d0d4dbd96751e3b2e9f92cb: stopping tablet replica
I20260619 18:44:46.666566 6627 master.cc:552] Master@127.6.120.254:35599 shutdown complete.
[ OK ] ClientTest.TestInvalidPredicates (707 ms)
[ RUN ] ClientTest.TestExclusiveInclusiveRangeBounds
I20260619 18:44:46.685599 6627 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.120.254:36159
I20260619 18:44:46.686542 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:46.691836 7209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:46.693060 7210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:46.695526 7212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:46.696427 6627 server_base.cc:1034] running on GCE node
I20260619 18:44:46.697394 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:46.697630 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:46.697808 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894686697794 us; error 0 us; skew 500 ppm
I20260619 18:44:46.698453 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:46.701149 6627 webserver.cc:460] Webserver started at http://127.6.120.254:41351/ using document root <none> and password file <none>
I20260619 18:44:46.701723 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:46.701954 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:46.702262 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:46.703615 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestExclusiveInclusiveRangeBounds.1781894682485826-6627-0/minicluster-data/master-0-root/instance:
uuid: "c75bcd9a5867492b8ff28bb262ddc704"
format_stamp: "Formatted at 2026-06-19 18:44:46 on dist-test-slave-90mn"
I20260619 18:44:46.709278 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260619 18:44:46.713379 7217 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:46.714275 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260619 18:44:46.714593 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestExclusiveInclusiveRangeBounds.1781894682485826-6627-0/minicluster-data/master-0-root
uuid: "c75bcd9a5867492b8ff28bb262ddc704"
format_stamp: "Formatted at 2026-06-19 18:44:46 on dist-test-slave-90mn"
I20260619 18:44:46.714932 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestExclusiveInclusiveRangeBounds.1781894682485826-6627-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestExclusiveInclusiveRangeBounds.1781894682485826-6627-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestExclusiveInclusiveRangeBounds.1781894682485826-6627-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:46.732375 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:46.733646 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:46.786633 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.254:36159
I20260619 18:44:46.786717 7278 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.254:36159 every 8 connection(s)
I20260619 18:44:46.791390 7279 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:46.800587 7279 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c75bcd9a5867492b8ff28bb262ddc704: Bootstrap starting.
I20260619 18:44:46.804251 7279 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c75bcd9a5867492b8ff28bb262ddc704: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:46.807951 7279 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c75bcd9a5867492b8ff28bb262ddc704: No bootstrap required, opened a new log
I20260619 18:44:46.809712 7279 raft_consensus.cc:348] T 00000000000000000000000000000000 P c75bcd9a5867492b8ff28bb262ddc704 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c75bcd9a5867492b8ff28bb262ddc704" member_type: VOTER }
I20260619 18:44:46.810077 7279 raft_consensus.cc:374] T 00000000000000000000000000000000 P c75bcd9a5867492b8ff28bb262ddc704 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:46.810329 7279 raft_consensus.cc:729] T 00000000000000000000000000000000 P c75bcd9a5867492b8ff28bb262ddc704 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c75bcd9a5867492b8ff28bb262ddc704, State: Initialized, Role: FOLLOWER
I20260619 18:44:46.810948 7279 consensus_queue.cc:260] T 00000000000000000000000000000000 P c75bcd9a5867492b8ff28bb262ddc704 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c75bcd9a5867492b8ff28bb262ddc704" member_type: VOTER }
I20260619 18:44:46.811393 7279 raft_consensus.cc:388] T 00000000000000000000000000000000 P c75bcd9a5867492b8ff28bb262ddc704 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:46.811606 7279 raft_consensus.cc:482] T 00000000000000000000000000000000 P c75bcd9a5867492b8ff28bb262ddc704 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:46.811898 7279 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c75bcd9a5867492b8ff28bb262ddc704 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:46.816202 7279 raft_consensus.cc:504] T 00000000000000000000000000000000 P c75bcd9a5867492b8ff28bb262ddc704 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c75bcd9a5867492b8ff28bb262ddc704" member_type: VOTER }
I20260619 18:44:46.816744 7279 leader_election.cc:302] T 00000000000000000000000000000000 P c75bcd9a5867492b8ff28bb262ddc704 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c75bcd9a5867492b8ff28bb262ddc704; no voters:
I20260619 18:44:46.818048 7279 leader_election.cc:288] T 00000000000000000000000000000000 P c75bcd9a5867492b8ff28bb262ddc704 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:46.818359 7282 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c75bcd9a5867492b8ff28bb262ddc704 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:46.819954 7282 raft_consensus.cc:686] T 00000000000000000000000000000000 P c75bcd9a5867492b8ff28bb262ddc704 [term 1 LEADER]: Becoming Leader. State: Replica: c75bcd9a5867492b8ff28bb262ddc704, State: Running, Role: LEADER
I20260619 18:44:46.820649 7282 consensus_queue.cc:237] T 00000000000000000000000000000000 P c75bcd9a5867492b8ff28bb262ddc704 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c75bcd9a5867492b8ff28bb262ddc704" member_type: VOTER }
I20260619 18:44:46.821326 7279 sys_catalog.cc:564] T 00000000000000000000000000000000 P c75bcd9a5867492b8ff28bb262ddc704 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 18:44:46.823225 7283 sys_catalog.cc:455] T 00000000000000000000000000000000 P c75bcd9a5867492b8ff28bb262ddc704 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c75bcd9a5867492b8ff28bb262ddc704" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c75bcd9a5867492b8ff28bb262ddc704" member_type: VOTER } }
I20260619 18:44:46.823776 7283 sys_catalog.cc:458] T 00000000000000000000000000000000 P c75bcd9a5867492b8ff28bb262ddc704 [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:46.825050 7284 sys_catalog.cc:455] T 00000000000000000000000000000000 P c75bcd9a5867492b8ff28bb262ddc704 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c75bcd9a5867492b8ff28bb262ddc704. Latest consensus state: current_term: 1 leader_uuid: "c75bcd9a5867492b8ff28bb262ddc704" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c75bcd9a5867492b8ff28bb262ddc704" member_type: VOTER } }
I20260619 18:44:46.825709 7284 sys_catalog.cc:458] T 00000000000000000000000000000000 P c75bcd9a5867492b8ff28bb262ddc704 [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:46.835680 7287 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 18:44:46.842465 7287 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 18:44:46.843477 6627 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260619 18:44:46.851670 7287 catalog_manager.cc:1347] Generated new cluster ID: d9712afa1a1347bc985bd4d7d158b758
I20260619 18:44:46.851948 7287 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 18:44:46.877050 7287 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 18:44:46.879192 7287 catalog_manager.cc:1504] Loading token signing keys...
I20260619 18:44:46.899520 7287 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c75bcd9a5867492b8ff28bb262ddc704: Generated new TSK 0
I20260619 18:44:46.900290 7287 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 18:44:46.909714 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:46.916304 7300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:46.917506 7301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:46.920698 7304 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:46.920737 6627 server_base.cc:1034] running on GCE node
I20260619 18:44:46.921954 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:46.922197 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:46.922389 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894686922376 us; error 0 us; skew 500 ppm
I20260619 18:44:46.923045 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:46.926506 6627 webserver.cc:460] Webserver started at http://127.6.120.193:40669/ using document root <none> and password file <none>
I20260619 18:44:46.926954 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:46.927156 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:46.927418 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:46.928539 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestExclusiveInclusiveRangeBounds.1781894682485826-6627-0/minicluster-data/ts-0-root/instance:
uuid: "7747b8cbb73c4fb2800fa7993144fbe1"
format_stamp: "Formatted at 2026-06-19 18:44:46 on dist-test-slave-90mn"
I20260619 18:44:46.932767 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260619 18:44:46.935922 7308 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:46.936838 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260619 18:44:46.937163 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestExclusiveInclusiveRangeBounds.1781894682485826-6627-0/minicluster-data/ts-0-root
uuid: "7747b8cbb73c4fb2800fa7993144fbe1"
format_stamp: "Formatted at 2026-06-19 18:44:46 on dist-test-slave-90mn"
I20260619 18:44:46.937572 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestExclusiveInclusiveRangeBounds.1781894682485826-6627-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestExclusiveInclusiveRangeBounds.1781894682485826-6627-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestExclusiveInclusiveRangeBounds.1781894682485826-6627-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:46.958472 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:46.959455 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:46.977281 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:44:46.977625 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:46.977944 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:44:46.978152 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:47.043529 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.193:34137
I20260619 18:44:47.043680 7378 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.193:34137 every 8 connection(s)
I20260619 18:44:47.047991 7379 heartbeater.cc:347] Connected to a master server at 127.6.120.254:36159
I20260619 18:44:47.048399 7379 heartbeater.cc:464] Registering TS with master...
I20260619 18:44:47.049232 7379 heartbeater.cc:511] Master 127.6.120.254:36159 requested a full tablet report, sending...
I20260619 18:44:47.051246 7234 ts_manager.cc:194] Registered new tserver with Master: 7747b8cbb73c4fb2800fa7993144fbe1 (127.6.120.193:34137)
I20260619 18:44:47.051537 6627 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.004998539s
I20260619 18:44:47.054136 7234 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53104
I20260619 18:44:47.067466 7379 heartbeater.cc:503] Master 127.6.120.254:36159 was elected leader, sending a full tablet report...
I20260619 18:44:47.076798 7234 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53128:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 18:44:47.113251 7344 tablet_service.cc:1467] Processing CreateTablet for tablet fe259c3e8cff403987c245f00958cd26 (DEFAULT_TABLE table=client-testtb [id=6b640c09a8eb43458a184308abb1d924]), partition=RANGE (key) PARTITION VALUES < 9
I20260619 18:44:47.113370 7343 tablet_service.cc:1467] Processing CreateTablet for tablet f40a9b5fa7f84c51b5275f37f8dcded7 (DEFAULT_TABLE table=client-testtb [id=6b640c09a8eb43458a184308abb1d924]), partition=RANGE (key) PARTITION 9 <= VALUES
I20260619 18:44:47.114697 7344 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fe259c3e8cff403987c245f00958cd26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:47.115350 7343 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f40a9b5fa7f84c51b5275f37f8dcded7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:47.131625 7389 tablet_bootstrap.cc:492] T f40a9b5fa7f84c51b5275f37f8dcded7 P 7747b8cbb73c4fb2800fa7993144fbe1: Bootstrap starting.
I20260619 18:44:47.136505 7389 tablet_bootstrap.cc:654] T f40a9b5fa7f84c51b5275f37f8dcded7 P 7747b8cbb73c4fb2800fa7993144fbe1: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:47.141423 7389 tablet_bootstrap.cc:492] T f40a9b5fa7f84c51b5275f37f8dcded7 P 7747b8cbb73c4fb2800fa7993144fbe1: No bootstrap required, opened a new log
I20260619 18:44:47.141777 7389 ts_tablet_manager.cc:1397] T f40a9b5fa7f84c51b5275f37f8dcded7 P 7747b8cbb73c4fb2800fa7993144fbe1: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260619 18:44:47.143375 7389 raft_consensus.cc:348] T f40a9b5fa7f84c51b5275f37f8dcded7 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7747b8cbb73c4fb2800fa7993144fbe1" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34137 } }
I20260619 18:44:47.143747 7389 raft_consensus.cc:374] T f40a9b5fa7f84c51b5275f37f8dcded7 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:47.144009 7389 raft_consensus.cc:729] T f40a9b5fa7f84c51b5275f37f8dcded7 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7747b8cbb73c4fb2800fa7993144fbe1, State: Initialized, Role: FOLLOWER
I20260619 18:44:47.144570 7389 consensus_queue.cc:260] T f40a9b5fa7f84c51b5275f37f8dcded7 P 7747b8cbb73c4fb2800fa7993144fbe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7747b8cbb73c4fb2800fa7993144fbe1" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34137 } }
I20260619 18:44:47.145030 7389 raft_consensus.cc:388] T f40a9b5fa7f84c51b5275f37f8dcded7 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:47.145270 7389 raft_consensus.cc:482] T f40a9b5fa7f84c51b5275f37f8dcded7 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:47.145527 7389 raft_consensus.cc:3037] T f40a9b5fa7f84c51b5275f37f8dcded7 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:47.150489 7389 raft_consensus.cc:504] T f40a9b5fa7f84c51b5275f37f8dcded7 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7747b8cbb73c4fb2800fa7993144fbe1" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34137 } }
I20260619 18:44:47.151226 7389 leader_election.cc:302] T f40a9b5fa7f84c51b5275f37f8dcded7 P 7747b8cbb73c4fb2800fa7993144fbe1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7747b8cbb73c4fb2800fa7993144fbe1; no voters:
I20260619 18:44:47.152640 7389 leader_election.cc:288] T f40a9b5fa7f84c51b5275f37f8dcded7 P 7747b8cbb73c4fb2800fa7993144fbe1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:47.152974 7391 raft_consensus.cc:2781] T f40a9b5fa7f84c51b5275f37f8dcded7 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:47.155265 7389 ts_tablet_manager.cc:1428] T f40a9b5fa7f84c51b5275f37f8dcded7 P 7747b8cbb73c4fb2800fa7993144fbe1: Time spent starting tablet: real 0.013s user 0.009s sys 0.005s
I20260619 18:44:47.156335 7389 tablet_bootstrap.cc:492] T fe259c3e8cff403987c245f00958cd26 P 7747b8cbb73c4fb2800fa7993144fbe1: Bootstrap starting.
I20260619 18:44:47.161324 7391 raft_consensus.cc:686] T f40a9b5fa7f84c51b5275f37f8dcded7 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 1 LEADER]: Becoming Leader. State: Replica: 7747b8cbb73c4fb2800fa7993144fbe1, State: Running, Role: LEADER
I20260619 18:44:47.162045 7391 consensus_queue.cc:237] T f40a9b5fa7f84c51b5275f37f8dcded7 P 7747b8cbb73c4fb2800fa7993144fbe1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7747b8cbb73c4fb2800fa7993144fbe1" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34137 } }
I20260619 18:44:47.162827 7389 tablet_bootstrap.cc:654] T fe259c3e8cff403987c245f00958cd26 P 7747b8cbb73c4fb2800fa7993144fbe1: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:47.169337 7233 catalog_manager.cc:5495] T f40a9b5fa7f84c51b5275f37f8dcded7 P 7747b8cbb73c4fb2800fa7993144fbe1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7747b8cbb73c4fb2800fa7993144fbe1 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "7747b8cbb73c4fb2800fa7993144fbe1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7747b8cbb73c4fb2800fa7993144fbe1" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34137 } health_report { overall_health: HEALTHY } } }
I20260619 18:44:47.174019 7389 tablet_bootstrap.cc:492] T fe259c3e8cff403987c245f00958cd26 P 7747b8cbb73c4fb2800fa7993144fbe1: No bootstrap required, opened a new log
I20260619 18:44:47.174465 7389 ts_tablet_manager.cc:1397] T fe259c3e8cff403987c245f00958cd26 P 7747b8cbb73c4fb2800fa7993144fbe1: Time spent bootstrapping tablet: real 0.018s user 0.012s sys 0.004s
I20260619 18:44:47.176698 7389 raft_consensus.cc:348] T fe259c3e8cff403987c245f00958cd26 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7747b8cbb73c4fb2800fa7993144fbe1" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34137 } }
I20260619 18:44:47.177227 7389 raft_consensus.cc:374] T fe259c3e8cff403987c245f00958cd26 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:47.177515 7389 raft_consensus.cc:729] T fe259c3e8cff403987c245f00958cd26 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7747b8cbb73c4fb2800fa7993144fbe1, State: Initialized, Role: FOLLOWER
I20260619 18:44:47.178320 7389 consensus_queue.cc:260] T fe259c3e8cff403987c245f00958cd26 P 7747b8cbb73c4fb2800fa7993144fbe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7747b8cbb73c4fb2800fa7993144fbe1" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34137 } }
I20260619 18:44:47.178936 7389 raft_consensus.cc:388] T fe259c3e8cff403987c245f00958cd26 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:47.179239 7389 raft_consensus.cc:482] T fe259c3e8cff403987c245f00958cd26 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:47.179553 7389 raft_consensus.cc:3037] T fe259c3e8cff403987c245f00958cd26 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:47.185115 7389 raft_consensus.cc:504] T fe259c3e8cff403987c245f00958cd26 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7747b8cbb73c4fb2800fa7993144fbe1" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34137 } }
I20260619 18:44:47.185724 7389 leader_election.cc:302] T fe259c3e8cff403987c245f00958cd26 P 7747b8cbb73c4fb2800fa7993144fbe1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7747b8cbb73c4fb2800fa7993144fbe1; no voters:
I20260619 18:44:47.186281 7389 leader_election.cc:288] T fe259c3e8cff403987c245f00958cd26 P 7747b8cbb73c4fb2800fa7993144fbe1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:47.186425 7393 raft_consensus.cc:2781] T fe259c3e8cff403987c245f00958cd26 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:47.187093 7393 raft_consensus.cc:686] T fe259c3e8cff403987c245f00958cd26 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 1 LEADER]: Becoming Leader. State: Replica: 7747b8cbb73c4fb2800fa7993144fbe1, State: Running, Role: LEADER
I20260619 18:44:47.188026 7389 ts_tablet_manager.cc:1428] T fe259c3e8cff403987c245f00958cd26 P 7747b8cbb73c4fb2800fa7993144fbe1: Time spent starting tablet: real 0.013s user 0.011s sys 0.003s
I20260619 18:44:47.187736 7393 consensus_queue.cc:237] T fe259c3e8cff403987c245f00958cd26 P 7747b8cbb73c4fb2800fa7993144fbe1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7747b8cbb73c4fb2800fa7993144fbe1" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34137 } }
I20260619 18:44:47.193427 7233 catalog_manager.cc:5495] T fe259c3e8cff403987c245f00958cd26 P 7747b8cbb73c4fb2800fa7993144fbe1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7747b8cbb73c4fb2800fa7993144fbe1 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "7747b8cbb73c4fb2800fa7993144fbe1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7747b8cbb73c4fb2800fa7993144fbe1" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34137 } health_report { overall_health: HEALTHY } } }
I20260619 18:44:47.223722 7233 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53128:
name: "TestExclusiveInclusiveRangeBounds"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\010\001\000\377\377\377\377\t\001\000c\000\000\000""\010\001\000\377\377\377\377\t\001\000c\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 18:44:47.244386 7343 tablet_service.cc:1467] Processing CreateTablet for tablet d304260752a6455f9e65de261ecbf6df (DEFAULT_TABLE table=TestExclusiveInclusiveRangeBounds [id=3f2bf434d4004312b6c477f1eed3fb8d]), partition=RANGE (key) PARTITION 0 <= VALUES < 100
I20260619 18:44:47.245476 7343 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d304260752a6455f9e65de261ecbf6df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:47.255618 7389 tablet_bootstrap.cc:492] T d304260752a6455f9e65de261ecbf6df P 7747b8cbb73c4fb2800fa7993144fbe1: Bootstrap starting.
I20260619 18:44:47.260349 7389 tablet_bootstrap.cc:654] T d304260752a6455f9e65de261ecbf6df P 7747b8cbb73c4fb2800fa7993144fbe1: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:47.264671 7389 tablet_bootstrap.cc:492] T d304260752a6455f9e65de261ecbf6df P 7747b8cbb73c4fb2800fa7993144fbe1: No bootstrap required, opened a new log
I20260619 18:44:47.265103 7389 ts_tablet_manager.cc:1397] T d304260752a6455f9e65de261ecbf6df P 7747b8cbb73c4fb2800fa7993144fbe1: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260619 18:44:47.267313 7389 raft_consensus.cc:348] T d304260752a6455f9e65de261ecbf6df P 7747b8cbb73c4fb2800fa7993144fbe1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7747b8cbb73c4fb2800fa7993144fbe1" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34137 } }
I20260619 18:44:47.267876 7389 raft_consensus.cc:374] T d304260752a6455f9e65de261ecbf6df P 7747b8cbb73c4fb2800fa7993144fbe1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:47.268172 7389 raft_consensus.cc:729] T d304260752a6455f9e65de261ecbf6df P 7747b8cbb73c4fb2800fa7993144fbe1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7747b8cbb73c4fb2800fa7993144fbe1, State: Initialized, Role: FOLLOWER
I20260619 18:44:47.268811 7389 consensus_queue.cc:260] T d304260752a6455f9e65de261ecbf6df P 7747b8cbb73c4fb2800fa7993144fbe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7747b8cbb73c4fb2800fa7993144fbe1" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34137 } }
I20260619 18:44:47.269302 7389 raft_consensus.cc:388] T d304260752a6455f9e65de261ecbf6df P 7747b8cbb73c4fb2800fa7993144fbe1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:47.269538 7389 raft_consensus.cc:482] T d304260752a6455f9e65de261ecbf6df P 7747b8cbb73c4fb2800fa7993144fbe1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:47.269819 7389 raft_consensus.cc:3037] T d304260752a6455f9e65de261ecbf6df P 7747b8cbb73c4fb2800fa7993144fbe1 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:47.274549 7389 raft_consensus.cc:504] T d304260752a6455f9e65de261ecbf6df P 7747b8cbb73c4fb2800fa7993144fbe1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7747b8cbb73c4fb2800fa7993144fbe1" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34137 } }
I20260619 18:44:47.275107 7389 leader_election.cc:302] T d304260752a6455f9e65de261ecbf6df P 7747b8cbb73c4fb2800fa7993144fbe1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7747b8cbb73c4fb2800fa7993144fbe1; no voters:
I20260619 18:44:47.275569 7389 leader_election.cc:288] T d304260752a6455f9e65de261ecbf6df P 7747b8cbb73c4fb2800fa7993144fbe1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:47.275738 7393 raft_consensus.cc:2781] T d304260752a6455f9e65de261ecbf6df P 7747b8cbb73c4fb2800fa7993144fbe1 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:47.276248 7393 raft_consensus.cc:686] T d304260752a6455f9e65de261ecbf6df P 7747b8cbb73c4fb2800fa7993144fbe1 [term 1 LEADER]: Becoming Leader. State: Replica: 7747b8cbb73c4fb2800fa7993144fbe1, State: Running, Role: LEADER
I20260619 18:44:47.277043 7389 ts_tablet_manager.cc:1428] T d304260752a6455f9e65de261ecbf6df P 7747b8cbb73c4fb2800fa7993144fbe1: Time spent starting tablet: real 0.012s user 0.002s sys 0.010s
I20260619 18:44:47.276888 7393 consensus_queue.cc:237] T d304260752a6455f9e65de261ecbf6df P 7747b8cbb73c4fb2800fa7993144fbe1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7747b8cbb73c4fb2800fa7993144fbe1" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34137 } }
I20260619 18:44:47.283982 7234 catalog_manager.cc:5495] T d304260752a6455f9e65de261ecbf6df P 7747b8cbb73c4fb2800fa7993144fbe1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7747b8cbb73c4fb2800fa7993144fbe1 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "7747b8cbb73c4fb2800fa7993144fbe1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7747b8cbb73c4fb2800fa7993144fbe1" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34137 } health_report { overall_health: HEALTHY } } }
I20260619 18:44:47.301326 7234 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53128:
table { table_name: "TestExclusiveInclusiveRangeBounds" } alter_schema_steps { type: ADD_RANGE_PARTITION add_range_partition { range_bounds { rows: "\010\001\000\307\000\000\000\t\001\000+\001\000\000""\010\001\000\307\000\000\000\t\001\000+\001\000\000" indirect_data: """" } } } schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } columns { name: "non_null_with_default" type: INT32 is_key: false is_nullable: false read_default_value: "90\000\000" encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } modify_external_catalogs: true
W20260619 18:44:47.317395 7234 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4350f457ff884311be3c57491d1b5640 has no consensus state
I20260619 18:44:47.327126 7343 tablet_service.cc:1467] Processing CreateTablet for tablet 4350f457ff884311be3c57491d1b5640 (DEFAULT_TABLE table=TestExclusiveInclusiveRangeBounds [id=3f2bf434d4004312b6c477f1eed3fb8d]), partition=RANGE (key) PARTITION 200 <= VALUES < 300
I20260619 18:44:47.329098 7343 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4350f457ff884311be3c57491d1b5640. 1 dirs total, 0 dirs full, 0 dirs failed
W20260619 18:44:47.343050 7221 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 4350f457ff884311be3c57491d1b5640 (table TestExclusiveInclusiveRangeBounds [id=3f2bf434d4004312b6c477f1eed3fb8d], current schema version=0) failed: Not found: failed to reset TS proxy: No leader found: Tablet 4350f457ff884311be3c57491d1b5640 consensus state has no leader
I20260619 18:44:47.343894 7389 tablet_bootstrap.cc:492] T 4350f457ff884311be3c57491d1b5640 P 7747b8cbb73c4fb2800fa7993144fbe1: Bootstrap starting.
I20260619 18:44:47.349691 7389 tablet_bootstrap.cc:654] T 4350f457ff884311be3c57491d1b5640 P 7747b8cbb73c4fb2800fa7993144fbe1: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:47.354651 7389 tablet_bootstrap.cc:492] T 4350f457ff884311be3c57491d1b5640 P 7747b8cbb73c4fb2800fa7993144fbe1: No bootstrap required, opened a new log
I20260619 18:44:47.355079 7389 ts_tablet_manager.cc:1397] T 4350f457ff884311be3c57491d1b5640 P 7747b8cbb73c4fb2800fa7993144fbe1: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.003s
I20260619 18:44:47.357475 7389 raft_consensus.cc:348] T 4350f457ff884311be3c57491d1b5640 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7747b8cbb73c4fb2800fa7993144fbe1" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34137 } }
I20260619 18:44:47.358031 7389 raft_consensus.cc:374] T 4350f457ff884311be3c57491d1b5640 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:47.358312 7389 raft_consensus.cc:729] T 4350f457ff884311be3c57491d1b5640 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7747b8cbb73c4fb2800fa7993144fbe1, State: Initialized, Role: FOLLOWER
I20260619 18:44:47.358974 7389 consensus_queue.cc:260] T 4350f457ff884311be3c57491d1b5640 P 7747b8cbb73c4fb2800fa7993144fbe1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7747b8cbb73c4fb2800fa7993144fbe1" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34137 } }
I20260619 18:44:47.359586 7389 raft_consensus.cc:388] T 4350f457ff884311be3c57491d1b5640 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:47.359875 7389 raft_consensus.cc:482] T 4350f457ff884311be3c57491d1b5640 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:47.360219 7389 raft_consensus.cc:3037] T 4350f457ff884311be3c57491d1b5640 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:47.366132 7389 raft_consensus.cc:504] T 4350f457ff884311be3c57491d1b5640 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7747b8cbb73c4fb2800fa7993144fbe1" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34137 } }
I20260619 18:44:47.366820 7389 leader_election.cc:302] T 4350f457ff884311be3c57491d1b5640 P 7747b8cbb73c4fb2800fa7993144fbe1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7747b8cbb73c4fb2800fa7993144fbe1; no voters:
I20260619 18:44:47.367388 7389 leader_election.cc:288] T 4350f457ff884311be3c57491d1b5640 P 7747b8cbb73c4fb2800fa7993144fbe1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:47.367564 7393 raft_consensus.cc:2781] T 4350f457ff884311be3c57491d1b5640 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:47.368237 7393 raft_consensus.cc:686] T 4350f457ff884311be3c57491d1b5640 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 1 LEADER]: Becoming Leader. State: Replica: 7747b8cbb73c4fb2800fa7993144fbe1, State: Running, Role: LEADER
I20260619 18:44:47.369047 7389 ts_tablet_manager.cc:1428] T 4350f457ff884311be3c57491d1b5640 P 7747b8cbb73c4fb2800fa7993144fbe1: Time spent starting tablet: real 0.014s user 0.011s sys 0.004s
I20260619 18:44:47.368963 7393 consensus_queue.cc:237] T 4350f457ff884311be3c57491d1b5640 P 7747b8cbb73c4fb2800fa7993144fbe1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7747b8cbb73c4fb2800fa7993144fbe1" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34137 } }
I20260619 18:44:47.375301 7234 catalog_manager.cc:5495] T 4350f457ff884311be3c57491d1b5640 P 7747b8cbb73c4fb2800fa7993144fbe1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7747b8cbb73c4fb2800fa7993144fbe1 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "7747b8cbb73c4fb2800fa7993144fbe1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7747b8cbb73c4fb2800fa7993144fbe1" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34137 } health_report { overall_health: HEALTHY } } }
I20260619 18:44:47.387418 7234 catalog_manager.cc:6040] T 00000000000000000000000000000000 P c75bcd9a5867492b8ff28bb262ddc704: TestExclusiveInclusiveRangeBounds [id=3f2bf434d4004312b6c477f1eed3fb8d] alter complete (version 0)
I20260619 18:44:47.561223 7232 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53128:
table { table_name: "TestExclusiveInclusiveRangeBounds" } alter_schema_steps { type: DROP_RANGE_PARTITION drop_range_partition { range_bounds { rows: "\006\001\000\000\000\000\000\007\001\000d\000\000\000""\006\001\000\000\000\000\000\007\001\000d\000\000\000" indirect_data: """" } } } alter_schema_steps { type: DROP_RANGE_PARTITION drop_range_partition { range_bounds { rows: "\010\001\000\307\000\000\000\t\001\000+\001\000\000""\010\001\000\307\000\000\000\t\001\000+\001\000\000" indirect_data: """" } } } schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } columns { name: "non_null_with_default" type: INT32 is_key: false is_nullable: false read_default_value: "90\000\000" encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } modify_external_catalogs: true
I20260619 18:44:47.575469 7232 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c75bcd9a5867492b8ff28bb262ddc704: Sending DeleteTablet for 1 replicas of tablet d304260752a6455f9e65de261ecbf6df
I20260619 18:44:47.576231 7232 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c75bcd9a5867492b8ff28bb262ddc704: Sending DeleteTablet for 1 replicas of tablet 4350f457ff884311be3c57491d1b5640
I20260619 18:44:47.577116 7343 tablet_service.cc:1514] Processing DeleteTablet for tablet d304260752a6455f9e65de261ecbf6df with delete_type TABLET_DATA_DELETED (Partition dropped at 2026-06-19 18:44:47 UTC) from {username='slave'} at 127.0.0.1:58336
I20260619 18:44:47.577653 7344 tablet_service.cc:1514] Processing DeleteTablet for tablet 4350f457ff884311be3c57491d1b5640 with delete_type TABLET_DATA_DELETED (Partition dropped at 2026-06-19 18:44:47 UTC) from {username='slave'} at 127.0.0.1:58336
I20260619 18:44:47.579268 7404 tablet_replica.cc:330] T d304260752a6455f9e65de261ecbf6df P 7747b8cbb73c4fb2800fa7993144fbe1: stopping tablet replica
I20260619 18:44:47.579885 7404 raft_consensus.cc:2229] T d304260752a6455f9e65de261ecbf6df P 7747b8cbb73c4fb2800fa7993144fbe1 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:47.580444 7404 raft_consensus.cc:2258] T d304260752a6455f9e65de261ecbf6df P 7747b8cbb73c4fb2800fa7993144fbe1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:47.583391 7404 ts_tablet_manager.cc:1905] T d304260752a6455f9e65de261ecbf6df P 7747b8cbb73c4fb2800fa7993144fbe1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 18:44:47.589592 6627 tablet_server.cc:178] TabletServer@127.6.120.193:0 shutting down...
I20260619 18:44:47.598433 7404 ts_tablet_manager.cc:1918] T d304260752a6455f9e65de261ecbf6df P 7747b8cbb73c4fb2800fa7993144fbe1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 18:44:47.598912 7404 log.cc:1196] T d304260752a6455f9e65de261ecbf6df P 7747b8cbb73c4fb2800fa7993144fbe1: Deleting WAL directory at /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestExclusiveInclusiveRangeBounds.1781894682485826-6627-0/minicluster-data/ts-0-root/wals/d304260752a6455f9e65de261ecbf6df
I20260619 18:44:47.599608 7404 ts_tablet_manager.cc:1939] T d304260752a6455f9e65de261ecbf6df P 7747b8cbb73c4fb2800fa7993144fbe1: Deleting consensus metadata
I20260619 18:44:47.602654 7221 catalog_manager.cc:4841] TS 7747b8cbb73c4fb2800fa7993144fbe1 (127.6.120.193:34137): tablet d304260752a6455f9e65de261ecbf6df (table TestExclusiveInclusiveRangeBounds [id=3f2bf434d4004312b6c477f1eed3fb8d]) successfully deleted
I20260619 18:44:47.602829 7404 tablet_replica.cc:330] T 4350f457ff884311be3c57491d1b5640 P 7747b8cbb73c4fb2800fa7993144fbe1: stopping tablet replica
I20260619 18:44:47.603611 7404 raft_consensus.cc:2229] T 4350f457ff884311be3c57491d1b5640 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:47.604221 7404 raft_consensus.cc:2258] T 4350f457ff884311be3c57491d1b5640 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:47.608387 7404 ts_tablet_manager.cc:1905] T 4350f457ff884311be3c57491d1b5640 P 7747b8cbb73c4fb2800fa7993144fbe1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 18:44:47.625573 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:44:47.625660 7404 ts_tablet_manager.cc:1918] T 4350f457ff884311be3c57491d1b5640 P 7747b8cbb73c4fb2800fa7993144fbe1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 18:44:47.626031 7404 log.cc:1196] T 4350f457ff884311be3c57491d1b5640 P 7747b8cbb73c4fb2800fa7993144fbe1: Deleting WAL directory at /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestExclusiveInclusiveRangeBounds.1781894682485826-6627-0/minicluster-data/ts-0-root/wals/4350f457ff884311be3c57491d1b5640
I20260619 18:44:47.626832 7404 ts_tablet_manager.cc:1939] T 4350f457ff884311be3c57491d1b5640 P 7747b8cbb73c4fb2800fa7993144fbe1: Deleting consensus metadata
I20260619 18:44:47.628851 6627 tablet_replica.cc:330] T fe259c3e8cff403987c245f00958cd26 P 7747b8cbb73c4fb2800fa7993144fbe1: stopping tablet replica
I20260619 18:44:47.629379 6627 raft_consensus.cc:2229] T fe259c3e8cff403987c245f00958cd26 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:47.629894 6627 raft_consensus.cc:2258] T fe259c3e8cff403987c245f00958cd26 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 18:44:47.629689 7221 catalog_manager.cc:4833] TS 7747b8cbb73c4fb2800fa7993144fbe1 (127.6.120.193:34137): delete failed for tablet 4350f457ff884311be3c57491d1b5640 with error code TABLET_NOT_RUNNING: Service unavailable: Tablet Manager is not running: MANAGER_QUIESCING
I20260619 18:44:47.632258 6627 tablet_replica.cc:330] T f40a9b5fa7f84c51b5275f37f8dcded7 P 7747b8cbb73c4fb2800fa7993144fbe1: stopping tablet replica
I20260619 18:44:47.632762 6627 raft_consensus.cc:2229] T f40a9b5fa7f84c51b5275f37f8dcded7 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:47.633189 6627 raft_consensus.cc:2258] T f40a9b5fa7f84c51b5275f37f8dcded7 P 7747b8cbb73c4fb2800fa7993144fbe1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:47.649718 6627 tablet_server.cc:194] TabletServer@127.6.120.193:0 shutdown complete.
I20260619 18:44:47.664952 6627 master.cc:537] Master@127.6.120.254:36159 shutting down...
W20260619 18:44:47.689741 7221 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.120.193:34137: connect: Connection refused (error 111)
W20260619 18:44:47.692956 7221 catalog_manager.cc:4584] TS 7747b8cbb73c4fb2800fa7993144fbe1 (127.6.120.193:34137): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4350f457ff884311be3c57491d1b5640: Network error: Client connection negotiation failed: client connection to 127.6.120.193:34137: connect: Connection refused (error 111)
I20260619 18:44:47.696033 6627 raft_consensus.cc:2229] T 00000000000000000000000000000000 P c75bcd9a5867492b8ff28bb262ddc704 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:47.696583 6627 raft_consensus.cc:2258] T 00000000000000000000000000000000 P c75bcd9a5867492b8ff28bb262ddc704 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:47.696892 6627 tablet_replica.cc:330] T 00000000000000000000000000000000 P c75bcd9a5867492b8ff28bb262ddc704: stopping tablet replica
I20260619 18:44:47.706475 6627 master.cc:552] Master@127.6.120.254:36159 shutdown complete.
[ OK ] ClientTest.TestExclusiveInclusiveRangeBounds (1045 ms)
[ RUN ] ClientTest.TestBasicIdBasedLookup
I20260619 18:44:47.733156 6627 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.120.254:33839
I20260619 18:44:47.734395 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:47.739989 7407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:47.740303 7408 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:47.743765 7410 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:47.745383 6627 server_base.cc:1034] running on GCE node
I20260619 18:44:47.746171 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:47.746485 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:47.746658 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894687746645 us; error 0 us; skew 500 ppm
I20260619 18:44:47.747282 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:47.750042 6627 webserver.cc:460] Webserver started at http://127.6.120.254:39715/ using document root <none> and password file <none>
I20260619 18:44:47.750599 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:47.750808 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:47.751097 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:47.752447 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBasicIdBasedLookup.1781894682485826-6627-0/minicluster-data/master-0-root/instance:
uuid: "afecd39dc247479d99b1d616172c9a8e"
format_stamp: "Formatted at 2026-06-19 18:44:47 on dist-test-slave-90mn"
I20260619 18:44:47.757822 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 18:44:47.761854 7415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:47.762709 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260619 18:44:47.763006 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBasicIdBasedLookup.1781894682485826-6627-0/minicluster-data/master-0-root
uuid: "afecd39dc247479d99b1d616172c9a8e"
format_stamp: "Formatted at 2026-06-19 18:44:47 on dist-test-slave-90mn"
I20260619 18:44:47.763342 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBasicIdBasedLookup.1781894682485826-6627-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBasicIdBasedLookup.1781894682485826-6627-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBasicIdBasedLookup.1781894682485826-6627-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:47.802341 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:47.803598 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:47.856801 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.254:33839
I20260619 18:44:47.856900 7476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.254:33839 every 8 connection(s)
I20260619 18:44:47.860921 7477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:47.870908 7477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afecd39dc247479d99b1d616172c9a8e: Bootstrap starting.
I20260619 18:44:47.874701 7477 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P afecd39dc247479d99b1d616172c9a8e: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:47.878412 7477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afecd39dc247479d99b1d616172c9a8e: No bootstrap required, opened a new log
I20260619 18:44:47.880065 7477 raft_consensus.cc:348] T 00000000000000000000000000000000 P afecd39dc247479d99b1d616172c9a8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afecd39dc247479d99b1d616172c9a8e" member_type: VOTER }
I20260619 18:44:47.880496 7477 raft_consensus.cc:374] T 00000000000000000000000000000000 P afecd39dc247479d99b1d616172c9a8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:47.880740 7477 raft_consensus.cc:729] T 00000000000000000000000000000000 P afecd39dc247479d99b1d616172c9a8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afecd39dc247479d99b1d616172c9a8e, State: Initialized, Role: FOLLOWER
I20260619 18:44:47.881265 7477 consensus_queue.cc:260] T 00000000000000000000000000000000 P afecd39dc247479d99b1d616172c9a8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afecd39dc247479d99b1d616172c9a8e" member_type: VOTER }
I20260619 18:44:47.881678 7477 raft_consensus.cc:388] T 00000000000000000000000000000000 P afecd39dc247479d99b1d616172c9a8e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:47.881882 7477 raft_consensus.cc:482] T 00000000000000000000000000000000 P afecd39dc247479d99b1d616172c9a8e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:47.882160 7477 raft_consensus.cc:3037] T 00000000000000000000000000000000 P afecd39dc247479d99b1d616172c9a8e [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:47.886107 7477 raft_consensus.cc:504] T 00000000000000000000000000000000 P afecd39dc247479d99b1d616172c9a8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afecd39dc247479d99b1d616172c9a8e" member_type: VOTER }
I20260619 18:44:47.886620 7477 leader_election.cc:302] T 00000000000000000000000000000000 P afecd39dc247479d99b1d616172c9a8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: afecd39dc247479d99b1d616172c9a8e; no voters:
I20260619 18:44:47.887915 7477 leader_election.cc:288] T 00000000000000000000000000000000 P afecd39dc247479d99b1d616172c9a8e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:47.888247 7480 raft_consensus.cc:2781] T 00000000000000000000000000000000 P afecd39dc247479d99b1d616172c9a8e [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:47.890266 7480 raft_consensus.cc:686] T 00000000000000000000000000000000 P afecd39dc247479d99b1d616172c9a8e [term 1 LEADER]: Becoming Leader. State: Replica: afecd39dc247479d99b1d616172c9a8e, State: Running, Role: LEADER
I20260619 18:44:47.890988 7480 consensus_queue.cc:237] T 00000000000000000000000000000000 P afecd39dc247479d99b1d616172c9a8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afecd39dc247479d99b1d616172c9a8e" member_type: VOTER }
I20260619 18:44:47.891623 7477 sys_catalog.cc:564] T 00000000000000000000000000000000 P afecd39dc247479d99b1d616172c9a8e [sys.catalog]: configured and running, proceeding with master startup.
I20260619 18:44:47.893718 7481 sys_catalog.cc:455] T 00000000000000000000000000000000 P afecd39dc247479d99b1d616172c9a8e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "afecd39dc247479d99b1d616172c9a8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afecd39dc247479d99b1d616172c9a8e" member_type: VOTER } }
I20260619 18:44:47.894317 7481 sys_catalog.cc:458] T 00000000000000000000000000000000 P afecd39dc247479d99b1d616172c9a8e [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:47.895536 7482 sys_catalog.cc:455] T 00000000000000000000000000000000 P afecd39dc247479d99b1d616172c9a8e [sys.catalog]: SysCatalogTable state changed. Reason: New leader afecd39dc247479d99b1d616172c9a8e. Latest consensus state: current_term: 1 leader_uuid: "afecd39dc247479d99b1d616172c9a8e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afecd39dc247479d99b1d616172c9a8e" member_type: VOTER } }
I20260619 18:44:47.896042 7482 sys_catalog.cc:458] T 00000000000000000000000000000000 P afecd39dc247479d99b1d616172c9a8e [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:47.900935 7485 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 18:44:47.908577 7485 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 18:44:47.909652 6627 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260619 18:44:47.917915 7485 catalog_manager.cc:1347] Generated new cluster ID: b56fa5ec3d61417e8fa273b071abd5cd
I20260619 18:44:47.918257 7485 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 18:44:47.949090 7485 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 18:44:47.951313 7485 catalog_manager.cc:1504] Loading token signing keys...
I20260619 18:44:47.965322 7485 catalog_manager.cc:5868] T 00000000000000000000000000000000 P afecd39dc247479d99b1d616172c9a8e: Generated new TSK 0
I20260619 18:44:47.966050 7485 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 18:44:47.975690 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:47.981563 7498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:47.983299 7499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:47.984531 6627 server_base.cc:1034] running on GCE node
W20260619 18:44:47.985780 7501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:47.986675 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:47.986886 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:47.987051 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894687987037 us; error 0 us; skew 500 ppm
I20260619 18:44:47.987532 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:47.990303 6627 webserver.cc:460] Webserver started at http://127.6.120.193:42773/ using document root <none> and password file <none>
I20260619 18:44:47.990742 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:47.990937 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:47.991192 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:47.992398 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBasicIdBasedLookup.1781894682485826-6627-0/minicluster-data/ts-0-root/instance:
uuid: "34d99980d6574e77932800f3a71c9cfb"
format_stamp: "Formatted at 2026-06-19 18:44:47 on dist-test-slave-90mn"
I20260619 18:44:47.996922 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260619 18:44:48.000161 7506 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:48.001003 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260619 18:44:48.001319 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBasicIdBasedLookup.1781894682485826-6627-0/minicluster-data/ts-0-root
uuid: "34d99980d6574e77932800f3a71c9cfb"
format_stamp: "Formatted at 2026-06-19 18:44:47 on dist-test-slave-90mn"
I20260619 18:44:48.001663 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBasicIdBasedLookup.1781894682485826-6627-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBasicIdBasedLookup.1781894682485826-6627-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBasicIdBasedLookup.1781894682485826-6627-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:48.021157 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:48.022401 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:48.032274 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:44:48.032554 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:48.032840 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:44:48.033038 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:48.102856 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.193:36903
I20260619 18:44:48.103015 7576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.193:36903 every 8 connection(s)
I20260619 18:44:48.108330 7577 heartbeater.cc:347] Connected to a master server at 127.6.120.254:33839
I20260619 18:44:48.108705 7577 heartbeater.cc:464] Registering TS with master...
I20260619 18:44:48.109485 7577 heartbeater.cc:511] Master 127.6.120.254:33839 requested a full tablet report, sending...
I20260619 18:44:48.111806 7432 ts_manager.cc:194] Registered new tserver with Master: 34d99980d6574e77932800f3a71c9cfb (127.6.120.193:36903)
I20260619 18:44:48.112771 6627 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.006036754s
I20260619 18:44:48.114156 7432 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47578
I20260619 18:44:48.127661 7577 heartbeater.cc:503] Master 127.6.120.254:33839 was elected leader, sending a full tablet report...
I20260619 18:44:48.136361 7432 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47602:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 18:44:48.173897 7542 tablet_service.cc:1467] Processing CreateTablet for tablet 08311452166d4d8cbd6df4dda644c49f (DEFAULT_TABLE table=client-testtb [id=f984f3d51bdb418ca1f049b0b3079c89]), partition=RANGE (key) PARTITION VALUES < 9
I20260619 18:44:48.174019 7541 tablet_service.cc:1467] Processing CreateTablet for tablet d774096c8a564b8c8c174b9bf7d2b266 (DEFAULT_TABLE table=client-testtb [id=f984f3d51bdb418ca1f049b0b3079c89]), partition=RANGE (key) PARTITION 9 <= VALUES
I20260619 18:44:48.175375 7542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 08311452166d4d8cbd6df4dda644c49f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:48.175846 7541 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d774096c8a564b8c8c174b9bf7d2b266. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:48.191846 7587 tablet_bootstrap.cc:492] T d774096c8a564b8c8c174b9bf7d2b266 P 34d99980d6574e77932800f3a71c9cfb: Bootstrap starting.
I20260619 18:44:48.196098 7587 tablet_bootstrap.cc:654] T d774096c8a564b8c8c174b9bf7d2b266 P 34d99980d6574e77932800f3a71c9cfb: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:48.201066 7587 tablet_bootstrap.cc:492] T d774096c8a564b8c8c174b9bf7d2b266 P 34d99980d6574e77932800f3a71c9cfb: No bootstrap required, opened a new log
I20260619 18:44:48.201418 7587 ts_tablet_manager.cc:1397] T d774096c8a564b8c8c174b9bf7d2b266 P 34d99980d6574e77932800f3a71c9cfb: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260619 18:44:48.203349 7587 raft_consensus.cc:348] T d774096c8a564b8c8c174b9bf7d2b266 P 34d99980d6574e77932800f3a71c9cfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34d99980d6574e77932800f3a71c9cfb" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 36903 } }
I20260619 18:44:48.203785 7587 raft_consensus.cc:374] T d774096c8a564b8c8c174b9bf7d2b266 P 34d99980d6574e77932800f3a71c9cfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:48.204015 7587 raft_consensus.cc:729] T d774096c8a564b8c8c174b9bf7d2b266 P 34d99980d6574e77932800f3a71c9cfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34d99980d6574e77932800f3a71c9cfb, State: Initialized, Role: FOLLOWER
I20260619 18:44:48.204612 7587 consensus_queue.cc:260] T d774096c8a564b8c8c174b9bf7d2b266 P 34d99980d6574e77932800f3a71c9cfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34d99980d6574e77932800f3a71c9cfb" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 36903 } }
I20260619 18:44:48.205081 7587 raft_consensus.cc:388] T d774096c8a564b8c8c174b9bf7d2b266 P 34d99980d6574e77932800f3a71c9cfb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:48.205313 7587 raft_consensus.cc:482] T d774096c8a564b8c8c174b9bf7d2b266 P 34d99980d6574e77932800f3a71c9cfb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:48.205567 7587 raft_consensus.cc:3037] T d774096c8a564b8c8c174b9bf7d2b266 P 34d99980d6574e77932800f3a71c9cfb [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:48.211159 7587 raft_consensus.cc:504] T d774096c8a564b8c8c174b9bf7d2b266 P 34d99980d6574e77932800f3a71c9cfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34d99980d6574e77932800f3a71c9cfb" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 36903 } }
I20260619 18:44:48.211705 7587 leader_election.cc:302] T d774096c8a564b8c8c174b9bf7d2b266 P 34d99980d6574e77932800f3a71c9cfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 34d99980d6574e77932800f3a71c9cfb; no voters:
I20260619 18:44:48.213085 7587 leader_election.cc:288] T d774096c8a564b8c8c174b9bf7d2b266 P 34d99980d6574e77932800f3a71c9cfb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:48.213459 7589 raft_consensus.cc:2781] T d774096c8a564b8c8c174b9bf7d2b266 P 34d99980d6574e77932800f3a71c9cfb [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:48.215734 7587 ts_tablet_manager.cc:1428] T d774096c8a564b8c8c174b9bf7d2b266 P 34d99980d6574e77932800f3a71c9cfb: Time spent starting tablet: real 0.014s user 0.011s sys 0.004s
I20260619 18:44:48.216812 7587 tablet_bootstrap.cc:492] T 08311452166d4d8cbd6df4dda644c49f P 34d99980d6574e77932800f3a71c9cfb: Bootstrap starting.
I20260619 18:44:48.223765 7587 tablet_bootstrap.cc:654] T 08311452166d4d8cbd6df4dda644c49f P 34d99980d6574e77932800f3a71c9cfb: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:48.224615 7589 raft_consensus.cc:686] T d774096c8a564b8c8c174b9bf7d2b266 P 34d99980d6574e77932800f3a71c9cfb [term 1 LEADER]: Becoming Leader. State: Replica: 34d99980d6574e77932800f3a71c9cfb, State: Running, Role: LEADER
I20260619 18:44:48.225374 7589 consensus_queue.cc:237] T d774096c8a564b8c8c174b9bf7d2b266 P 34d99980d6574e77932800f3a71c9cfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34d99980d6574e77932800f3a71c9cfb" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 36903 } }
I20260619 18:44:48.229609 7587 tablet_bootstrap.cc:492] T 08311452166d4d8cbd6df4dda644c49f P 34d99980d6574e77932800f3a71c9cfb: No bootstrap required, opened a new log
I20260619 18:44:48.230042 7587 ts_tablet_manager.cc:1397] T 08311452166d4d8cbd6df4dda644c49f P 34d99980d6574e77932800f3a71c9cfb: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.006s
I20260619 18:44:48.232622 7431 catalog_manager.cc:5495] T d774096c8a564b8c8c174b9bf7d2b266 P 34d99980d6574e77932800f3a71c9cfb reported cstate change: term changed from 0 to 1, leader changed from <none> to 34d99980d6574e77932800f3a71c9cfb (127.6.120.193). New cstate: current_term: 1 leader_uuid: "34d99980d6574e77932800f3a71c9cfb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34d99980d6574e77932800f3a71c9cfb" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 36903 } health_report { overall_health: HEALTHY } } }
I20260619 18:44:48.232769 7587 raft_consensus.cc:348] T 08311452166d4d8cbd6df4dda644c49f P 34d99980d6574e77932800f3a71c9cfb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34d99980d6574e77932800f3a71c9cfb" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 36903 } }
I20260619 18:44:48.236507 7587 raft_consensus.cc:374] T 08311452166d4d8cbd6df4dda644c49f P 34d99980d6574e77932800f3a71c9cfb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:48.236866 7587 raft_consensus.cc:729] T 08311452166d4d8cbd6df4dda644c49f P 34d99980d6574e77932800f3a71c9cfb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34d99980d6574e77932800f3a71c9cfb, State: Initialized, Role: FOLLOWER
I20260619 18:44:48.237645 7587 consensus_queue.cc:260] T 08311452166d4d8cbd6df4dda644c49f P 34d99980d6574e77932800f3a71c9cfb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34d99980d6574e77932800f3a71c9cfb" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 36903 } }
I20260619 18:44:48.238391 7587 raft_consensus.cc:388] T 08311452166d4d8cbd6df4dda644c49f P 34d99980d6574e77932800f3a71c9cfb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:48.238692 7587 raft_consensus.cc:482] T 08311452166d4d8cbd6df4dda644c49f P 34d99980d6574e77932800f3a71c9cfb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:48.239017 7587 raft_consensus.cc:3037] T 08311452166d4d8cbd6df4dda644c49f P 34d99980d6574e77932800f3a71c9cfb [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:48.245299 7587 raft_consensus.cc:504] T 08311452166d4d8cbd6df4dda644c49f P 34d99980d6574e77932800f3a71c9cfb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34d99980d6574e77932800f3a71c9cfb" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 36903 } }
I20260619 18:44:48.245996 7587 leader_election.cc:302] T 08311452166d4d8cbd6df4dda644c49f P 34d99980d6574e77932800f3a71c9cfb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 34d99980d6574e77932800f3a71c9cfb; no voters:
I20260619 18:44:48.246577 7587 leader_election.cc:288] T 08311452166d4d8cbd6df4dda644c49f P 34d99980d6574e77932800f3a71c9cfb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:48.246706 7589 raft_consensus.cc:2781] T 08311452166d4d8cbd6df4dda644c49f P 34d99980d6574e77932800f3a71c9cfb [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:48.247465 7589 raft_consensus.cc:686] T 08311452166d4d8cbd6df4dda644c49f P 34d99980d6574e77932800f3a71c9cfb [term 1 LEADER]: Becoming Leader. State: Replica: 34d99980d6574e77932800f3a71c9cfb, State: Running, Role: LEADER
I20260619 18:44:48.248155 7587 ts_tablet_manager.cc:1428] T 08311452166d4d8cbd6df4dda644c49f P 34d99980d6574e77932800f3a71c9cfb: Time spent starting tablet: real 0.018s user 0.015s sys 0.000s
I20260619 18:44:48.248231 7589 consensus_queue.cc:237] T 08311452166d4d8cbd6df4dda644c49f P 34d99980d6574e77932800f3a71c9cfb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34d99980d6574e77932800f3a71c9cfb" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 36903 } }
I20260619 18:44:48.254472 7432 catalog_manager.cc:5495] T 08311452166d4d8cbd6df4dda644c49f P 34d99980d6574e77932800f3a71c9cfb reported cstate change: term changed from 0 to 1, leader changed from <none> to 34d99980d6574e77932800f3a71c9cfb (127.6.120.193). New cstate: current_term: 1 leader_uuid: "34d99980d6574e77932800f3a71c9cfb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34d99980d6574e77932800f3a71c9cfb" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 36903 } health_report { overall_health: HEALTHY } } }
W20260619 18:44:48.286794 7582 meta_cache.cc:788] Not found: LookupRpcById { tablet: 'dummy-tablet-id', attempt: 1 } failed
I20260619 18:44:48.288893 6627 tablet_server.cc:178] TabletServer@127.6.120.193:0 shutting down...
I20260619 18:44:48.316826 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:44:48.317584 6627 tablet_replica.cc:330] T 08311452166d4d8cbd6df4dda644c49f P 34d99980d6574e77932800f3a71c9cfb: stopping tablet replica
I20260619 18:44:48.318171 6627 raft_consensus.cc:2229] T 08311452166d4d8cbd6df4dda644c49f P 34d99980d6574e77932800f3a71c9cfb [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:48.318563 6627 raft_consensus.cc:2258] T 08311452166d4d8cbd6df4dda644c49f P 34d99980d6574e77932800f3a71c9cfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:48.320560 6627 tablet_replica.cc:330] T d774096c8a564b8c8c174b9bf7d2b266 P 34d99980d6574e77932800f3a71c9cfb: stopping tablet replica
I20260619 18:44:48.320971 6627 raft_consensus.cc:2229] T d774096c8a564b8c8c174b9bf7d2b266 P 34d99980d6574e77932800f3a71c9cfb [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:48.321336 6627 raft_consensus.cc:2258] T d774096c8a564b8c8c174b9bf7d2b266 P 34d99980d6574e77932800f3a71c9cfb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:48.343634 6627 tablet_server.cc:194] TabletServer@127.6.120.193:0 shutdown complete.
I20260619 18:44:48.353705 6627 master.cc:537] Master@127.6.120.254:33839 shutting down...
I20260619 18:44:48.375120 6627 raft_consensus.cc:2229] T 00000000000000000000000000000000 P afecd39dc247479d99b1d616172c9a8e [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:48.375694 6627 raft_consensus.cc:2258] T 00000000000000000000000000000000 P afecd39dc247479d99b1d616172c9a8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:48.376185 6627 tablet_replica.cc:330] T 00000000000000000000000000000000 P afecd39dc247479d99b1d616172c9a8e: stopping tablet replica
I20260619 18:44:48.396811 6627 master.cc:552] Master@127.6.120.254:33839 shutdown complete.
[ OK ] ClientTest.TestBasicIdBasedLookup (684 ms)
[ RUN ] ClientTest.TestScannerKeepAlive
I20260619 18:44:48.415772 6627 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.120.254:33139
I20260619 18:44:48.416757 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:48.421674 7596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:48.423204 7597 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:48.424711 7599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:48.425680 6627 server_base.cc:1034] running on GCE node
I20260619 18:44:48.426393 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:48.426589 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:48.426751 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894688426737 us; error 0 us; skew 500 ppm
I20260619 18:44:48.427244 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:48.430016 6627 webserver.cc:460] Webserver started at http://127.6.120.254:34347/ using document root <none> and password file <none>
I20260619 18:44:48.430459 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:48.430649 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:48.430896 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:48.431922 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestScannerKeepAlive.1781894682485826-6627-0/minicluster-data/master-0-root/instance:
uuid: "b998654bc0134111b226683140b327c2"
format_stamp: "Formatted at 2026-06-19 18:44:48 on dist-test-slave-90mn"
I20260619 18:44:48.436223 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.003s
I20260619 18:44:48.439430 7604 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:48.440246 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260619 18:44:48.440551 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestScannerKeepAlive.1781894682485826-6627-0/minicluster-data/master-0-root
uuid: "b998654bc0134111b226683140b327c2"
format_stamp: "Formatted at 2026-06-19 18:44:48 on dist-test-slave-90mn"
I20260619 18:44:48.440901 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestScannerKeepAlive.1781894682485826-6627-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestScannerKeepAlive.1781894682485826-6627-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestScannerKeepAlive.1781894682485826-6627-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:48.455062 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:48.456317 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:48.506965 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.254:33139
I20260619 18:44:48.507030 7665 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.254:33139 every 8 connection(s)
I20260619 18:44:48.511495 7666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:48.520480 7666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b998654bc0134111b226683140b327c2: Bootstrap starting.
I20260619 18:44:48.523988 7666 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b998654bc0134111b226683140b327c2: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:48.527691 7666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b998654bc0134111b226683140b327c2: No bootstrap required, opened a new log
I20260619 18:44:48.529389 7666 raft_consensus.cc:348] T 00000000000000000000000000000000 P b998654bc0134111b226683140b327c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b998654bc0134111b226683140b327c2" member_type: VOTER }
I20260619 18:44:48.529793 7666 raft_consensus.cc:374] T 00000000000000000000000000000000 P b998654bc0134111b226683140b327c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:48.530014 7666 raft_consensus.cc:729] T 00000000000000000000000000000000 P b998654bc0134111b226683140b327c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b998654bc0134111b226683140b327c2, State: Initialized, Role: FOLLOWER
I20260619 18:44:48.530824 7666 consensus_queue.cc:260] T 00000000000000000000000000000000 P b998654bc0134111b226683140b327c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b998654bc0134111b226683140b327c2" member_type: VOTER }
I20260619 18:44:48.531383 7666 raft_consensus.cc:388] T 00000000000000000000000000000000 P b998654bc0134111b226683140b327c2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:48.531653 7666 raft_consensus.cc:482] T 00000000000000000000000000000000 P b998654bc0134111b226683140b327c2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:48.531934 7666 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b998654bc0134111b226683140b327c2 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:48.536437 7666 raft_consensus.cc:504] T 00000000000000000000000000000000 P b998654bc0134111b226683140b327c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b998654bc0134111b226683140b327c2" member_type: VOTER }
I20260619 18:44:48.536978 7666 leader_election.cc:302] T 00000000000000000000000000000000 P b998654bc0134111b226683140b327c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b998654bc0134111b226683140b327c2; no voters:
I20260619 18:44:48.538388 7666 leader_election.cc:288] T 00000000000000000000000000000000 P b998654bc0134111b226683140b327c2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:48.538676 7669 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b998654bc0134111b226683140b327c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:48.540380 7669 raft_consensus.cc:686] T 00000000000000000000000000000000 P b998654bc0134111b226683140b327c2 [term 1 LEADER]: Becoming Leader. State: Replica: b998654bc0134111b226683140b327c2, State: Running, Role: LEADER
I20260619 18:44:48.541108 7669 consensus_queue.cc:237] T 00000000000000000000000000000000 P b998654bc0134111b226683140b327c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b998654bc0134111b226683140b327c2" member_type: VOTER }
I20260619 18:44:48.541888 7666 sys_catalog.cc:564] T 00000000000000000000000000000000 P b998654bc0134111b226683140b327c2 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 18:44:48.544242 7670 sys_catalog.cc:455] T 00000000000000000000000000000000 P b998654bc0134111b226683140b327c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b998654bc0134111b226683140b327c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b998654bc0134111b226683140b327c2" member_type: VOTER } }
I20260619 18:44:48.544334 7671 sys_catalog.cc:455] T 00000000000000000000000000000000 P b998654bc0134111b226683140b327c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b998654bc0134111b226683140b327c2. Latest consensus state: current_term: 1 leader_uuid: "b998654bc0134111b226683140b327c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b998654bc0134111b226683140b327c2" member_type: VOTER } }
I20260619 18:44:48.544791 7670 sys_catalog.cc:458] T 00000000000000000000000000000000 P b998654bc0134111b226683140b327c2 [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:48.544924 7671 sys_catalog.cc:458] T 00000000000000000000000000000000 P b998654bc0134111b226683140b327c2 [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:48.547153 7674 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 18:44:48.556546 7674 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 18:44:48.568717 7674 catalog_manager.cc:1347] Generated new cluster ID: 3c54d841bbd14176940426ff9a44ebd1
I20260619 18:44:48.569121 7674 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 18:44:48.572057 6627 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260619 18:44:48.606534 7674 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 18:44:48.608721 7674 catalog_manager.cc:1504] Loading token signing keys...
I20260619 18:44:48.627256 7674 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b998654bc0134111b226683140b327c2: Generated new TSK 0
I20260619 18:44:48.628014 7674 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 18:44:48.638217 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:48.645205 7687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:48.645498 7688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:48.648567 6627 server_base.cc:1034] running on GCE node
W20260619 18:44:48.649391 7691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:48.650372 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:48.650611 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:48.650812 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894688650796 us; error 0 us; skew 500 ppm
I20260619 18:44:48.651387 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:48.654558 6627 webserver.cc:460] Webserver started at http://127.6.120.193:38191/ using document root <none> and password file <none>
I20260619 18:44:48.655059 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:48.655377 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:48.655671 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:48.657012 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestScannerKeepAlive.1781894682485826-6627-0/minicluster-data/ts-0-root/instance:
uuid: "b0ea7616abb54bba90a5bd6f7e90d3ad"
format_stamp: "Formatted at 2026-06-19 18:44:48 on dist-test-slave-90mn"
I20260619 18:44:48.662101 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260619 18:44:48.666123 7695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:48.667101 6627 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260619 18:44:48.667444 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestScannerKeepAlive.1781894682485826-6627-0/minicluster-data/ts-0-root
uuid: "b0ea7616abb54bba90a5bd6f7e90d3ad"
format_stamp: "Formatted at 2026-06-19 18:44:48 on dist-test-slave-90mn"
I20260619 18:44:48.667799 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestScannerKeepAlive.1781894682485826-6627-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestScannerKeepAlive.1781894682485826-6627-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestScannerKeepAlive.1781894682485826-6627-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:48.687987 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:48.689306 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:48.696736 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:44:48.697024 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:48.697306 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:44:48.697505 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:48.766870 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.193:40511
I20260619 18:44:48.766973 7765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.193:40511 every 8 connection(s)
I20260619 18:44:48.771775 7766 heartbeater.cc:347] Connected to a master server at 127.6.120.254:33139
I20260619 18:44:48.772140 7766 heartbeater.cc:464] Registering TS with master...
I20260619 18:44:48.772812 7766 heartbeater.cc:511] Master 127.6.120.254:33139 requested a full tablet report, sending...
I20260619 18:44:48.774791 7621 ts_manager.cc:194] Registered new tserver with Master: b0ea7616abb54bba90a5bd6f7e90d3ad (127.6.120.193:40511)
I20260619 18:44:48.775228 6627 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.004908138s
I20260619 18:44:48.776857 7621 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34974
I20260619 18:44:48.789945 7766 heartbeater.cc:503] Master 127.6.120.254:33139 was elected leader, sending a full tablet report...
I20260619 18:44:48.805248 7621 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34996:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 18:44:48.850605 7731 tablet_service.cc:1467] Processing CreateTablet for tablet 4d1779832cd84fb7ae3328bf7f0d1afe (DEFAULT_TABLE table=client-testtb [id=1657b29b3af9434397328b3938f36c07]), partition=RANGE (key) PARTITION VALUES < 9
I20260619 18:44:48.850837 7730 tablet_service.cc:1467] Processing CreateTablet for tablet d4fdffee302e4f97a0027db93b9ef851 (DEFAULT_TABLE table=client-testtb [id=1657b29b3af9434397328b3938f36c07]), partition=RANGE (key) PARTITION 9 <= VALUES
I20260619 18:44:48.851931 7731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d1779832cd84fb7ae3328bf7f0d1afe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:48.852631 7730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4fdffee302e4f97a0027db93b9ef851. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:48.868927 7776 tablet_bootstrap.cc:492] T 4d1779832cd84fb7ae3328bf7f0d1afe P b0ea7616abb54bba90a5bd6f7e90d3ad: Bootstrap starting.
I20260619 18:44:48.874943 7776 tablet_bootstrap.cc:654] T 4d1779832cd84fb7ae3328bf7f0d1afe P b0ea7616abb54bba90a5bd6f7e90d3ad: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:48.879158 7776 tablet_bootstrap.cc:492] T 4d1779832cd84fb7ae3328bf7f0d1afe P b0ea7616abb54bba90a5bd6f7e90d3ad: No bootstrap required, opened a new log
I20260619 18:44:48.879527 7776 ts_tablet_manager.cc:1397] T 4d1779832cd84fb7ae3328bf7f0d1afe P b0ea7616abb54bba90a5bd6f7e90d3ad: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260619 18:44:48.881294 7776 raft_consensus.cc:348] T 4d1779832cd84fb7ae3328bf7f0d1afe P b0ea7616abb54bba90a5bd6f7e90d3ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0ea7616abb54bba90a5bd6f7e90d3ad" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40511 } }
I20260619 18:44:48.881678 7776 raft_consensus.cc:374] T 4d1779832cd84fb7ae3328bf7f0d1afe P b0ea7616abb54bba90a5bd6f7e90d3ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:48.881927 7776 raft_consensus.cc:729] T 4d1779832cd84fb7ae3328bf7f0d1afe P b0ea7616abb54bba90a5bd6f7e90d3ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0ea7616abb54bba90a5bd6f7e90d3ad, State: Initialized, Role: FOLLOWER
I20260619 18:44:48.882458 7776 consensus_queue.cc:260] T 4d1779832cd84fb7ae3328bf7f0d1afe P b0ea7616abb54bba90a5bd6f7e90d3ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0ea7616abb54bba90a5bd6f7e90d3ad" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40511 } }
I20260619 18:44:48.883034 7776 raft_consensus.cc:388] T 4d1779832cd84fb7ae3328bf7f0d1afe P b0ea7616abb54bba90a5bd6f7e90d3ad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:48.883329 7776 raft_consensus.cc:482] T 4d1779832cd84fb7ae3328bf7f0d1afe P b0ea7616abb54bba90a5bd6f7e90d3ad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:48.883639 7776 raft_consensus.cc:3037] T 4d1779832cd84fb7ae3328bf7f0d1afe P b0ea7616abb54bba90a5bd6f7e90d3ad [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:48.889220 7776 raft_consensus.cc:504] T 4d1779832cd84fb7ae3328bf7f0d1afe P b0ea7616abb54bba90a5bd6f7e90d3ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0ea7616abb54bba90a5bd6f7e90d3ad" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40511 } }
I20260619 18:44:48.889798 7776 leader_election.cc:302] T 4d1779832cd84fb7ae3328bf7f0d1afe P b0ea7616abb54bba90a5bd6f7e90d3ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b0ea7616abb54bba90a5bd6f7e90d3ad; no voters:
I20260619 18:44:48.891079 7776 leader_election.cc:288] T 4d1779832cd84fb7ae3328bf7f0d1afe P b0ea7616abb54bba90a5bd6f7e90d3ad [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:48.891448 7778 raft_consensus.cc:2781] T 4d1779832cd84fb7ae3328bf7f0d1afe P b0ea7616abb54bba90a5bd6f7e90d3ad [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:48.893518 7776 ts_tablet_manager.cc:1428] T 4d1779832cd84fb7ae3328bf7f0d1afe P b0ea7616abb54bba90a5bd6f7e90d3ad: Time spent starting tablet: real 0.014s user 0.013s sys 0.001s
I20260619 18:44:48.894188 7776 tablet_bootstrap.cc:492] T d4fdffee302e4f97a0027db93b9ef851 P b0ea7616abb54bba90a5bd6f7e90d3ad: Bootstrap starting.
I20260619 18:44:48.898844 7776 tablet_bootstrap.cc:654] T d4fdffee302e4f97a0027db93b9ef851 P b0ea7616abb54bba90a5bd6f7e90d3ad: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:48.899196 7778 raft_consensus.cc:686] T 4d1779832cd84fb7ae3328bf7f0d1afe P b0ea7616abb54bba90a5bd6f7e90d3ad [term 1 LEADER]: Becoming Leader. State: Replica: b0ea7616abb54bba90a5bd6f7e90d3ad, State: Running, Role: LEADER
I20260619 18:44:48.899955 7778 consensus_queue.cc:237] T 4d1779832cd84fb7ae3328bf7f0d1afe P b0ea7616abb54bba90a5bd6f7e90d3ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0ea7616abb54bba90a5bd6f7e90d3ad" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40511 } }
I20260619 18:44:48.905211 7776 tablet_bootstrap.cc:492] T d4fdffee302e4f97a0027db93b9ef851 P b0ea7616abb54bba90a5bd6f7e90d3ad: No bootstrap required, opened a new log
I20260619 18:44:48.905665 7776 ts_tablet_manager.cc:1397] T d4fdffee302e4f97a0027db93b9ef851 P b0ea7616abb54bba90a5bd6f7e90d3ad: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.002s
I20260619 18:44:48.907433 7620 catalog_manager.cc:5495] T 4d1779832cd84fb7ae3328bf7f0d1afe P b0ea7616abb54bba90a5bd6f7e90d3ad reported cstate change: term changed from 0 to 1, leader changed from <none> to b0ea7616abb54bba90a5bd6f7e90d3ad (127.6.120.193). New cstate: current_term: 1 leader_uuid: "b0ea7616abb54bba90a5bd6f7e90d3ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0ea7616abb54bba90a5bd6f7e90d3ad" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40511 } health_report { overall_health: HEALTHY } } }
I20260619 18:44:48.908056 7776 raft_consensus.cc:348] T d4fdffee302e4f97a0027db93b9ef851 P b0ea7616abb54bba90a5bd6f7e90d3ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0ea7616abb54bba90a5bd6f7e90d3ad" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40511 } }
I20260619 18:44:48.908615 7776 raft_consensus.cc:374] T d4fdffee302e4f97a0027db93b9ef851 P b0ea7616abb54bba90a5bd6f7e90d3ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:48.908890 7776 raft_consensus.cc:729] T d4fdffee302e4f97a0027db93b9ef851 P b0ea7616abb54bba90a5bd6f7e90d3ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0ea7616abb54bba90a5bd6f7e90d3ad, State: Initialized, Role: FOLLOWER
I20260619 18:44:48.909603 7776 consensus_queue.cc:260] T d4fdffee302e4f97a0027db93b9ef851 P b0ea7616abb54bba90a5bd6f7e90d3ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0ea7616abb54bba90a5bd6f7e90d3ad" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40511 } }
I20260619 18:44:48.910224 7776 raft_consensus.cc:388] T d4fdffee302e4f97a0027db93b9ef851 P b0ea7616abb54bba90a5bd6f7e90d3ad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:48.910614 7776 raft_consensus.cc:482] T d4fdffee302e4f97a0027db93b9ef851 P b0ea7616abb54bba90a5bd6f7e90d3ad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:48.910950 7776 raft_consensus.cc:3037] T d4fdffee302e4f97a0027db93b9ef851 P b0ea7616abb54bba90a5bd6f7e90d3ad [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:48.917418 7776 raft_consensus.cc:504] T d4fdffee302e4f97a0027db93b9ef851 P b0ea7616abb54bba90a5bd6f7e90d3ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0ea7616abb54bba90a5bd6f7e90d3ad" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40511 } }
I20260619 18:44:48.918118 7776 leader_election.cc:302] T d4fdffee302e4f97a0027db93b9ef851 P b0ea7616abb54bba90a5bd6f7e90d3ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b0ea7616abb54bba90a5bd6f7e90d3ad; no voters:
I20260619 18:44:48.918869 7780 raft_consensus.cc:2781] T d4fdffee302e4f97a0027db93b9ef851 P b0ea7616abb54bba90a5bd6f7e90d3ad [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:48.919320 7780 raft_consensus.cc:686] T d4fdffee302e4f97a0027db93b9ef851 P b0ea7616abb54bba90a5bd6f7e90d3ad [term 1 LEADER]: Becoming Leader. State: Replica: b0ea7616abb54bba90a5bd6f7e90d3ad, State: Running, Role: LEADER
I20260619 18:44:48.919999 7780 consensus_queue.cc:237] T d4fdffee302e4f97a0027db93b9ef851 P b0ea7616abb54bba90a5bd6f7e90d3ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0ea7616abb54bba90a5bd6f7e90d3ad" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40511 } }
I20260619 18:44:48.921133 7776 leader_election.cc:288] T d4fdffee302e4f97a0027db93b9ef851 P b0ea7616abb54bba90a5bd6f7e90d3ad [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:48.923386 7776 ts_tablet_manager.cc:1428] T d4fdffee302e4f97a0027db93b9ef851 P b0ea7616abb54bba90a5bd6f7e90d3ad: Time spent starting tablet: real 0.017s user 0.012s sys 0.003s
I20260619 18:44:48.935878 7620 catalog_manager.cc:5495] T d4fdffee302e4f97a0027db93b9ef851 P b0ea7616abb54bba90a5bd6f7e90d3ad reported cstate change: term changed from 0 to 1, leader changed from <none> to b0ea7616abb54bba90a5bd6f7e90d3ad (127.6.120.193). New cstate: current_term: 1 leader_uuid: "b0ea7616abb54bba90a5bd6f7e90d3ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0ea7616abb54bba90a5bd6f7e90d3ad" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40511 } health_report { overall_health: HEALTHY } } }
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:2918: Skipped
test is skipped; set KUDU_ALLOW_SLOW_TESTS=1 to run
I20260619 18:44:48.953955 6627 tablet_server.cc:178] TabletServer@127.6.120.193:0 shutting down...
I20260619 18:44:48.989885 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:44:48.990658 6627 tablet_replica.cc:330] T d4fdffee302e4f97a0027db93b9ef851 P b0ea7616abb54bba90a5bd6f7e90d3ad: stopping tablet replica
I20260619 18:44:48.991271 6627 raft_consensus.cc:2229] T d4fdffee302e4f97a0027db93b9ef851 P b0ea7616abb54bba90a5bd6f7e90d3ad [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:48.991743 6627 raft_consensus.cc:2258] T d4fdffee302e4f97a0027db93b9ef851 P b0ea7616abb54bba90a5bd6f7e90d3ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:48.994398 6627 tablet_replica.cc:330] T 4d1779832cd84fb7ae3328bf7f0d1afe P b0ea7616abb54bba90a5bd6f7e90d3ad: stopping tablet replica
I20260619 18:44:48.994967 6627 raft_consensus.cc:2229] T 4d1779832cd84fb7ae3328bf7f0d1afe P b0ea7616abb54bba90a5bd6f7e90d3ad [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:48.995410 6627 raft_consensus.cc:2258] T 4d1779832cd84fb7ae3328bf7f0d1afe P b0ea7616abb54bba90a5bd6f7e90d3ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:49.008723 6627 tablet_server.cc:194] TabletServer@127.6.120.193:0 shutdown complete.
I20260619 18:44:49.017922 6627 master.cc:537] Master@127.6.120.254:33139 shutting down...
I20260619 18:44:49.036304 6627 raft_consensus.cc:2229] T 00000000000000000000000000000000 P b998654bc0134111b226683140b327c2 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:49.036834 6627 raft_consensus.cc:2258] T 00000000000000000000000000000000 P b998654bc0134111b226683140b327c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:49.037287 6627 tablet_replica.cc:330] T 00000000000000000000000000000000 P b998654bc0134111b226683140b327c2: stopping tablet replica
I20260619 18:44:49.046329 6627 master.cc:552] Master@127.6.120.254:33139 shutdown complete.
[ SKIPPED ] ClientTest.TestScannerKeepAlive (649 ms)
[ RUN ] ClientTest.TestInsertAutoFlushSync
I20260619 18:44:49.065744 6627 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.120.254:37697
I20260619 18:44:49.066684 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:49.071422 7785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:49.072532 7786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:49.073119 7788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:49.074352 6627 server_base.cc:1034] running on GCE node
I20260619 18:44:49.074978 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:49.075134 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:49.075240 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894689075232 us; error 0 us; skew 500 ppm
I20260619 18:44:49.075711 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:49.082327 6627 webserver.cc:460] Webserver started at http://127.6.120.254:36873/ using document root <none> and password file <none>
I20260619 18:44:49.082736 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:49.082878 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:49.083081 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:49.084039 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestInsertAutoFlushSync.1781894682485826-6627-0/minicluster-data/master-0-root/instance:
uuid: "778ea6bfc65549edae3af5244b7cd0c7"
format_stamp: "Formatted at 2026-06-19 18:44:49 on dist-test-slave-90mn"
I20260619 18:44:49.087978 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260619 18:44:49.090910 7793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:49.091604 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260619 18:44:49.091864 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestInsertAutoFlushSync.1781894682485826-6627-0/minicluster-data/master-0-root
uuid: "778ea6bfc65549edae3af5244b7cd0c7"
format_stamp: "Formatted at 2026-06-19 18:44:49 on dist-test-slave-90mn"
I20260619 18:44:49.092176 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestInsertAutoFlushSync.1781894682485826-6627-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestInsertAutoFlushSync.1781894682485826-6627-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestInsertAutoFlushSync.1781894682485826-6627-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:49.117709 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:49.118701 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:49.157665 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.254:37697
I20260619 18:44:49.157765 7854 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.254:37697 every 8 connection(s)
I20260619 18:44:49.161386 7855 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:49.170183 7855 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 778ea6bfc65549edae3af5244b7cd0c7: Bootstrap starting.
I20260619 18:44:49.173739 7855 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 778ea6bfc65549edae3af5244b7cd0c7: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:49.177168 7855 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 778ea6bfc65549edae3af5244b7cd0c7: No bootstrap required, opened a new log
I20260619 18:44:49.178809 7855 raft_consensus.cc:348] T 00000000000000000000000000000000 P 778ea6bfc65549edae3af5244b7cd0c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "778ea6bfc65549edae3af5244b7cd0c7" member_type: VOTER }
I20260619 18:44:49.179157 7855 raft_consensus.cc:374] T 00000000000000000000000000000000 P 778ea6bfc65549edae3af5244b7cd0c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:49.179322 7855 raft_consensus.cc:729] T 00000000000000000000000000000000 P 778ea6bfc65549edae3af5244b7cd0c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 778ea6bfc65549edae3af5244b7cd0c7, State: Initialized, Role: FOLLOWER
I20260619 18:44:49.179749 7855 consensus_queue.cc:260] T 00000000000000000000000000000000 P 778ea6bfc65549edae3af5244b7cd0c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "778ea6bfc65549edae3af5244b7cd0c7" member_type: VOTER }
I20260619 18:44:49.180142 7855 raft_consensus.cc:388] T 00000000000000000000000000000000 P 778ea6bfc65549edae3af5244b7cd0c7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:49.180383 7855 raft_consensus.cc:482] T 00000000000000000000000000000000 P 778ea6bfc65549edae3af5244b7cd0c7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:49.180579 7855 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 778ea6bfc65549edae3af5244b7cd0c7 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:49.184324 7855 raft_consensus.cc:504] T 00000000000000000000000000000000 P 778ea6bfc65549edae3af5244b7cd0c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "778ea6bfc65549edae3af5244b7cd0c7" member_type: VOTER }
I20260619 18:44:49.184767 7855 leader_election.cc:302] T 00000000000000000000000000000000 P 778ea6bfc65549edae3af5244b7cd0c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 778ea6bfc65549edae3af5244b7cd0c7; no voters:
I20260619 18:44:49.185755 7855 leader_election.cc:288] T 00000000000000000000000000000000 P 778ea6bfc65549edae3af5244b7cd0c7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:49.186048 7858 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 778ea6bfc65549edae3af5244b7cd0c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:49.187286 7858 raft_consensus.cc:686] T 00000000000000000000000000000000 P 778ea6bfc65549edae3af5244b7cd0c7 [term 1 LEADER]: Becoming Leader. State: Replica: 778ea6bfc65549edae3af5244b7cd0c7, State: Running, Role: LEADER
I20260619 18:44:49.187898 7858 consensus_queue.cc:237] T 00000000000000000000000000000000 P 778ea6bfc65549edae3af5244b7cd0c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "778ea6bfc65549edae3af5244b7cd0c7" member_type: VOTER }
I20260619 18:44:49.188474 7855 sys_catalog.cc:564] T 00000000000000000000000000000000 P 778ea6bfc65549edae3af5244b7cd0c7 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 18:44:49.190737 7860 sys_catalog.cc:455] T 00000000000000000000000000000000 P 778ea6bfc65549edae3af5244b7cd0c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 778ea6bfc65549edae3af5244b7cd0c7. Latest consensus state: current_term: 1 leader_uuid: "778ea6bfc65549edae3af5244b7cd0c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "778ea6bfc65549edae3af5244b7cd0c7" member_type: VOTER } }
I20260619 18:44:49.190673 7859 sys_catalog.cc:455] T 00000000000000000000000000000000 P 778ea6bfc65549edae3af5244b7cd0c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "778ea6bfc65549edae3af5244b7cd0c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "778ea6bfc65549edae3af5244b7cd0c7" member_type: VOTER } }
I20260619 18:44:49.191346 7860 sys_catalog.cc:458] T 00000000000000000000000000000000 P 778ea6bfc65549edae3af5244b7cd0c7 [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:49.191633 7859 sys_catalog.cc:458] T 00000000000000000000000000000000 P 778ea6bfc65549edae3af5244b7cd0c7 [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:49.202934 7864 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 18:44:49.203282 6627 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260619 18:44:49.207172 7864 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 18:44:49.214735 7864 catalog_manager.cc:1347] Generated new cluster ID: 1adb68dd43304dc9af98528681dd333c
I20260619 18:44:49.214936 7864 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 18:44:49.228891 7864 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 18:44:49.230397 7864 catalog_manager.cc:1504] Loading token signing keys...
I20260619 18:44:49.247431 7864 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 778ea6bfc65549edae3af5244b7cd0c7: Generated new TSK 0
I20260619 18:44:49.248063 7864 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 18:44:49.269734 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:49.275111 7876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:49.276312 7877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:49.278129 6627 server_base.cc:1034] running on GCE node
W20260619 18:44:49.278357 7879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:49.279197 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:49.279423 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:49.279588 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894689279574 us; error 0 us; skew 500 ppm
I20260619 18:44:49.280062 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:49.282227 6627 webserver.cc:460] Webserver started at http://127.6.120.193:35083/ using document root <none> and password file <none>
I20260619 18:44:49.282699 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:49.282903 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:49.283150 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:49.284197 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestInsertAutoFlushSync.1781894682485826-6627-0/minicluster-data/ts-0-root/instance:
uuid: "6629f34ae6e54eeaae9afb1bebf86a3a"
format_stamp: "Formatted at 2026-06-19 18:44:49 on dist-test-slave-90mn"
I20260619 18:44:49.288324 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260619 18:44:49.293159 7884 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:49.294417 6627 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.005s sys 0.000s
I20260619 18:44:49.294740 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestInsertAutoFlushSync.1781894682485826-6627-0/minicluster-data/ts-0-root
uuid: "6629f34ae6e54eeaae9afb1bebf86a3a"
format_stamp: "Formatted at 2026-06-19 18:44:49 on dist-test-slave-90mn"
I20260619 18:44:49.295038 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestInsertAutoFlushSync.1781894682485826-6627-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestInsertAutoFlushSync.1781894682485826-6627-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestInsertAutoFlushSync.1781894682485826-6627-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:49.309765 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:49.310734 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:49.317157 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:44:49.317454 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:49.317744 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:44:49.317965 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:49.365494 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.193:44049
I20260619 18:44:49.365605 7954 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.193:44049 every 8 connection(s)
I20260619 18:44:49.369814 7955 heartbeater.cc:347] Connected to a master server at 127.6.120.254:37697
I20260619 18:44:49.370122 7955 heartbeater.cc:464] Registering TS with master...
I20260619 18:44:49.370973 7955 heartbeater.cc:511] Master 127.6.120.254:37697 requested a full tablet report, sending...
I20260619 18:44:49.373445 7810 ts_manager.cc:194] Registered new tserver with Master: 6629f34ae6e54eeaae9afb1bebf86a3a (127.6.120.193:44049)
I20260619 18:44:49.374404 6627 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.005989052s
I20260619 18:44:49.376560 7810 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45822
I20260619 18:44:49.390715 7955 heartbeater.cc:503] Master 127.6.120.254:37697 was elected leader, sending a full tablet report...
I20260619 18:44:49.398259 7810 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45830:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 18:44:49.428946 7920 tablet_service.cc:1467] Processing CreateTablet for tablet 3569f60c88724db1bb0e7f8623abc6c4 (DEFAULT_TABLE table=client-testtb [id=f3c18c801b04426fac46d5a7334db896]), partition=RANGE (key) PARTITION VALUES < 9
I20260619 18:44:49.429255 7919 tablet_service.cc:1467] Processing CreateTablet for tablet 5cd15ab046994eeebecaf6721288a442 (DEFAULT_TABLE table=client-testtb [id=f3c18c801b04426fac46d5a7334db896]), partition=RANGE (key) PARTITION 9 <= VALUES
I20260619 18:44:49.429917 7920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3569f60c88724db1bb0e7f8623abc6c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:49.430477 7919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5cd15ab046994eeebecaf6721288a442. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:49.442348 7965 tablet_bootstrap.cc:492] T 5cd15ab046994eeebecaf6721288a442 P 6629f34ae6e54eeaae9afb1bebf86a3a: Bootstrap starting.
I20260619 18:44:49.446785 7965 tablet_bootstrap.cc:654] T 5cd15ab046994eeebecaf6721288a442 P 6629f34ae6e54eeaae9afb1bebf86a3a: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:49.450543 7965 tablet_bootstrap.cc:492] T 5cd15ab046994eeebecaf6721288a442 P 6629f34ae6e54eeaae9afb1bebf86a3a: No bootstrap required, opened a new log
I20260619 18:44:49.450832 7965 ts_tablet_manager.cc:1397] T 5cd15ab046994eeebecaf6721288a442 P 6629f34ae6e54eeaae9afb1bebf86a3a: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.004s
I20260619 18:44:49.452492 7965 raft_consensus.cc:348] T 5cd15ab046994eeebecaf6721288a442 P 6629f34ae6e54eeaae9afb1bebf86a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6629f34ae6e54eeaae9afb1bebf86a3a" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 44049 } }
I20260619 18:44:49.452970 7965 raft_consensus.cc:374] T 5cd15ab046994eeebecaf6721288a442 P 6629f34ae6e54eeaae9afb1bebf86a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:49.453264 7965 raft_consensus.cc:729] T 5cd15ab046994eeebecaf6721288a442 P 6629f34ae6e54eeaae9afb1bebf86a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6629f34ae6e54eeaae9afb1bebf86a3a, State: Initialized, Role: FOLLOWER
I20260619 18:44:49.453902 7965 consensus_queue.cc:260] T 5cd15ab046994eeebecaf6721288a442 P 6629f34ae6e54eeaae9afb1bebf86a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6629f34ae6e54eeaae9afb1bebf86a3a" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 44049 } }
I20260619 18:44:49.454442 7965 raft_consensus.cc:388] T 5cd15ab046994eeebecaf6721288a442 P 6629f34ae6e54eeaae9afb1bebf86a3a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:49.454632 7965 raft_consensus.cc:482] T 5cd15ab046994eeebecaf6721288a442 P 6629f34ae6e54eeaae9afb1bebf86a3a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:49.454829 7965 raft_consensus.cc:3037] T 5cd15ab046994eeebecaf6721288a442 P 6629f34ae6e54eeaae9afb1bebf86a3a [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:49.458907 7965 raft_consensus.cc:504] T 5cd15ab046994eeebecaf6721288a442 P 6629f34ae6e54eeaae9afb1bebf86a3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6629f34ae6e54eeaae9afb1bebf86a3a" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 44049 } }
I20260619 18:44:49.459476 7965 leader_election.cc:302] T 5cd15ab046994eeebecaf6721288a442 P 6629f34ae6e54eeaae9afb1bebf86a3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6629f34ae6e54eeaae9afb1bebf86a3a; no voters:
I20260619 18:44:49.460812 7965 leader_election.cc:288] T 5cd15ab046994eeebecaf6721288a442 P 6629f34ae6e54eeaae9afb1bebf86a3a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:49.461141 7967 raft_consensus.cc:2781] T 5cd15ab046994eeebecaf6721288a442 P 6629f34ae6e54eeaae9afb1bebf86a3a [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:49.463188 7965 ts_tablet_manager.cc:1428] T 5cd15ab046994eeebecaf6721288a442 P 6629f34ae6e54eeaae9afb1bebf86a3a: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20260619 18:44:49.463411 7967 raft_consensus.cc:686] T 5cd15ab046994eeebecaf6721288a442 P 6629f34ae6e54eeaae9afb1bebf86a3a [term 1 LEADER]: Becoming Leader. State: Replica: 6629f34ae6e54eeaae9afb1bebf86a3a, State: Running, Role: LEADER
I20260619 18:44:49.464017 7965 tablet_bootstrap.cc:492] T 3569f60c88724db1bb0e7f8623abc6c4 P 6629f34ae6e54eeaae9afb1bebf86a3a: Bootstrap starting.
I20260619 18:44:49.464035 7967 consensus_queue.cc:237] T 5cd15ab046994eeebecaf6721288a442 P 6629f34ae6e54eeaae9afb1bebf86a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6629f34ae6e54eeaae9afb1bebf86a3a" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 44049 } }
I20260619 18:44:49.468780 7965 tablet_bootstrap.cc:654] T 3569f60c88724db1bb0e7f8623abc6c4 P 6629f34ae6e54eeaae9afb1bebf86a3a: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:49.469918 7810 catalog_manager.cc:5495] T 5cd15ab046994eeebecaf6721288a442 P 6629f34ae6e54eeaae9afb1bebf86a3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6629f34ae6e54eeaae9afb1bebf86a3a (127.6.120.193). New cstate: current_term: 1 leader_uuid: "6629f34ae6e54eeaae9afb1bebf86a3a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6629f34ae6e54eeaae9afb1bebf86a3a" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 44049 } health_report { overall_health: HEALTHY } } }
I20260619 18:44:49.472640 7965 tablet_bootstrap.cc:492] T 3569f60c88724db1bb0e7f8623abc6c4 P 6629f34ae6e54eeaae9afb1bebf86a3a: No bootstrap required, opened a new log
I20260619 18:44:49.472987 7965 ts_tablet_manager.cc:1397] T 3569f60c88724db1bb0e7f8623abc6c4 P 6629f34ae6e54eeaae9afb1bebf86a3a: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260619 18:44:49.474815 7965 raft_consensus.cc:348] T 3569f60c88724db1bb0e7f8623abc6c4 P 6629f34ae6e54eeaae9afb1bebf86a3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6629f34ae6e54eeaae9afb1bebf86a3a" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 44049 } }
I20260619 18:44:49.475237 7965 raft_consensus.cc:374] T 3569f60c88724db1bb0e7f8623abc6c4 P 6629f34ae6e54eeaae9afb1bebf86a3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:49.475525 7965 raft_consensus.cc:729] T 3569f60c88724db1bb0e7f8623abc6c4 P 6629f34ae6e54eeaae9afb1bebf86a3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6629f34ae6e54eeaae9afb1bebf86a3a, State: Initialized, Role: FOLLOWER
I20260619 18:44:49.476146 7965 consensus_queue.cc:260] T 3569f60c88724db1bb0e7f8623abc6c4 P 6629f34ae6e54eeaae9afb1bebf86a3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6629f34ae6e54eeaae9afb1bebf86a3a" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 44049 } }
I20260619 18:44:49.476694 7965 raft_consensus.cc:388] T 3569f60c88724db1bb0e7f8623abc6c4 P 6629f34ae6e54eeaae9afb1bebf86a3a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:49.476941 7965 raft_consensus.cc:482] T 3569f60c88724db1bb0e7f8623abc6c4 P 6629f34ae6e54eeaae9afb1bebf86a3a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:49.477236 7965 raft_consensus.cc:3037] T 3569f60c88724db1bb0e7f8623abc6c4 P 6629f34ae6e54eeaae9afb1bebf86a3a [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:49.481997 7965 raft_consensus.cc:504] T 3569f60c88724db1bb0e7f8623abc6c4 P 6629f34ae6e54eeaae9afb1bebf86a3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6629f34ae6e54eeaae9afb1bebf86a3a" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 44049 } }
I20260619 18:44:49.482534 7965 leader_election.cc:302] T 3569f60c88724db1bb0e7f8623abc6c4 P 6629f34ae6e54eeaae9afb1bebf86a3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6629f34ae6e54eeaae9afb1bebf86a3a; no voters:
I20260619 18:44:49.483035 7965 leader_election.cc:288] T 3569f60c88724db1bb0e7f8623abc6c4 P 6629f34ae6e54eeaae9afb1bebf86a3a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:49.483173 7967 raft_consensus.cc:2781] T 3569f60c88724db1bb0e7f8623abc6c4 P 6629f34ae6e54eeaae9afb1bebf86a3a [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:49.483683 7967 raft_consensus.cc:686] T 3569f60c88724db1bb0e7f8623abc6c4 P 6629f34ae6e54eeaae9afb1bebf86a3a [term 1 LEADER]: Becoming Leader. State: Replica: 6629f34ae6e54eeaae9afb1bebf86a3a, State: Running, Role: LEADER
I20260619 18:44:49.484391 7965 ts_tablet_manager.cc:1428] T 3569f60c88724db1bb0e7f8623abc6c4 P 6629f34ae6e54eeaae9afb1bebf86a3a: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s
I20260619 18:44:49.484347 7967 consensus_queue.cc:237] T 3569f60c88724db1bb0e7f8623abc6c4 P 6629f34ae6e54eeaae9afb1bebf86a3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6629f34ae6e54eeaae9afb1bebf86a3a" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 44049 } }
I20260619 18:44:49.489761 7810 catalog_manager.cc:5495] T 3569f60c88724db1bb0e7f8623abc6c4 P 6629f34ae6e54eeaae9afb1bebf86a3a reported cstate change: term changed from 0 to 1, leader changed from <none> to 6629f34ae6e54eeaae9afb1bebf86a3a (127.6.120.193). New cstate: current_term: 1 leader_uuid: "6629f34ae6e54eeaae9afb1bebf86a3a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6629f34ae6e54eeaae9afb1bebf86a3a" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 44049 } health_report { overall_health: HEALTHY } } }
I20260619 18:44:50.230428 6627 tablet_server.cc:178] TabletServer@127.6.120.193:0 shutting down...
I20260619 18:44:50.246632 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:44:50.247189 6627 tablet_replica.cc:330] T 3569f60c88724db1bb0e7f8623abc6c4 P 6629f34ae6e54eeaae9afb1bebf86a3a: stopping tablet replica
I20260619 18:44:50.247718 6627 raft_consensus.cc:2229] T 3569f60c88724db1bb0e7f8623abc6c4 P 6629f34ae6e54eeaae9afb1bebf86a3a [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:50.248209 6627 raft_consensus.cc:2258] T 3569f60c88724db1bb0e7f8623abc6c4 P 6629f34ae6e54eeaae9afb1bebf86a3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:50.249917 6627 tablet_replica.cc:330] T 5cd15ab046994eeebecaf6721288a442 P 6629f34ae6e54eeaae9afb1bebf86a3a: stopping tablet replica
I20260619 18:44:50.250402 6627 raft_consensus.cc:2229] T 5cd15ab046994eeebecaf6721288a442 P 6629f34ae6e54eeaae9afb1bebf86a3a [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:50.250794 6627 raft_consensus.cc:2258] T 5cd15ab046994eeebecaf6721288a442 P 6629f34ae6e54eeaae9afb1bebf86a3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:50.260280 6627 tablet_server.cc:194] TabletServer@127.6.120.193:0 shutdown complete.
I20260619 18:44:50.268940 6627 master.cc:537] Master@127.6.120.254:37697 shutting down...
I20260619 18:44:50.285832 6627 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 778ea6bfc65549edae3af5244b7cd0c7 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:50.286291 6627 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 778ea6bfc65549edae3af5244b7cd0c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:50.286586 6627 tablet_replica.cc:330] T 00000000000000000000000000000000 P 778ea6bfc65549edae3af5244b7cd0c7: stopping tablet replica
I20260619 18:44:50.303606 6627 master.cc:552] Master@127.6.120.254:37697 shutdown complete.
[ OK ] ClientTest.TestInsertAutoFlushSync (1258 ms)
[ RUN ] ClientTest.TestBatchWithPartialErrorOfMissingRequiredColumn
I20260619 18:44:50.324638 6627 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.120.254:38101
I20260619 18:44:50.325583 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:50.330255 7976 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:50.331394 7977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:50.332098 7979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:50.332825 6627 server_base.cc:1034] running on GCE node
I20260619 18:44:50.333487 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:50.333639 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:50.333746 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894690333738 us; error 0 us; skew 500 ppm
I20260619 18:44:50.334158 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:50.336421 6627 webserver.cc:460] Webserver started at http://127.6.120.254:39467/ using document root <none> and password file <none>
I20260619 18:44:50.336838 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:50.336984 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:50.337172 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:50.338115 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBatchWithPartialErrorOfMissingRequiredColumn.1781894682485826-6627-0/minicluster-data/master-0-root/instance:
uuid: "a0d56c31d95e4c43988268c45bbab417"
format_stamp: "Formatted at 2026-06-19 18:44:50 on dist-test-slave-90mn"
I20260619 18:44:50.342077 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260619 18:44:50.345089 7984 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:50.345752 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260619 18:44:50.346038 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBatchWithPartialErrorOfMissingRequiredColumn.1781894682485826-6627-0/minicluster-data/master-0-root
uuid: "a0d56c31d95e4c43988268c45bbab417"
format_stamp: "Formatted at 2026-06-19 18:44:50 on dist-test-slave-90mn"
I20260619 18:44:50.346329 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBatchWithPartialErrorOfMissingRequiredColumn.1781894682485826-6627-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBatchWithPartialErrorOfMissingRequiredColumn.1781894682485826-6627-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBatchWithPartialErrorOfMissingRequiredColumn.1781894682485826-6627-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:50.364068 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:50.365053 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:50.403211 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.254:38101
I20260619 18:44:50.403295 8045 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.254:38101 every 8 connection(s)
I20260619 18:44:50.406607 8046 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:50.415771 8046 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0d56c31d95e4c43988268c45bbab417: Bootstrap starting.
I20260619 18:44:50.419371 8046 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a0d56c31d95e4c43988268c45bbab417: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:50.422875 8046 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0d56c31d95e4c43988268c45bbab417: No bootstrap required, opened a new log
I20260619 18:44:50.424611 8046 raft_consensus.cc:348] T 00000000000000000000000000000000 P a0d56c31d95e4c43988268c45bbab417 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0d56c31d95e4c43988268c45bbab417" member_type: VOTER }
I20260619 18:44:50.424975 8046 raft_consensus.cc:374] T 00000000000000000000000000000000 P a0d56c31d95e4c43988268c45bbab417 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:50.425145 8046 raft_consensus.cc:729] T 00000000000000000000000000000000 P a0d56c31d95e4c43988268c45bbab417 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0d56c31d95e4c43988268c45bbab417, State: Initialized, Role: FOLLOWER
I20260619 18:44:50.425658 8046 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0d56c31d95e4c43988268c45bbab417 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0d56c31d95e4c43988268c45bbab417" member_type: VOTER }
I20260619 18:44:50.426047 8046 raft_consensus.cc:388] T 00000000000000000000000000000000 P a0d56c31d95e4c43988268c45bbab417 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:50.426229 8046 raft_consensus.cc:482] T 00000000000000000000000000000000 P a0d56c31d95e4c43988268c45bbab417 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:50.426436 8046 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a0d56c31d95e4c43988268c45bbab417 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:50.430356 8046 raft_consensus.cc:504] T 00000000000000000000000000000000 P a0d56c31d95e4c43988268c45bbab417 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0d56c31d95e4c43988268c45bbab417" member_type: VOTER }
I20260619 18:44:50.430780 8046 leader_election.cc:302] T 00000000000000000000000000000000 P a0d56c31d95e4c43988268c45bbab417 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a0d56c31d95e4c43988268c45bbab417; no voters:
I20260619 18:44:50.431744 8046 leader_election.cc:288] T 00000000000000000000000000000000 P a0d56c31d95e4c43988268c45bbab417 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:50.432066 8049 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a0d56c31d95e4c43988268c45bbab417 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:50.433422 8049 raft_consensus.cc:686] T 00000000000000000000000000000000 P a0d56c31d95e4c43988268c45bbab417 [term 1 LEADER]: Becoming Leader. State: Replica: a0d56c31d95e4c43988268c45bbab417, State: Running, Role: LEADER
I20260619 18:44:50.433955 8049 consensus_queue.cc:237] T 00000000000000000000000000000000 P a0d56c31d95e4c43988268c45bbab417 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0d56c31d95e4c43988268c45bbab417" member_type: VOTER }
I20260619 18:44:50.434501 8046 sys_catalog.cc:564] T 00000000000000000000000000000000 P a0d56c31d95e4c43988268c45bbab417 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 18:44:50.436861 8051 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0d56c31d95e4c43988268c45bbab417 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0d56c31d95e4c43988268c45bbab417. Latest consensus state: current_term: 1 leader_uuid: "a0d56c31d95e4c43988268c45bbab417" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0d56c31d95e4c43988268c45bbab417" member_type: VOTER } }
I20260619 18:44:50.436861 8050 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0d56c31d95e4c43988268c45bbab417 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a0d56c31d95e4c43988268c45bbab417" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0d56c31d95e4c43988268c45bbab417" member_type: VOTER } }
I20260619 18:44:50.437474 8051 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0d56c31d95e4c43988268c45bbab417 [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:50.437538 8050 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0d56c31d95e4c43988268c45bbab417 [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:50.445485 8054 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 18:44:50.450131 8054 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 18:44:50.454109 6627 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260619 18:44:50.457937 8054 catalog_manager.cc:1347] Generated new cluster ID: 68e086423bb04b9abd6145380fe04f51
I20260619 18:44:50.458140 8054 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 18:44:50.486621 8054 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 18:44:50.488379 8054 catalog_manager.cc:1504] Loading token signing keys...
I20260619 18:44:50.502627 8054 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a0d56c31d95e4c43988268c45bbab417: Generated new TSK 0
I20260619 18:44:50.503285 8054 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 18:44:50.521194 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:50.526484 8067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:50.527588 8068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:50.530589 6627 server_base.cc:1034] running on GCE node
W20260619 18:44:50.530476 8070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:50.531517 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:50.531725 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:50.531878 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894690531865 us; error 0 us; skew 500 ppm
I20260619 18:44:50.532439 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:50.534643 6627 webserver.cc:460] Webserver started at http://127.6.120.193:44221/ using document root <none> and password file <none>
I20260619 18:44:50.535094 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:50.535298 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:50.535557 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:50.536655 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBatchWithPartialErrorOfMissingRequiredColumn.1781894682485826-6627-0/minicluster-data/ts-0-root/instance:
uuid: "51ec371842a3442a97a497cedae7808d"
format_stamp: "Formatted at 2026-06-19 18:44:50 on dist-test-slave-90mn"
I20260619 18:44:50.540644 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260619 18:44:50.543529 8075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:50.544384 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260619 18:44:50.544617 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBatchWithPartialErrorOfMissingRequiredColumn.1781894682485826-6627-0/minicluster-data/ts-0-root
uuid: "51ec371842a3442a97a497cedae7808d"
format_stamp: "Formatted at 2026-06-19 18:44:50 on dist-test-slave-90mn"
I20260619 18:44:50.544849 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBatchWithPartialErrorOfMissingRequiredColumn.1781894682485826-6627-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBatchWithPartialErrorOfMissingRequiredColumn.1781894682485826-6627-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBatchWithPartialErrorOfMissingRequiredColumn.1781894682485826-6627-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:50.558192 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:50.559105 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:50.564493 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:44:50.564795 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:50.565062 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:44:50.565227 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:50.612466 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.193:36503
I20260619 18:44:50.612589 8145 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.193:36503 every 8 connection(s)
I20260619 18:44:50.616832 8146 heartbeater.cc:347] Connected to a master server at 127.6.120.254:38101
I20260619 18:44:50.617182 8146 heartbeater.cc:464] Registering TS with master...
I20260619 18:44:50.617872 8146 heartbeater.cc:511] Master 127.6.120.254:38101 requested a full tablet report, sending...
I20260619 18:44:50.619608 8001 ts_manager.cc:194] Registered new tserver with Master: 51ec371842a3442a97a497cedae7808d (127.6.120.193:36503)
I20260619 18:44:50.620292 6627 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.004825986s
I20260619 18:44:50.622243 8001 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52436
I20260619 18:44:50.635706 8146 heartbeater.cc:503] Master 127.6.120.254:38101 was elected leader, sending a full tablet report...
I20260619 18:44:50.643114 8001 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52460:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 18:44:50.675414 8111 tablet_service.cc:1467] Processing CreateTablet for tablet 5802277a1c884900b91de6f263513d49 (DEFAULT_TABLE table=client-testtb [id=5a7738d9eba54cf9afaea41d6d2041a6]), partition=RANGE (key) PARTITION VALUES < 9
I20260619 18:44:50.675685 8110 tablet_service.cc:1467] Processing CreateTablet for tablet a2edce866c0a4fca82ba4b2be91f56bc (DEFAULT_TABLE table=client-testtb [id=5a7738d9eba54cf9afaea41d6d2041a6]), partition=RANGE (key) PARTITION 9 <= VALUES
I20260619 18:44:50.676645 8111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5802277a1c884900b91de6f263513d49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:50.677256 8110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2edce866c0a4fca82ba4b2be91f56bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:50.688642 8156 tablet_bootstrap.cc:492] T a2edce866c0a4fca82ba4b2be91f56bc P 51ec371842a3442a97a497cedae7808d: Bootstrap starting.
I20260619 18:44:50.693137 8156 tablet_bootstrap.cc:654] T a2edce866c0a4fca82ba4b2be91f56bc P 51ec371842a3442a97a497cedae7808d: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:50.696909 8156 tablet_bootstrap.cc:492] T a2edce866c0a4fca82ba4b2be91f56bc P 51ec371842a3442a97a497cedae7808d: No bootstrap required, opened a new log
I20260619 18:44:50.697276 8156 ts_tablet_manager.cc:1397] T a2edce866c0a4fca82ba4b2be91f56bc P 51ec371842a3442a97a497cedae7808d: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260619 18:44:50.699034 8156 raft_consensus.cc:348] T a2edce866c0a4fca82ba4b2be91f56bc P 51ec371842a3442a97a497cedae7808d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ec371842a3442a97a497cedae7808d" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 36503 } }
I20260619 18:44:50.699460 8156 raft_consensus.cc:374] T a2edce866c0a4fca82ba4b2be91f56bc P 51ec371842a3442a97a497cedae7808d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:50.699728 8156 raft_consensus.cc:729] T a2edce866c0a4fca82ba4b2be91f56bc P 51ec371842a3442a97a497cedae7808d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51ec371842a3442a97a497cedae7808d, State: Initialized, Role: FOLLOWER
I20260619 18:44:50.700322 8156 consensus_queue.cc:260] T a2edce866c0a4fca82ba4b2be91f56bc P 51ec371842a3442a97a497cedae7808d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ec371842a3442a97a497cedae7808d" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 36503 } }
I20260619 18:44:50.700750 8156 raft_consensus.cc:388] T a2edce866c0a4fca82ba4b2be91f56bc P 51ec371842a3442a97a497cedae7808d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:50.700932 8156 raft_consensus.cc:482] T a2edce866c0a4fca82ba4b2be91f56bc P 51ec371842a3442a97a497cedae7808d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:50.701141 8156 raft_consensus.cc:3037] T a2edce866c0a4fca82ba4b2be91f56bc P 51ec371842a3442a97a497cedae7808d [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:50.705497 8156 raft_consensus.cc:504] T a2edce866c0a4fca82ba4b2be91f56bc P 51ec371842a3442a97a497cedae7808d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ec371842a3442a97a497cedae7808d" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 36503 } }
I20260619 18:44:50.706179 8156 leader_election.cc:302] T a2edce866c0a4fca82ba4b2be91f56bc P 51ec371842a3442a97a497cedae7808d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 51ec371842a3442a97a497cedae7808d; no voters:
I20260619 18:44:50.707252 8156 leader_election.cc:288] T a2edce866c0a4fca82ba4b2be91f56bc P 51ec371842a3442a97a497cedae7808d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:50.707675 8158 raft_consensus.cc:2781] T a2edce866c0a4fca82ba4b2be91f56bc P 51ec371842a3442a97a497cedae7808d [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:50.709589 8156 ts_tablet_manager.cc:1428] T a2edce866c0a4fca82ba4b2be91f56bc P 51ec371842a3442a97a497cedae7808d: Time spent starting tablet: real 0.012s user 0.010s sys 0.004s
I20260619 18:44:50.709918 8158 raft_consensus.cc:686] T a2edce866c0a4fca82ba4b2be91f56bc P 51ec371842a3442a97a497cedae7808d [term 1 LEADER]: Becoming Leader. State: Replica: 51ec371842a3442a97a497cedae7808d, State: Running, Role: LEADER
I20260619 18:44:50.710403 8156 tablet_bootstrap.cc:492] T 5802277a1c884900b91de6f263513d49 P 51ec371842a3442a97a497cedae7808d: Bootstrap starting.
I20260619 18:44:50.710578 8158 consensus_queue.cc:237] T a2edce866c0a4fca82ba4b2be91f56bc P 51ec371842a3442a97a497cedae7808d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ec371842a3442a97a497cedae7808d" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 36503 } }
I20260619 18:44:50.715000 8156 tablet_bootstrap.cc:654] T 5802277a1c884900b91de6f263513d49 P 51ec371842a3442a97a497cedae7808d: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:50.717195 8001 catalog_manager.cc:5495] T a2edce866c0a4fca82ba4b2be91f56bc P 51ec371842a3442a97a497cedae7808d reported cstate change: term changed from 0 to 1, leader changed from <none> to 51ec371842a3442a97a497cedae7808d (127.6.120.193). New cstate: current_term: 1 leader_uuid: "51ec371842a3442a97a497cedae7808d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ec371842a3442a97a497cedae7808d" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 36503 } health_report { overall_health: HEALTHY } } }
I20260619 18:44:50.719722 8156 tablet_bootstrap.cc:492] T 5802277a1c884900b91de6f263513d49 P 51ec371842a3442a97a497cedae7808d: No bootstrap required, opened a new log
I20260619 18:44:50.720175 8156 ts_tablet_manager.cc:1397] T 5802277a1c884900b91de6f263513d49 P 51ec371842a3442a97a497cedae7808d: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.004s
I20260619 18:44:50.722218 8156 raft_consensus.cc:348] T 5802277a1c884900b91de6f263513d49 P 51ec371842a3442a97a497cedae7808d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ec371842a3442a97a497cedae7808d" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 36503 } }
I20260619 18:44:50.722633 8156 raft_consensus.cc:374] T 5802277a1c884900b91de6f263513d49 P 51ec371842a3442a97a497cedae7808d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:50.722865 8156 raft_consensus.cc:729] T 5802277a1c884900b91de6f263513d49 P 51ec371842a3442a97a497cedae7808d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51ec371842a3442a97a497cedae7808d, State: Initialized, Role: FOLLOWER
I20260619 18:44:50.723476 8156 consensus_queue.cc:260] T 5802277a1c884900b91de6f263513d49 P 51ec371842a3442a97a497cedae7808d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ec371842a3442a97a497cedae7808d" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 36503 } }
I20260619 18:44:50.723989 8156 raft_consensus.cc:388] T 5802277a1c884900b91de6f263513d49 P 51ec371842a3442a97a497cedae7808d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:50.724339 8156 raft_consensus.cc:482] T 5802277a1c884900b91de6f263513d49 P 51ec371842a3442a97a497cedae7808d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:50.724669 8156 raft_consensus.cc:3037] T 5802277a1c884900b91de6f263513d49 P 51ec371842a3442a97a497cedae7808d [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:50.729632 8156 raft_consensus.cc:504] T 5802277a1c884900b91de6f263513d49 P 51ec371842a3442a97a497cedae7808d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ec371842a3442a97a497cedae7808d" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 36503 } }
I20260619 18:44:50.730196 8156 leader_election.cc:302] T 5802277a1c884900b91de6f263513d49 P 51ec371842a3442a97a497cedae7808d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 51ec371842a3442a97a497cedae7808d; no voters:
I20260619 18:44:50.730717 8156 leader_election.cc:288] T 5802277a1c884900b91de6f263513d49 P 51ec371842a3442a97a497cedae7808d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:50.730849 8158 raft_consensus.cc:2781] T 5802277a1c884900b91de6f263513d49 P 51ec371842a3442a97a497cedae7808d [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:50.731416 8158 raft_consensus.cc:686] T 5802277a1c884900b91de6f263513d49 P 51ec371842a3442a97a497cedae7808d [term 1 LEADER]: Becoming Leader. State: Replica: 51ec371842a3442a97a497cedae7808d, State: Running, Role: LEADER
I20260619 18:44:50.732080 8156 ts_tablet_manager.cc:1428] T 5802277a1c884900b91de6f263513d49 P 51ec371842a3442a97a497cedae7808d: Time spent starting tablet: real 0.012s user 0.008s sys 0.000s
I20260619 18:44:50.732012 8158 consensus_queue.cc:237] T 5802277a1c884900b91de6f263513d49 P 51ec371842a3442a97a497cedae7808d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ec371842a3442a97a497cedae7808d" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 36503 } }
I20260619 18:44:50.737342 8001 catalog_manager.cc:5495] T 5802277a1c884900b91de6f263513d49 P 51ec371842a3442a97a497cedae7808d reported cstate change: term changed from 0 to 1, leader changed from <none> to 51ec371842a3442a97a497cedae7808d (127.6.120.193). New cstate: current_term: 1 leader_uuid: "51ec371842a3442a97a497cedae7808d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ec371842a3442a97a497cedae7808d" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 36503 } health_report { overall_health: HEALTHY } } }
I20260619 18:44:50.757153 8001 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:52460:
table { table_name: "client-testtb" } alter_schema_steps { type: ALTER_COLUMN alter_column { delta { name: "non_null_with_default" remove_default: true } } } modify_external_catalogs: true
I20260619 18:44:50.771413 8166 tablet.cc:1722] T 5802277a1c884900b91de6f263513d49 P 51ec371842a3442a97a497cedae7808d: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:non_null_with_default INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:non_null_with_default INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 18:44:50.772960 8167 tablet.cc:1722] T a2edce866c0a4fca82ba4b2be91f56bc P 51ec371842a3442a97a497cedae7808d: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:non_null_with_default INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:non_null_with_default INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 18:44:50.774066 8166 tablet.cc:1620] T 5802277a1c884900b91de6f263513d49 P 51ec371842a3442a97a497cedae7808d: MemRowSet was empty: no flush needed.
I20260619 18:44:50.774958 8167 tablet.cc:1620] T a2edce866c0a4fca82ba4b2be91f56bc P 51ec371842a3442a97a497cedae7808d: MemRowSet was empty: no flush needed.
I20260619 18:44:50.794968 8000 catalog_manager.cc:6040] T 00000000000000000000000000000000 P a0d56c31d95e4c43988268c45bbab417: client-testtb [id=5a7738d9eba54cf9afaea41d6d2041a6] alter complete (version 1)
I20260619 18:44:50.836125 6627 tablet_server.cc:178] TabletServer@127.6.120.193:0 shutting down...
I20260619 18:44:50.853904 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:44:50.854671 6627 tablet_replica.cc:330] T 5802277a1c884900b91de6f263513d49 P 51ec371842a3442a97a497cedae7808d: stopping tablet replica
I20260619 18:44:50.855180 6627 raft_consensus.cc:2229] T 5802277a1c884900b91de6f263513d49 P 51ec371842a3442a97a497cedae7808d [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:50.855630 6627 raft_consensus.cc:2258] T 5802277a1c884900b91de6f263513d49 P 51ec371842a3442a97a497cedae7808d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:50.857609 6627 tablet_replica.cc:330] T a2edce866c0a4fca82ba4b2be91f56bc P 51ec371842a3442a97a497cedae7808d: stopping tablet replica
I20260619 18:44:50.858026 6627 raft_consensus.cc:2229] T a2edce866c0a4fca82ba4b2be91f56bc P 51ec371842a3442a97a497cedae7808d [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:50.858408 6627 raft_consensus.cc:2258] T a2edce866c0a4fca82ba4b2be91f56bc P 51ec371842a3442a97a497cedae7808d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:50.869524 6627 tablet_server.cc:194] TabletServer@127.6.120.193:0 shutdown complete.
I20260619 18:44:50.879073 6627 master.cc:537] Master@127.6.120.254:38101 shutting down...
I20260619 18:44:50.894668 6627 raft_consensus.cc:2229] T 00000000000000000000000000000000 P a0d56c31d95e4c43988268c45bbab417 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:50.895174 6627 raft_consensus.cc:2258] T 00000000000000000000000000000000 P a0d56c31d95e4c43988268c45bbab417 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:50.895609 6627 tablet_replica.cc:330] T 00000000000000000000000000000000 P a0d56c31d95e4c43988268c45bbab417: stopping tablet replica
I20260619 18:44:50.915200 6627 master.cc:552] Master@127.6.120.254:38101 shutdown complete.
[ OK ] ClientTest.TestBatchWithPartialErrorOfMissingRequiredColumn (609 ms)
[ RUN ] ClientTest.TestApplyToSessionWithoutFlushing_OpsBuffered
I20260619 18:44:50.933998 6627 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.120.254:41441
I20260619 18:44:50.935004 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:50.939807 8169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:50.941594 8170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:50.941847 8172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:50.942286 6627 server_base.cc:1034] running on GCE node
I20260619 18:44:50.942967 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:50.943136 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:50.943333 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894690943303 us; error 0 us; skew 500 ppm
I20260619 18:44:50.943845 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:50.946215 6627 webserver.cc:460] Webserver started at http://127.6.120.254:40283/ using document root <none> and password file <none>
I20260619 18:44:50.946650 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:50.946798 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:50.947101 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:50.948159 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestApplyToSessionWithoutFlushing_OpsBuffered.1781894682485826-6627-0/minicluster-data/master-0-root/instance:
uuid: "afb634bc83a445f3a0ec6b387e7e675b"
format_stamp: "Formatted at 2026-06-19 18:44:50 on dist-test-slave-90mn"
I20260619 18:44:50.952317 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260619 18:44:50.955852 8177 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:50.956583 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260619 18:44:50.956851 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestApplyToSessionWithoutFlushing_OpsBuffered.1781894682485826-6627-0/minicluster-data/master-0-root
uuid: "afb634bc83a445f3a0ec6b387e7e675b"
format_stamp: "Formatted at 2026-06-19 18:44:50 on dist-test-slave-90mn"
I20260619 18:44:50.957095 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestApplyToSessionWithoutFlushing_OpsBuffered.1781894682485826-6627-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestApplyToSessionWithoutFlushing_OpsBuffered.1781894682485826-6627-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestApplyToSessionWithoutFlushing_OpsBuffered.1781894682485826-6627-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:50.980001 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:50.981066 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:51.021195 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.254:41441
I20260619 18:44:51.021296 8238 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.254:41441 every 8 connection(s)
I20260619 18:44:51.024685 8239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:51.033869 8239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afb634bc83a445f3a0ec6b387e7e675b: Bootstrap starting.
I20260619 18:44:51.037410 8239 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P afb634bc83a445f3a0ec6b387e7e675b: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:51.040977 8239 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afb634bc83a445f3a0ec6b387e7e675b: No bootstrap required, opened a new log
I20260619 18:44:51.042599 8239 raft_consensus.cc:348] T 00000000000000000000000000000000 P afb634bc83a445f3a0ec6b387e7e675b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afb634bc83a445f3a0ec6b387e7e675b" member_type: VOTER }
I20260619 18:44:51.042943 8239 raft_consensus.cc:374] T 00000000000000000000000000000000 P afb634bc83a445f3a0ec6b387e7e675b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:51.043123 8239 raft_consensus.cc:729] T 00000000000000000000000000000000 P afb634bc83a445f3a0ec6b387e7e675b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afb634bc83a445f3a0ec6b387e7e675b, State: Initialized, Role: FOLLOWER
I20260619 18:44:51.043677 8239 consensus_queue.cc:260] T 00000000000000000000000000000000 P afb634bc83a445f3a0ec6b387e7e675b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afb634bc83a445f3a0ec6b387e7e675b" member_type: VOTER }
I20260619 18:44:51.044088 8239 raft_consensus.cc:388] T 00000000000000000000000000000000 P afb634bc83a445f3a0ec6b387e7e675b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:51.044346 8239 raft_consensus.cc:482] T 00000000000000000000000000000000 P afb634bc83a445f3a0ec6b387e7e675b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:51.044545 8239 raft_consensus.cc:3037] T 00000000000000000000000000000000 P afb634bc83a445f3a0ec6b387e7e675b [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:51.048513 8239 raft_consensus.cc:504] T 00000000000000000000000000000000 P afb634bc83a445f3a0ec6b387e7e675b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afb634bc83a445f3a0ec6b387e7e675b" member_type: VOTER }
I20260619 18:44:51.048957 8239 leader_election.cc:302] T 00000000000000000000000000000000 P afb634bc83a445f3a0ec6b387e7e675b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: afb634bc83a445f3a0ec6b387e7e675b; no voters:
I20260619 18:44:51.050061 8239 leader_election.cc:288] T 00000000000000000000000000000000 P afb634bc83a445f3a0ec6b387e7e675b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:51.050383 8242 raft_consensus.cc:2781] T 00000000000000000000000000000000 P afb634bc83a445f3a0ec6b387e7e675b [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:51.051705 8242 raft_consensus.cc:686] T 00000000000000000000000000000000 P afb634bc83a445f3a0ec6b387e7e675b [term 1 LEADER]: Becoming Leader. State: Replica: afb634bc83a445f3a0ec6b387e7e675b, State: Running, Role: LEADER
I20260619 18:44:51.052369 8242 consensus_queue.cc:237] T 00000000000000000000000000000000 P afb634bc83a445f3a0ec6b387e7e675b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afb634bc83a445f3a0ec6b387e7e675b" member_type: VOTER }
I20260619 18:44:51.052733 8239 sys_catalog.cc:564] T 00000000000000000000000000000000 P afb634bc83a445f3a0ec6b387e7e675b [sys.catalog]: configured and running, proceeding with master startup.
I20260619 18:44:51.055104 8243 sys_catalog.cc:455] T 00000000000000000000000000000000 P afb634bc83a445f3a0ec6b387e7e675b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "afb634bc83a445f3a0ec6b387e7e675b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afb634bc83a445f3a0ec6b387e7e675b" member_type: VOTER } }
I20260619 18:44:51.055120 8244 sys_catalog.cc:455] T 00000000000000000000000000000000 P afb634bc83a445f3a0ec6b387e7e675b [sys.catalog]: SysCatalogTable state changed. Reason: New leader afb634bc83a445f3a0ec6b387e7e675b. Latest consensus state: current_term: 1 leader_uuid: "afb634bc83a445f3a0ec6b387e7e675b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afb634bc83a445f3a0ec6b387e7e675b" member_type: VOTER } }
I20260619 18:44:51.055699 8243 sys_catalog.cc:458] T 00000000000000000000000000000000 P afb634bc83a445f3a0ec6b387e7e675b [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:51.055936 8244 sys_catalog.cc:458] T 00000000000000000000000000000000 P afb634bc83a445f3a0ec6b387e7e675b [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:51.061020 8247 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 18:44:51.065357 8247 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 18:44:51.067448 6627 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260619 18:44:51.073207 8247 catalog_manager.cc:1347] Generated new cluster ID: ac30d38f6cb344969b6bbcab4268b44f
I20260619 18:44:51.073503 8247 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 18:44:51.087504 8247 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 18:44:51.089061 8247 catalog_manager.cc:1504] Loading token signing keys...
I20260619 18:44:51.098004 8247 catalog_manager.cc:5868] T 00000000000000000000000000000000 P afb634bc83a445f3a0ec6b387e7e675b: Generated new TSK 0
I20260619 18:44:51.098582 8247 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 18:44:51.134217 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:51.139631 8260 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:51.140728 8261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:51.142465 6627 server_base.cc:1034] running on GCE node
W20260619 18:44:51.142431 8263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:51.143457 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:51.143651 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:51.143767 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894691143759 us; error 0 us; skew 500 ppm
I20260619 18:44:51.144263 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:51.146365 6627 webserver.cc:460] Webserver started at http://127.6.120.193:36491/ using document root <none> and password file <none>
I20260619 18:44:51.146780 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:51.146924 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:51.147116 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:51.148075 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestApplyToSessionWithoutFlushing_OpsBuffered.1781894682485826-6627-0/minicluster-data/ts-0-root/instance:
uuid: "64e47e73cdae443d927d7752be003885"
format_stamp: "Formatted at 2026-06-19 18:44:51 on dist-test-slave-90mn"
I20260619 18:44:51.152040 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260619 18:44:51.155342 8268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:51.156057 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260619 18:44:51.156383 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestApplyToSessionWithoutFlushing_OpsBuffered.1781894682485826-6627-0/minicluster-data/ts-0-root
uuid: "64e47e73cdae443d927d7752be003885"
format_stamp: "Formatted at 2026-06-19 18:44:51 on dist-test-slave-90mn"
I20260619 18:44:51.156672 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestApplyToSessionWithoutFlushing_OpsBuffered.1781894682485826-6627-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestApplyToSessionWithoutFlushing_OpsBuffered.1781894682485826-6627-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestApplyToSessionWithoutFlushing_OpsBuffered.1781894682485826-6627-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:51.168548 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:51.169466 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:51.173784 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:44:51.174103 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:51.174463 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:44:51.174726 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:51.222046 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.193:43507
I20260619 18:44:51.222131 8338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.193:43507 every 8 connection(s)
I20260619 18:44:51.226265 8339 heartbeater.cc:347] Connected to a master server at 127.6.120.254:41441
I20260619 18:44:51.226657 8339 heartbeater.cc:464] Registering TS with master...
I20260619 18:44:51.227233 8339 heartbeater.cc:511] Master 127.6.120.254:41441 requested a full tablet report, sending...
I20260619 18:44:51.228952 8194 ts_manager.cc:194] Registered new tserver with Master: 64e47e73cdae443d927d7752be003885 (127.6.120.193:43507)
I20260619 18:44:51.229717 6627 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.004701044s
I20260619 18:44:51.230675 8194 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56172
I20260619 18:44:51.243445 8339 heartbeater.cc:503] Master 127.6.120.254:41441 was elected leader, sending a full tablet report...
I20260619 18:44:51.251169 8194 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56198:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 18:44:51.282080 8303 tablet_service.cc:1467] Processing CreateTablet for tablet d7e6b7e79609437091289775c4eec883 (DEFAULT_TABLE table=client-testtb [id=77e40918126141eb9441146a818a1817]), partition=RANGE (key) PARTITION 9 <= VALUES
I20260619 18:44:51.282011 8304 tablet_service.cc:1467] Processing CreateTablet for tablet 5553c2bac1df49f2ab1ba88980f8bab2 (DEFAULT_TABLE table=client-testtb [id=77e40918126141eb9441146a818a1817]), partition=RANGE (key) PARTITION VALUES < 9
I20260619 18:44:51.283530 8303 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d7e6b7e79609437091289775c4eec883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:51.284132 8304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5553c2bac1df49f2ab1ba88980f8bab2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:51.299209 8349 tablet_bootstrap.cc:492] T 5553c2bac1df49f2ab1ba88980f8bab2 P 64e47e73cdae443d927d7752be003885: Bootstrap starting.
I20260619 18:44:51.303115 8349 tablet_bootstrap.cc:654] T 5553c2bac1df49f2ab1ba88980f8bab2 P 64e47e73cdae443d927d7752be003885: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:51.306794 8349 tablet_bootstrap.cc:492] T 5553c2bac1df49f2ab1ba88980f8bab2 P 64e47e73cdae443d927d7752be003885: No bootstrap required, opened a new log
I20260619 18:44:51.307153 8349 ts_tablet_manager.cc:1397] T 5553c2bac1df49f2ab1ba88980f8bab2 P 64e47e73cdae443d927d7752be003885: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s
I20260619 18:44:51.308920 8349 raft_consensus.cc:348] T 5553c2bac1df49f2ab1ba88980f8bab2 P 64e47e73cdae443d927d7752be003885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64e47e73cdae443d927d7752be003885" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 43507 } }
I20260619 18:44:51.309341 8349 raft_consensus.cc:374] T 5553c2bac1df49f2ab1ba88980f8bab2 P 64e47e73cdae443d927d7752be003885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:51.309556 8349 raft_consensus.cc:729] T 5553c2bac1df49f2ab1ba88980f8bab2 P 64e47e73cdae443d927d7752be003885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64e47e73cdae443d927d7752be003885, State: Initialized, Role: FOLLOWER
I20260619 18:44:51.310077 8349 consensus_queue.cc:260] T 5553c2bac1df49f2ab1ba88980f8bab2 P 64e47e73cdae443d927d7752be003885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64e47e73cdae443d927d7752be003885" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 43507 } }
I20260619 18:44:51.310674 8349 raft_consensus.cc:388] T 5553c2bac1df49f2ab1ba88980f8bab2 P 64e47e73cdae443d927d7752be003885 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:51.310935 8349 raft_consensus.cc:482] T 5553c2bac1df49f2ab1ba88980f8bab2 P 64e47e73cdae443d927d7752be003885 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:51.311250 8349 raft_consensus.cc:3037] T 5553c2bac1df49f2ab1ba88980f8bab2 P 64e47e73cdae443d927d7752be003885 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:51.316530 8349 raft_consensus.cc:504] T 5553c2bac1df49f2ab1ba88980f8bab2 P 64e47e73cdae443d927d7752be003885 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64e47e73cdae443d927d7752be003885" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 43507 } }
I20260619 18:44:51.317037 8349 leader_election.cc:302] T 5553c2bac1df49f2ab1ba88980f8bab2 P 64e47e73cdae443d927d7752be003885 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 64e47e73cdae443d927d7752be003885; no voters:
I20260619 18:44:51.318044 8349 leader_election.cc:288] T 5553c2bac1df49f2ab1ba88980f8bab2 P 64e47e73cdae443d927d7752be003885 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:51.318357 8351 raft_consensus.cc:2781] T 5553c2bac1df49f2ab1ba88980f8bab2 P 64e47e73cdae443d927d7752be003885 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:51.319690 8351 raft_consensus.cc:686] T 5553c2bac1df49f2ab1ba88980f8bab2 P 64e47e73cdae443d927d7752be003885 [term 1 LEADER]: Becoming Leader. State: Replica: 64e47e73cdae443d927d7752be003885, State: Running, Role: LEADER
I20260619 18:44:51.320237 8349 ts_tablet_manager.cc:1428] T 5553c2bac1df49f2ab1ba88980f8bab2 P 64e47e73cdae443d927d7752be003885: Time spent starting tablet: real 0.013s user 0.014s sys 0.001s
I20260619 18:44:51.321008 8349 tablet_bootstrap.cc:492] T d7e6b7e79609437091289775c4eec883 P 64e47e73cdae443d927d7752be003885: Bootstrap starting.
I20260619 18:44:51.320767 8351 consensus_queue.cc:237] T 5553c2bac1df49f2ab1ba88980f8bab2 P 64e47e73cdae443d927d7752be003885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64e47e73cdae443d927d7752be003885" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 43507 } }
I20260619 18:44:51.326130 8349 tablet_bootstrap.cc:654] T d7e6b7e79609437091289775c4eec883 P 64e47e73cdae443d927d7752be003885: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:51.326884 8194 catalog_manager.cc:5495] T 5553c2bac1df49f2ab1ba88980f8bab2 P 64e47e73cdae443d927d7752be003885 reported cstate change: term changed from 0 to 1, leader changed from <none> to 64e47e73cdae443d927d7752be003885 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "64e47e73cdae443d927d7752be003885" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64e47e73cdae443d927d7752be003885" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 43507 } health_report { overall_health: HEALTHY } } }
I20260619 18:44:51.330226 8349 tablet_bootstrap.cc:492] T d7e6b7e79609437091289775c4eec883 P 64e47e73cdae443d927d7752be003885: No bootstrap required, opened a new log
I20260619 18:44:51.330641 8349 ts_tablet_manager.cc:1397] T d7e6b7e79609437091289775c4eec883 P 64e47e73cdae443d927d7752be003885: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.007s
I20260619 18:44:51.332899 8349 raft_consensus.cc:348] T d7e6b7e79609437091289775c4eec883 P 64e47e73cdae443d927d7752be003885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64e47e73cdae443d927d7752be003885" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 43507 } }
I20260619 18:44:51.333357 8349 raft_consensus.cc:374] T d7e6b7e79609437091289775c4eec883 P 64e47e73cdae443d927d7752be003885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:51.333686 8349 raft_consensus.cc:729] T d7e6b7e79609437091289775c4eec883 P 64e47e73cdae443d927d7752be003885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64e47e73cdae443d927d7752be003885, State: Initialized, Role: FOLLOWER
I20260619 18:44:51.334292 8349 consensus_queue.cc:260] T d7e6b7e79609437091289775c4eec883 P 64e47e73cdae443d927d7752be003885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64e47e73cdae443d927d7752be003885" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 43507 } }
I20260619 18:44:51.334796 8349 raft_consensus.cc:388] T d7e6b7e79609437091289775c4eec883 P 64e47e73cdae443d927d7752be003885 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:51.335033 8349 raft_consensus.cc:482] T d7e6b7e79609437091289775c4eec883 P 64e47e73cdae443d927d7752be003885 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:51.335381 8349 raft_consensus.cc:3037] T d7e6b7e79609437091289775c4eec883 P 64e47e73cdae443d927d7752be003885 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:51.340324 8349 raft_consensus.cc:504] T d7e6b7e79609437091289775c4eec883 P 64e47e73cdae443d927d7752be003885 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64e47e73cdae443d927d7752be003885" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 43507 } }
I20260619 18:44:51.340912 8349 leader_election.cc:302] T d7e6b7e79609437091289775c4eec883 P 64e47e73cdae443d927d7752be003885 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 64e47e73cdae443d927d7752be003885; no voters:
I20260619 18:44:51.341382 8349 leader_election.cc:288] T d7e6b7e79609437091289775c4eec883 P 64e47e73cdae443d927d7752be003885 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:51.341572 8351 raft_consensus.cc:2781] T d7e6b7e79609437091289775c4eec883 P 64e47e73cdae443d927d7752be003885 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:51.342077 8351 raft_consensus.cc:686] T d7e6b7e79609437091289775c4eec883 P 64e47e73cdae443d927d7752be003885 [term 1 LEADER]: Becoming Leader. State: Replica: 64e47e73cdae443d927d7752be003885, State: Running, Role: LEADER
I20260619 18:44:51.342707 8349 ts_tablet_manager.cc:1428] T d7e6b7e79609437091289775c4eec883 P 64e47e73cdae443d927d7752be003885: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20260619 18:44:51.342664 8351 consensus_queue.cc:237] T d7e6b7e79609437091289775c4eec883 P 64e47e73cdae443d927d7752be003885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64e47e73cdae443d927d7752be003885" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 43507 } }
I20260619 18:44:51.348248 8194 catalog_manager.cc:5495] T d7e6b7e79609437091289775c4eec883 P 64e47e73cdae443d927d7752be003885 reported cstate change: term changed from 0 to 1, leader changed from <none> to 64e47e73cdae443d927d7752be003885 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "64e47e73cdae443d927d7752be003885" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64e47e73cdae443d927d7752be003885" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 43507 } health_report { overall_health: HEALTHY } } }
I20260619 18:44:51.402556 6627 tablet_server.cc:178] TabletServer@127.6.120.193:0 shutting down...
I20260619 18:44:51.418870 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:44:51.419618 6627 tablet_replica.cc:330] T d7e6b7e79609437091289775c4eec883 P 64e47e73cdae443d927d7752be003885: stopping tablet replica
I20260619 18:44:51.420047 6627 raft_consensus.cc:2229] T d7e6b7e79609437091289775c4eec883 P 64e47e73cdae443d927d7752be003885 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:51.420472 6627 raft_consensus.cc:2258] T d7e6b7e79609437091289775c4eec883 P 64e47e73cdae443d927d7752be003885 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:51.422351 6627 tablet_replica.cc:330] T 5553c2bac1df49f2ab1ba88980f8bab2 P 64e47e73cdae443d927d7752be003885: stopping tablet replica
I20260619 18:44:51.422731 6627 raft_consensus.cc:2229] T 5553c2bac1df49f2ab1ba88980f8bab2 P 64e47e73cdae443d927d7752be003885 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:51.423028 6627 raft_consensus.cc:2258] T 5553c2bac1df49f2ab1ba88980f8bab2 P 64e47e73cdae443d927d7752be003885 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:51.442842 6627 tablet_server.cc:194] TabletServer@127.6.120.193:0 shutdown complete.
I20260619 18:44:51.452507 6627 master.cc:537] Master@127.6.120.254:41441 shutting down...
I20260619 18:44:51.468510 6627 raft_consensus.cc:2229] T 00000000000000000000000000000000 P afb634bc83a445f3a0ec6b387e7e675b [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:51.468999 6627 raft_consensus.cc:2258] T 00000000000000000000000000000000 P afb634bc83a445f3a0ec6b387e7e675b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:51.469498 6627 tablet_replica.cc:330] T 00000000000000000000000000000000 P afb634bc83a445f3a0ec6b387e7e675b: stopping tablet replica
I20260619 18:44:51.478616 6627 master.cc:552] Master@127.6.120.254:41441 shutdown complete.
[ OK ] ClientTest.TestApplyToSessionWithoutFlushing_OpsBuffered (563 ms)
[ RUN ] ClientTest.TestAutoFlushBackgroundAndErrorCollector
I20260619 18:44:51.497061 6627 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.120.254:38561
I20260619 18:44:51.497996 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:51.502606 8359 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:51.503567 8360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:51.504222 8362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:51.504962 6627 server_base.cc:1034] running on GCE node
I20260619 18:44:51.505611 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:51.505766 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:51.505869 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894691505862 us; error 0 us; skew 500 ppm
I20260619 18:44:51.506284 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:51.508495 6627 webserver.cc:460] Webserver started at http://127.6.120.254:33611/ using document root <none> and password file <none>
I20260619 18:44:51.508890 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:51.509050 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:51.509243 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:51.510201 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestAutoFlushBackgroundAndErrorCollector.1781894682485826-6627-0/minicluster-data/master-0-root/instance:
uuid: "18a0aff9d4d0488e91c9e94f78e48dd0"
format_stamp: "Formatted at 2026-06-19 18:44:51 on dist-test-slave-90mn"
I20260619 18:44:51.514178 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260619 18:44:51.517769 8367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:51.518503 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260619 18:44:51.518782 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestAutoFlushBackgroundAndErrorCollector.1781894682485826-6627-0/minicluster-data/master-0-root
uuid: "18a0aff9d4d0488e91c9e94f78e48dd0"
format_stamp: "Formatted at 2026-06-19 18:44:51 on dist-test-slave-90mn"
I20260619 18:44:51.519078 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestAutoFlushBackgroundAndErrorCollector.1781894682485826-6627-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestAutoFlushBackgroundAndErrorCollector.1781894682485826-6627-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestAutoFlushBackgroundAndErrorCollector.1781894682485826-6627-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:51.531312 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:51.532292 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:51.570221 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.254:38561
I20260619 18:44:51.570309 8428 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.254:38561 every 8 connection(s)
I20260619 18:44:51.573612 8429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:51.582844 8429 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18a0aff9d4d0488e91c9e94f78e48dd0: Bootstrap starting.
I20260619 18:44:51.586490 8429 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 18a0aff9d4d0488e91c9e94f78e48dd0: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:51.589900 8429 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18a0aff9d4d0488e91c9e94f78e48dd0: No bootstrap required, opened a new log
I20260619 18:44:51.591516 8429 raft_consensus.cc:348] T 00000000000000000000000000000000 P 18a0aff9d4d0488e91c9e94f78e48dd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18a0aff9d4d0488e91c9e94f78e48dd0" member_type: VOTER }
I20260619 18:44:51.591879 8429 raft_consensus.cc:374] T 00000000000000000000000000000000 P 18a0aff9d4d0488e91c9e94f78e48dd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:51.592056 8429 raft_consensus.cc:729] T 00000000000000000000000000000000 P 18a0aff9d4d0488e91c9e94f78e48dd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18a0aff9d4d0488e91c9e94f78e48dd0, State: Initialized, Role: FOLLOWER
I20260619 18:44:51.592594 8429 consensus_queue.cc:260] T 00000000000000000000000000000000 P 18a0aff9d4d0488e91c9e94f78e48dd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18a0aff9d4d0488e91c9e94f78e48dd0" member_type: VOTER }
I20260619 18:44:51.592981 8429 raft_consensus.cc:388] T 00000000000000000000000000000000 P 18a0aff9d4d0488e91c9e94f78e48dd0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:51.593164 8429 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18a0aff9d4d0488e91c9e94f78e48dd0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:51.593366 8429 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 18a0aff9d4d0488e91c9e94f78e48dd0 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:51.597333 8429 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18a0aff9d4d0488e91c9e94f78e48dd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18a0aff9d4d0488e91c9e94f78e48dd0" member_type: VOTER }
I20260619 18:44:51.597764 8429 leader_election.cc:302] T 00000000000000000000000000000000 P 18a0aff9d4d0488e91c9e94f78e48dd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 18a0aff9d4d0488e91c9e94f78e48dd0; no voters:
I20260619 18:44:51.598754 8429 leader_election.cc:288] T 00000000000000000000000000000000 P 18a0aff9d4d0488e91c9e94f78e48dd0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:51.599057 8432 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 18a0aff9d4d0488e91c9e94f78e48dd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:51.600386 8432 raft_consensus.cc:686] T 00000000000000000000000000000000 P 18a0aff9d4d0488e91c9e94f78e48dd0 [term 1 LEADER]: Becoming Leader. State: Replica: 18a0aff9d4d0488e91c9e94f78e48dd0, State: Running, Role: LEADER
I20260619 18:44:51.601086 8432 consensus_queue.cc:237] T 00000000000000000000000000000000 P 18a0aff9d4d0488e91c9e94f78e48dd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18a0aff9d4d0488e91c9e94f78e48dd0" member_type: VOTER }
I20260619 18:44:51.601472 8429 sys_catalog.cc:564] T 00000000000000000000000000000000 P 18a0aff9d4d0488e91c9e94f78e48dd0 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 18:44:51.603873 8434 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18a0aff9d4d0488e91c9e94f78e48dd0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 18a0aff9d4d0488e91c9e94f78e48dd0. Latest consensus state: current_term: 1 leader_uuid: "18a0aff9d4d0488e91c9e94f78e48dd0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18a0aff9d4d0488e91c9e94f78e48dd0" member_type: VOTER } }
I20260619 18:44:51.603826 8433 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18a0aff9d4d0488e91c9e94f78e48dd0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "18a0aff9d4d0488e91c9e94f78e48dd0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "18a0aff9d4d0488e91c9e94f78e48dd0" member_type: VOTER } }
I20260619 18:44:51.604530 8434 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18a0aff9d4d0488e91c9e94f78e48dd0 [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:51.604648 8433 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18a0aff9d4d0488e91c9e94f78e48dd0 [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:51.610368 8437 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 18:44:51.615759 8437 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 18:44:51.616917 6627 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260619 18:44:51.623682 8437 catalog_manager.cc:1347] Generated new cluster ID: d256b8a133b64ababacaa4382405eb8b
I20260619 18:44:51.623981 8437 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 18:44:51.642007 8437 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 18:44:51.643544 8437 catalog_manager.cc:1504] Loading token signing keys...
I20260619 18:44:51.666941 8437 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 18a0aff9d4d0488e91c9e94f78e48dd0: Generated new TSK 0
I20260619 18:44:51.667627 8437 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 18:44:51.683019 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:51.688349 8450 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:51.689414 8451 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:51.692090 8453 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:51.692220 6627 server_base.cc:1034] running on GCE node
I20260619 18:44:51.693100 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:51.693265 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:51.693460 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894691693430 us; error 0 us; skew 500 ppm
I20260619 18:44:51.693945 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:51.696377 6627 webserver.cc:460] Webserver started at http://127.6.120.193:36489/ using document root <none> and password file <none>
I20260619 18:44:51.696835 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:51.697019 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:51.697279 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:51.698293 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestAutoFlushBackgroundAndErrorCollector.1781894682485826-6627-0/minicluster-data/ts-0-root/instance:
uuid: "53ee44a9692247e0918779c7732d04c4"
format_stamp: "Formatted at 2026-06-19 18:44:51 on dist-test-slave-90mn"
I20260619 18:44:51.702749 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.001s
I20260619 18:44:51.705818 8458 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:51.706590 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260619 18:44:51.706859 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestAutoFlushBackgroundAndErrorCollector.1781894682485826-6627-0/minicluster-data/ts-0-root
uuid: "53ee44a9692247e0918779c7732d04c4"
format_stamp: "Formatted at 2026-06-19 18:44:51 on dist-test-slave-90mn"
I20260619 18:44:51.707141 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestAutoFlushBackgroundAndErrorCollector.1781894682485826-6627-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestAutoFlushBackgroundAndErrorCollector.1781894682485826-6627-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestAutoFlushBackgroundAndErrorCollector.1781894682485826-6627-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:51.741641 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:51.742616 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:51.747440 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:44:51.747872 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260619 18:44:51.748329 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:44:51.748579 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:51.795383 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.193:34925
I20260619 18:44:51.795497 8528 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.193:34925 every 8 connection(s)
I20260619 18:44:51.799991 8529 heartbeater.cc:347] Connected to a master server at 127.6.120.254:38561
I20260619 18:44:51.800388 8529 heartbeater.cc:464] Registering TS with master...
I20260619 18:44:51.801074 8529 heartbeater.cc:511] Master 127.6.120.254:38561 requested a full tablet report, sending...
I20260619 18:44:51.802955 8384 ts_manager.cc:194] Registered new tserver with Master: 53ee44a9692247e0918779c7732d04c4 (127.6.120.193:34925)
I20260619 18:44:51.803740 6627 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.005055232s
I20260619 18:44:51.805290 8384 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41276
I20260619 18:44:51.818532 8529 heartbeater.cc:503] Master 127.6.120.254:38561 was elected leader, sending a full tablet report...
I20260619 18:44:51.827133 8384 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41292:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 18:44:51.857918 8494 tablet_service.cc:1467] Processing CreateTablet for tablet d9412d09e87e4fe89f101bbec15eb10a (DEFAULT_TABLE table=client-testtb [id=83944044e00041c2bfde7ccd996d085c]), partition=RANGE (key) PARTITION VALUES < 9
I20260619 18:44:51.858062 8493 tablet_service.cc:1467] Processing CreateTablet for tablet a5eedeb5018d4d48b1a44b59f95b2c38 (DEFAULT_TABLE table=client-testtb [id=83944044e00041c2bfde7ccd996d085c]), partition=RANGE (key) PARTITION 9 <= VALUES
I20260619 18:44:51.859185 8494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d9412d09e87e4fe89f101bbec15eb10a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:51.859756 8493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5eedeb5018d4d48b1a44b59f95b2c38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:51.871524 8539 tablet_bootstrap.cc:492] T d9412d09e87e4fe89f101bbec15eb10a P 53ee44a9692247e0918779c7732d04c4: Bootstrap starting.
I20260619 18:44:51.876250 8539 tablet_bootstrap.cc:654] T d9412d09e87e4fe89f101bbec15eb10a P 53ee44a9692247e0918779c7732d04c4: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:51.879914 8539 tablet_bootstrap.cc:492] T d9412d09e87e4fe89f101bbec15eb10a P 53ee44a9692247e0918779c7732d04c4: No bootstrap required, opened a new log
I20260619 18:44:51.880318 8539 ts_tablet_manager.cc:1397] T d9412d09e87e4fe89f101bbec15eb10a P 53ee44a9692247e0918779c7732d04c4: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260619 18:44:51.881911 8539 raft_consensus.cc:348] T d9412d09e87e4fe89f101bbec15eb10a P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } }
I20260619 18:44:51.882313 8539 raft_consensus.cc:374] T d9412d09e87e4fe89f101bbec15eb10a P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:51.882561 8539 raft_consensus.cc:729] T d9412d09e87e4fe89f101bbec15eb10a P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53ee44a9692247e0918779c7732d04c4, State: Initialized, Role: FOLLOWER
I20260619 18:44:51.883140 8539 consensus_queue.cc:260] T d9412d09e87e4fe89f101bbec15eb10a P 53ee44a9692247e0918779c7732d04c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } }
I20260619 18:44:51.883623 8539 raft_consensus.cc:388] T d9412d09e87e4fe89f101bbec15eb10a P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:51.883869 8539 raft_consensus.cc:482] T d9412d09e87e4fe89f101bbec15eb10a P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:51.884183 8539 raft_consensus.cc:3037] T d9412d09e87e4fe89f101bbec15eb10a P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:51.888855 8539 raft_consensus.cc:504] T d9412d09e87e4fe89f101bbec15eb10a P 53ee44a9692247e0918779c7732d04c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } }
I20260619 18:44:51.889469 8539 leader_election.cc:302] T d9412d09e87e4fe89f101bbec15eb10a P 53ee44a9692247e0918779c7732d04c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 53ee44a9692247e0918779c7732d04c4; no voters:
I20260619 18:44:51.890563 8539 leader_election.cc:288] T d9412d09e87e4fe89f101bbec15eb10a P 53ee44a9692247e0918779c7732d04c4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:51.890852 8541 raft_consensus.cc:2781] T d9412d09e87e4fe89f101bbec15eb10a P 53ee44a9692247e0918779c7732d04c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:51.892915 8539 ts_tablet_manager.cc:1428] T d9412d09e87e4fe89f101bbec15eb10a P 53ee44a9692247e0918779c7732d04c4: Time spent starting tablet: real 0.012s user 0.013s sys 0.000s
I20260619 18:44:51.893306 8541 raft_consensus.cc:686] T d9412d09e87e4fe89f101bbec15eb10a P 53ee44a9692247e0918779c7732d04c4 [term 1 LEADER]: Becoming Leader. State: Replica: 53ee44a9692247e0918779c7732d04c4, State: Running, Role: LEADER
I20260619 18:44:51.893772 8539 tablet_bootstrap.cc:492] T a5eedeb5018d4d48b1a44b59f95b2c38 P 53ee44a9692247e0918779c7732d04c4: Bootstrap starting.
I20260619 18:44:51.894068 8541 consensus_queue.cc:237] T d9412d09e87e4fe89f101bbec15eb10a P 53ee44a9692247e0918779c7732d04c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } }
I20260619 18:44:51.898602 8539 tablet_bootstrap.cc:654] T a5eedeb5018d4d48b1a44b59f95b2c38 P 53ee44a9692247e0918779c7732d04c4: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:51.900880 8384 catalog_manager.cc:5495] T d9412d09e87e4fe89f101bbec15eb10a P 53ee44a9692247e0918779c7732d04c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 53ee44a9692247e0918779c7732d04c4 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "53ee44a9692247e0918779c7732d04c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } health_report { overall_health: HEALTHY } } }
I20260619 18:44:51.903155 8539 tablet_bootstrap.cc:492] T a5eedeb5018d4d48b1a44b59f95b2c38 P 53ee44a9692247e0918779c7732d04c4: No bootstrap required, opened a new log
I20260619 18:44:51.903620 8539 ts_tablet_manager.cc:1397] T a5eedeb5018d4d48b1a44b59f95b2c38 P 53ee44a9692247e0918779c7732d04c4: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260619 18:44:51.905835 8539 raft_consensus.cc:348] T a5eedeb5018d4d48b1a44b59f95b2c38 P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } }
I20260619 18:44:51.906400 8539 raft_consensus.cc:374] T a5eedeb5018d4d48b1a44b59f95b2c38 P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:51.906605 8539 raft_consensus.cc:729] T a5eedeb5018d4d48b1a44b59f95b2c38 P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53ee44a9692247e0918779c7732d04c4, State: Initialized, Role: FOLLOWER
I20260619 18:44:51.907181 8539 consensus_queue.cc:260] T a5eedeb5018d4d48b1a44b59f95b2c38 P 53ee44a9692247e0918779c7732d04c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } }
I20260619 18:44:51.907822 8539 raft_consensus.cc:388] T a5eedeb5018d4d48b1a44b59f95b2c38 P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:51.908144 8539 raft_consensus.cc:482] T a5eedeb5018d4d48b1a44b59f95b2c38 P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:51.908463 8539 raft_consensus.cc:3037] T a5eedeb5018d4d48b1a44b59f95b2c38 P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:51.913869 8539 raft_consensus.cc:504] T a5eedeb5018d4d48b1a44b59f95b2c38 P 53ee44a9692247e0918779c7732d04c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } }
I20260619 18:44:51.914505 8539 leader_election.cc:302] T a5eedeb5018d4d48b1a44b59f95b2c38 P 53ee44a9692247e0918779c7732d04c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 53ee44a9692247e0918779c7732d04c4; no voters:
I20260619 18:44:51.915035 8539 leader_election.cc:288] T a5eedeb5018d4d48b1a44b59f95b2c38 P 53ee44a9692247e0918779c7732d04c4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:51.915216 8541 raft_consensus.cc:2781] T a5eedeb5018d4d48b1a44b59f95b2c38 P 53ee44a9692247e0918779c7732d04c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:51.915704 8541 raft_consensus.cc:686] T a5eedeb5018d4d48b1a44b59f95b2c38 P 53ee44a9692247e0918779c7732d04c4 [term 1 LEADER]: Becoming Leader. State: Replica: 53ee44a9692247e0918779c7732d04c4, State: Running, Role: LEADER
I20260619 18:44:51.916417 8539 ts_tablet_manager.cc:1428] T a5eedeb5018d4d48b1a44b59f95b2c38 P 53ee44a9692247e0918779c7732d04c4: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260619 18:44:51.916371 8541 consensus_queue.cc:237] T a5eedeb5018d4d48b1a44b59f95b2c38 P 53ee44a9692247e0918779c7732d04c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } }
I20260619 18:44:51.921763 8384 catalog_manager.cc:5495] T a5eedeb5018d4d48b1a44b59f95b2c38 P 53ee44a9692247e0918779c7732d04c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 53ee44a9692247e0918779c7732d04c4 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "53ee44a9692247e0918779c7732d04c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } health_report { overall_health: HEALTHY } } }
I20260619 18:44:51.941736 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:51.947979 8548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:51.949429 8549 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:51.950680 8551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:51.951484 6627 server_base.cc:1034] running on GCE node
I20260619 18:44:51.952224 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:51.952399 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:51.952574 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894691952563 us; error 0 us; skew 500 ppm
I20260619 18:44:51.953112 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:51.955374 6627 webserver.cc:460] Webserver started at http://127.6.120.194:36679/ using document root <none> and password file <none>
I20260619 18:44:51.955828 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:51.956013 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:51.956300 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:51.957432 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestAutoFlushBackgroundAndErrorCollector.1781894682485826-6627-0/minicluster-data/ts-1-root/instance:
uuid: "d13ca347dc3e44fbaba0d76f995c8b96"
format_stamp: "Formatted at 2026-06-19 18:44:51 on dist-test-slave-90mn"
I20260619 18:44:51.962587 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.001s
I20260619 18:44:51.965857 8556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:51.966701 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260619 18:44:51.967018 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestAutoFlushBackgroundAndErrorCollector.1781894682485826-6627-0/minicluster-data/ts-1-root
uuid: "d13ca347dc3e44fbaba0d76f995c8b96"
format_stamp: "Formatted at 2026-06-19 18:44:51 on dist-test-slave-90mn"
I20260619 18:44:51.967304 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestAutoFlushBackgroundAndErrorCollector.1781894682485826-6627-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestAutoFlushBackgroundAndErrorCollector.1781894682485826-6627-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestAutoFlushBackgroundAndErrorCollector.1781894682485826-6627-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:51.995400 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:51.996515 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:52.004631 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:44:52.004894 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:52.005188 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:44:52.005362 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:52.102572 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.194:38223
I20260619 18:44:52.103101 8625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.194:38223 every 8 connection(s)
I20260619 18:44:52.107918 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260619 18:44:52.107903 8626 heartbeater.cc:347] Connected to a master server at 127.6.120.254:38561
I20260619 18:44:52.108460 8626 heartbeater.cc:464] Registering TS with master...
I20260619 18:44:52.109247 8626 heartbeater.cc:511] Master 127.6.120.254:38561 requested a full tablet report, sending...
I20260619 18:44:52.111254 8383 ts_manager.cc:194] Registered new tserver with Master: d13ca347dc3e44fbaba0d76f995c8b96 (127.6.120.194:38223)
I20260619 18:44:52.113325 8383 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41304
W20260619 18:44:52.117571 8628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:52.118114 8629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:52.122540 6627 server_base.cc:1034] running on GCE node
W20260619 18:44:52.123057 8631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:52.123883 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:52.124145 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:52.124322 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894692124308 us; error 0 us; skew 500 ppm
I20260619 18:44:52.124833 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:52.127373 8626 heartbeater.cc:503] Master 127.6.120.254:38561 was elected leader, sending a full tablet report...
I20260619 18:44:52.127660 6627 webserver.cc:460] Webserver started at http://127.6.120.195:46359/ using document root <none> and password file <none>
I20260619 18:44:52.128299 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:52.128528 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:52.128829 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:52.130208 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestAutoFlushBackgroundAndErrorCollector.1781894682485826-6627-0/minicluster-data/ts-2-root/instance:
uuid: "2015ae63ce8c475691dd3d25fc15d3dd"
format_stamp: "Formatted at 2026-06-19 18:44:52 on dist-test-slave-90mn"
I20260619 18:44:52.134322 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260619 18:44:52.137506 8636 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:52.138212 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260619 18:44:52.138473 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestAutoFlushBackgroundAndErrorCollector.1781894682485826-6627-0/minicluster-data/ts-2-root
uuid: "2015ae63ce8c475691dd3d25fc15d3dd"
format_stamp: "Formatted at 2026-06-19 18:44:52 on dist-test-slave-90mn"
I20260619 18:44:52.138736 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestAutoFlushBackgroundAndErrorCollector.1781894682485826-6627-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestAutoFlushBackgroundAndErrorCollector.1781894682485826-6627-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestAutoFlushBackgroundAndErrorCollector.1781894682485826-6627-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:52.151865 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:52.153023 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:52.161872 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:44:52.162147 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:52.162402 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:44:52.162576 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:52.263844 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.195:42309
I20260619 18:44:52.263937 8705 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.195:42309 every 8 connection(s)
I20260619 18:44:52.269143 8706 heartbeater.cc:347] Connected to a master server at 127.6.120.254:38561
I20260619 18:44:52.269606 8706 heartbeater.cc:464] Registering TS with master...
I20260619 18:44:52.270641 8706 heartbeater.cc:511] Master 127.6.120.254:38561 requested a full tablet report, sending...
I20260619 18:44:52.272472 8383 ts_manager.cc:194] Registered new tserver with Master: 2015ae63ce8c475691dd3d25fc15d3dd (127.6.120.195:42309)
I20260619 18:44:52.273222 6627 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.005069192s
I20260619 18:44:52.274029 8383 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41326
I20260619 18:44:52.275292 8384 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41292:
name: "table.0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\001\000\000\000""\004\001\000\001\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 18:44:52.277218 8384 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table table.0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 18:44:52.287287 8706 heartbeater.cc:503] Master 127.6.120.254:38561 was elected leader, sending a full tablet report...
I20260619 18:44:52.316428 8671 tablet_service.cc:1467] Processing CreateTablet for tablet 5bdd420404394b0a813ce08034fcb8e7 (DEFAULT_TABLE table=table.0 [id=a58be4ce34714cd7965ced9a2432e3ba]), partition=RANGE (key) PARTITION VALUES < 1
I20260619 18:44:52.317024 8670 tablet_service.cc:1467] Processing CreateTablet for tablet e81d4ac0aefa4a7dbe95b3fb66f7228e (DEFAULT_TABLE table=table.0 [id=a58be4ce34714cd7965ced9a2432e3ba]), partition=RANGE (key) PARTITION 1 <= VALUES
I20260619 18:44:52.317764 8671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bdd420404394b0a813ce08034fcb8e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:52.318356 8670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e81d4ac0aefa4a7dbe95b3fb66f7228e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:52.335120 8494 tablet_service.cc:1467] Processing CreateTablet for tablet 5bdd420404394b0a813ce08034fcb8e7 (DEFAULT_TABLE table=table.0 [id=a58be4ce34714cd7965ced9a2432e3ba]), partition=RANGE (key) PARTITION VALUES < 1
I20260619 18:44:52.335443 8493 tablet_service.cc:1467] Processing CreateTablet for tablet e81d4ac0aefa4a7dbe95b3fb66f7228e (DEFAULT_TABLE table=table.0 [id=a58be4ce34714cd7965ced9a2432e3ba]), partition=RANGE (key) PARTITION 1 <= VALUES
I20260619 18:44:52.335826 8591 tablet_service.cc:1467] Processing CreateTablet for tablet 5bdd420404394b0a813ce08034fcb8e7 (DEFAULT_TABLE table=table.0 [id=a58be4ce34714cd7965ced9a2432e3ba]), partition=RANGE (key) PARTITION VALUES < 1
I20260619 18:44:52.336467 8494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bdd420404394b0a813ce08034fcb8e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:52.337141 8493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e81d4ac0aefa4a7dbe95b3fb66f7228e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:52.337193 8591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bdd420404394b0a813ce08034fcb8e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:52.335826 8590 tablet_service.cc:1467] Processing CreateTablet for tablet e81d4ac0aefa4a7dbe95b3fb66f7228e (DEFAULT_TABLE table=table.0 [id=a58be4ce34714cd7965ced9a2432e3ba]), partition=RANGE (key) PARTITION 1 <= VALUES
I20260619 18:44:52.338769 8590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e81d4ac0aefa4a7dbe95b3fb66f7228e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:52.343822 8711 tablet_bootstrap.cc:492] T 5bdd420404394b0a813ce08034fcb8e7 P 2015ae63ce8c475691dd3d25fc15d3dd: Bootstrap starting.
I20260619 18:44:52.353586 8711 tablet_bootstrap.cc:654] T 5bdd420404394b0a813ce08034fcb8e7 P 2015ae63ce8c475691dd3d25fc15d3dd: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:52.357331 8539 tablet_bootstrap.cc:492] T 5bdd420404394b0a813ce08034fcb8e7 P 53ee44a9692247e0918779c7732d04c4: Bootstrap starting.
I20260619 18:44:52.365880 8539 tablet_bootstrap.cc:654] T 5bdd420404394b0a813ce08034fcb8e7 P 53ee44a9692247e0918779c7732d04c4: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:52.378652 8712 tablet_bootstrap.cc:492] T 5bdd420404394b0a813ce08034fcb8e7 P d13ca347dc3e44fbaba0d76f995c8b96: Bootstrap starting.
I20260619 18:44:52.380791 8711 tablet_bootstrap.cc:492] T 5bdd420404394b0a813ce08034fcb8e7 P 2015ae63ce8c475691dd3d25fc15d3dd: No bootstrap required, opened a new log
I20260619 18:44:52.381287 8711 ts_tablet_manager.cc:1397] T 5bdd420404394b0a813ce08034fcb8e7 P 2015ae63ce8c475691dd3d25fc15d3dd: Time spent bootstrapping tablet: real 0.038s user 0.006s sys 0.009s
I20260619 18:44:52.381523 8539 tablet_bootstrap.cc:492] T 5bdd420404394b0a813ce08034fcb8e7 P 53ee44a9692247e0918779c7732d04c4: No bootstrap required, opened a new log
I20260619 18:44:52.382023 8539 ts_tablet_manager.cc:1397] T 5bdd420404394b0a813ce08034fcb8e7 P 53ee44a9692247e0918779c7732d04c4: Time spent bootstrapping tablet: real 0.026s user 0.006s sys 0.007s
I20260619 18:44:52.383492 8711 raft_consensus.cc:348] T 5bdd420404394b0a813ce08034fcb8e7 P 2015ae63ce8c475691dd3d25fc15d3dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } } peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } }
I20260619 18:44:52.384372 8711 raft_consensus.cc:374] T 5bdd420404394b0a813ce08034fcb8e7 P 2015ae63ce8c475691dd3d25fc15d3dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:52.384703 8711 raft_consensus.cc:729] T 5bdd420404394b0a813ce08034fcb8e7 P 2015ae63ce8c475691dd3d25fc15d3dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2015ae63ce8c475691dd3d25fc15d3dd, State: Initialized, Role: FOLLOWER
I20260619 18:44:52.384703 8539 raft_consensus.cc:348] T 5bdd420404394b0a813ce08034fcb8e7 P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } } peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } }
I20260619 18:44:52.385610 8539 raft_consensus.cc:374] T 5bdd420404394b0a813ce08034fcb8e7 P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:52.385953 8712 tablet_bootstrap.cc:654] T 5bdd420404394b0a813ce08034fcb8e7 P d13ca347dc3e44fbaba0d76f995c8b96: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:52.385567 8711 consensus_queue.cc:260] T 5bdd420404394b0a813ce08034fcb8e7 P 2015ae63ce8c475691dd3d25fc15d3dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } } peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } }
I20260619 18:44:52.386094 8539 raft_consensus.cc:729] T 5bdd420404394b0a813ce08034fcb8e7 P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53ee44a9692247e0918779c7732d04c4, State: Initialized, Role: FOLLOWER
I20260619 18:44:52.387007 8539 consensus_queue.cc:260] T 5bdd420404394b0a813ce08034fcb8e7 P 53ee44a9692247e0918779c7732d04c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } } peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } }
I20260619 18:44:52.389159 8539 ts_tablet_manager.cc:1428] T 5bdd420404394b0a813ce08034fcb8e7 P 53ee44a9692247e0918779c7732d04c4: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260619 18:44:52.390115 8539 tablet_bootstrap.cc:492] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 53ee44a9692247e0918779c7732d04c4: Bootstrap starting.
I20260619 18:44:52.396638 8539 tablet_bootstrap.cc:654] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 53ee44a9692247e0918779c7732d04c4: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:52.401428 8711 ts_tablet_manager.cc:1428] T 5bdd420404394b0a813ce08034fcb8e7 P 2015ae63ce8c475691dd3d25fc15d3dd: Time spent starting tablet: real 0.020s user 0.006s sys 0.005s
I20260619 18:44:52.402462 8711 tablet_bootstrap.cc:492] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 2015ae63ce8c475691dd3d25fc15d3dd: Bootstrap starting.
I20260619 18:44:52.409077 8711 tablet_bootstrap.cc:654] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 2015ae63ce8c475691dd3d25fc15d3dd: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:52.414301 8712 tablet_bootstrap.cc:492] T 5bdd420404394b0a813ce08034fcb8e7 P d13ca347dc3e44fbaba0d76f995c8b96: No bootstrap required, opened a new log
I20260619 18:44:52.414757 8539 tablet_bootstrap.cc:492] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 53ee44a9692247e0918779c7732d04c4: No bootstrap required, opened a new log
I20260619 18:44:52.414860 8712 ts_tablet_manager.cc:1397] T 5bdd420404394b0a813ce08034fcb8e7 P d13ca347dc3e44fbaba0d76f995c8b96: Time spent bootstrapping tablet: real 0.037s user 0.014s sys 0.007s
I20260619 18:44:52.415262 8539 ts_tablet_manager.cc:1397] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 53ee44a9692247e0918779c7732d04c4: Time spent bootstrapping tablet: real 0.025s user 0.010s sys 0.015s
I20260619 18:44:52.417122 8711 tablet_bootstrap.cc:492] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 2015ae63ce8c475691dd3d25fc15d3dd: No bootstrap required, opened a new log
I20260619 18:44:52.417496 8711 ts_tablet_manager.cc:1397] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 2015ae63ce8c475691dd3d25fc15d3dd: Time spent bootstrapping tablet: real 0.015s user 0.011s sys 0.000s
I20260619 18:44:52.418097 8712 raft_consensus.cc:348] T 5bdd420404394b0a813ce08034fcb8e7 P d13ca347dc3e44fbaba0d76f995c8b96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } } peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } }
I20260619 18:44:52.418257 8539 raft_consensus.cc:348] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } } peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } }
I20260619 18:44:52.418906 8712 raft_consensus.cc:374] T 5bdd420404394b0a813ce08034fcb8e7 P d13ca347dc3e44fbaba0d76f995c8b96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:52.419016 8539 raft_consensus.cc:374] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:52.419306 8712 raft_consensus.cc:729] T 5bdd420404394b0a813ce08034fcb8e7 P d13ca347dc3e44fbaba0d76f995c8b96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d13ca347dc3e44fbaba0d76f995c8b96, State: Initialized, Role: FOLLOWER
I20260619 18:44:52.419350 8539 raft_consensus.cc:729] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53ee44a9692247e0918779c7732d04c4, State: Initialized, Role: FOLLOWER
I20260619 18:44:52.419590 8711 raft_consensus.cc:348] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 2015ae63ce8c475691dd3d25fc15d3dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } } peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } }
I20260619 18:44:52.420404 8711 raft_consensus.cc:374] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 2015ae63ce8c475691dd3d25fc15d3dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:52.420238 8712 consensus_queue.cc:260] T 5bdd420404394b0a813ce08034fcb8e7 P d13ca347dc3e44fbaba0d76f995c8b96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } } peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } }
I20260619 18:44:52.420814 8711 raft_consensus.cc:729] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 2015ae63ce8c475691dd3d25fc15d3dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2015ae63ce8c475691dd3d25fc15d3dd, State: Initialized, Role: FOLLOWER
I20260619 18:44:52.420372 8539 consensus_queue.cc:260] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 53ee44a9692247e0918779c7732d04c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } } peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } }
I20260619 18:44:52.425225 8539 ts_tablet_manager.cc:1428] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 53ee44a9692247e0918779c7732d04c4: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260619 18:44:52.427872 8712 ts_tablet_manager.cc:1428] T 5bdd420404394b0a813ce08034fcb8e7 P d13ca347dc3e44fbaba0d76f995c8b96: Time spent starting tablet: real 0.013s user 0.006s sys 0.005s
I20260619 18:44:52.428797 8712 tablet_bootstrap.cc:492] T e81d4ac0aefa4a7dbe95b3fb66f7228e P d13ca347dc3e44fbaba0d76f995c8b96: Bootstrap starting.
I20260619 18:44:52.422277 8711 consensus_queue.cc:260] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 2015ae63ce8c475691dd3d25fc15d3dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } } peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } }
I20260619 18:44:52.434296 8711 ts_tablet_manager.cc:1428] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 2015ae63ce8c475691dd3d25fc15d3dd: Time spent starting tablet: real 0.017s user 0.006s sys 0.000s
I20260619 18:44:52.434828 8712 tablet_bootstrap.cc:654] T e81d4ac0aefa4a7dbe95b3fb66f7228e P d13ca347dc3e44fbaba0d76f995c8b96: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:52.440361 8712 tablet_bootstrap.cc:492] T e81d4ac0aefa4a7dbe95b3fb66f7228e P d13ca347dc3e44fbaba0d76f995c8b96: No bootstrap required, opened a new log
I20260619 18:44:52.440737 8712 ts_tablet_manager.cc:1397] T e81d4ac0aefa4a7dbe95b3fb66f7228e P d13ca347dc3e44fbaba0d76f995c8b96: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260619 18:44:52.442866 8712 raft_consensus.cc:348] T e81d4ac0aefa4a7dbe95b3fb66f7228e P d13ca347dc3e44fbaba0d76f995c8b96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } } peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } }
I20260619 18:44:52.443356 8712 raft_consensus.cc:374] T e81d4ac0aefa4a7dbe95b3fb66f7228e P d13ca347dc3e44fbaba0d76f995c8b96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:52.443636 8712 raft_consensus.cc:729] T e81d4ac0aefa4a7dbe95b3fb66f7228e P d13ca347dc3e44fbaba0d76f995c8b96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d13ca347dc3e44fbaba0d76f995c8b96, State: Initialized, Role: FOLLOWER
I20260619 18:44:52.444242 8712 consensus_queue.cc:260] T e81d4ac0aefa4a7dbe95b3fb66f7228e P d13ca347dc3e44fbaba0d76f995c8b96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } } peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } }
I20260619 18:44:52.446022 8712 ts_tablet_manager.cc:1428] T e81d4ac0aefa4a7dbe95b3fb66f7228e P d13ca347dc3e44fbaba0d76f995c8b96: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260619 18:44:52.453214 8715 raft_consensus.cc:482] T 5bdd420404394b0a813ce08034fcb8e7 P 2015ae63ce8c475691dd3d25fc15d3dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 18:44:52.453692 8715 raft_consensus.cc:504] T 5bdd420404394b0a813ce08034fcb8e7 P 2015ae63ce8c475691dd3d25fc15d3dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } } peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } }
I20260619 18:44:52.456053 8715 leader_election.cc:288] T 5bdd420404394b0a813ce08034fcb8e7 P 2015ae63ce8c475691dd3d25fc15d3dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d13ca347dc3e44fbaba0d76f995c8b96 (127.6.120.194:38223), 53ee44a9692247e0918779c7732d04c4 (127.6.120.193:34925)
I20260619 18:44:52.472924 8601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bdd420404394b0a813ce08034fcb8e7" candidate_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" is_pre_election: true
I20260619 18:44:52.473902 8601 raft_consensus.cc:2454] T 5bdd420404394b0a813ce08034fcb8e7 P d13ca347dc3e44fbaba0d76f995c8b96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2015ae63ce8c475691dd3d25fc15d3dd in term 0.
I20260619 18:44:52.475191 8639 leader_election.cc:302] T 5bdd420404394b0a813ce08034fcb8e7 P 2015ae63ce8c475691dd3d25fc15d3dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2015ae63ce8c475691dd3d25fc15d3dd, d13ca347dc3e44fbaba0d76f995c8b96; no voters:
I20260619 18:44:52.475914 8715 raft_consensus.cc:2781] T 5bdd420404394b0a813ce08034fcb8e7 P 2015ae63ce8c475691dd3d25fc15d3dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 18:44:52.476266 8715 raft_consensus.cc:482] T 5bdd420404394b0a813ce08034fcb8e7 P 2015ae63ce8c475691dd3d25fc15d3dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 18:44:52.476598 8715 raft_consensus.cc:3037] T 5bdd420404394b0a813ce08034fcb8e7 P 2015ae63ce8c475691dd3d25fc15d3dd [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:52.481798 8715 raft_consensus.cc:504] T 5bdd420404394b0a813ce08034fcb8e7 P 2015ae63ce8c475691dd3d25fc15d3dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } } peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } }
I20260619 18:44:52.481941 8504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bdd420404394b0a813ce08034fcb8e7" candidate_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53ee44a9692247e0918779c7732d04c4" is_pre_election: true
I20260619 18:44:52.482745 8504 raft_consensus.cc:2454] T 5bdd420404394b0a813ce08034fcb8e7 P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2015ae63ce8c475691dd3d25fc15d3dd in term 0.
I20260619 18:44:52.483795 8715 leader_election.cc:288] T 5bdd420404394b0a813ce08034fcb8e7 P 2015ae63ce8c475691dd3d25fc15d3dd [CANDIDATE]: Term 1 election: Requested vote from peers d13ca347dc3e44fbaba0d76f995c8b96 (127.6.120.194:38223), 53ee44a9692247e0918779c7732d04c4 (127.6.120.193:34925)
I20260619 18:44:52.485144 8601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bdd420404394b0a813ce08034fcb8e7" candidate_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d13ca347dc3e44fbaba0d76f995c8b96"
I20260619 18:44:52.485350 8504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bdd420404394b0a813ce08034fcb8e7" candidate_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53ee44a9692247e0918779c7732d04c4"
I20260619 18:44:52.485737 8601 raft_consensus.cc:3037] T 5bdd420404394b0a813ce08034fcb8e7 P d13ca347dc3e44fbaba0d76f995c8b96 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:52.485857 8504 raft_consensus.cc:3037] T 5bdd420404394b0a813ce08034fcb8e7 P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:52.491431 8504 raft_consensus.cc:2454] T 5bdd420404394b0a813ce08034fcb8e7 P 53ee44a9692247e0918779c7732d04c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2015ae63ce8c475691dd3d25fc15d3dd in term 1.
I20260619 18:44:52.491423 8601 raft_consensus.cc:2454] T 5bdd420404394b0a813ce08034fcb8e7 P d13ca347dc3e44fbaba0d76f995c8b96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2015ae63ce8c475691dd3d25fc15d3dd in term 1.
I20260619 18:44:52.492405 8639 leader_election.cc:302] T 5bdd420404394b0a813ce08034fcb8e7 P 2015ae63ce8c475691dd3d25fc15d3dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2015ae63ce8c475691dd3d25fc15d3dd, 53ee44a9692247e0918779c7732d04c4; no voters:
I20260619 18:44:52.493021 8715 raft_consensus.cc:2781] T 5bdd420404394b0a813ce08034fcb8e7 P 2015ae63ce8c475691dd3d25fc15d3dd [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:52.494740 8715 raft_consensus.cc:686] T 5bdd420404394b0a813ce08034fcb8e7 P 2015ae63ce8c475691dd3d25fc15d3dd [term 1 LEADER]: Becoming Leader. State: Replica: 2015ae63ce8c475691dd3d25fc15d3dd, State: Running, Role: LEADER
I20260619 18:44:52.495508 8715 consensus_queue.cc:237] T 5bdd420404394b0a813ce08034fcb8e7 P 2015ae63ce8c475691dd3d25fc15d3dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } } peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } }
I20260619 18:44:52.503067 8381 catalog_manager.cc:5495] T 5bdd420404394b0a813ce08034fcb8e7 P 2015ae63ce8c475691dd3d25fc15d3dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2015ae63ce8c475691dd3d25fc15d3dd (127.6.120.195). New cstate: current_term: 1 leader_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } health_report { overall_health: UNKNOWN } } }
W20260619 18:44:52.518913 8707 tablet.cc:2369] T 5bdd420404394b0a813ce08034fcb8e7 P 2015ae63ce8c475691dd3d25fc15d3dd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 18:44:52.616145 8541 raft_consensus.cc:482] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 18:44:52.616549 8541 raft_consensus.cc:504] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } } peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } }
I20260619 18:44:52.618444 8541 leader_election.cc:288] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 53ee44a9692247e0918779c7732d04c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d13ca347dc3e44fbaba0d76f995c8b96 (127.6.120.194:38223), 2015ae63ce8c475691dd3d25fc15d3dd (127.6.120.195:42309)
I20260619 18:44:52.632902 8601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e81d4ac0aefa4a7dbe95b3fb66f7228e" candidate_uuid: "53ee44a9692247e0918779c7732d04c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" is_pre_election: true
I20260619 18:44:52.633524 8601 raft_consensus.cc:2454] T e81d4ac0aefa4a7dbe95b3fb66f7228e P d13ca347dc3e44fbaba0d76f995c8b96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53ee44a9692247e0918779c7732d04c4 in term 0.
I20260619 18:44:52.634574 8681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e81d4ac0aefa4a7dbe95b3fb66f7228e" candidate_uuid: "53ee44a9692247e0918779c7732d04c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" is_pre_election: true
I20260619 18:44:52.634599 8461 leader_election.cc:302] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 53ee44a9692247e0918779c7732d04c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53ee44a9692247e0918779c7732d04c4, d13ca347dc3e44fbaba0d76f995c8b96; no voters:
I20260619 18:44:52.635254 8681 raft_consensus.cc:2454] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 2015ae63ce8c475691dd3d25fc15d3dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53ee44a9692247e0918779c7732d04c4 in term 0.
I20260619 18:44:52.635645 8541 raft_consensus.cc:2781] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 18:44:52.635998 8541 raft_consensus.cc:482] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 18:44:52.636365 8541 raft_consensus.cc:3037] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:52.643020 8541 raft_consensus.cc:504] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 53ee44a9692247e0918779c7732d04c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } } peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } }
I20260619 18:44:52.644519 8541 leader_election.cc:288] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 53ee44a9692247e0918779c7732d04c4 [CANDIDATE]: Term 1 election: Requested vote from peers d13ca347dc3e44fbaba0d76f995c8b96 (127.6.120.194:38223), 2015ae63ce8c475691dd3d25fc15d3dd (127.6.120.195:42309)
I20260619 18:44:52.645257 8601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e81d4ac0aefa4a7dbe95b3fb66f7228e" candidate_uuid: "53ee44a9692247e0918779c7732d04c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d13ca347dc3e44fbaba0d76f995c8b96"
I20260619 18:44:52.645532 8681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e81d4ac0aefa4a7dbe95b3fb66f7228e" candidate_uuid: "53ee44a9692247e0918779c7732d04c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2015ae63ce8c475691dd3d25fc15d3dd"
I20260619 18:44:52.645781 8601 raft_consensus.cc:3037] T e81d4ac0aefa4a7dbe95b3fb66f7228e P d13ca347dc3e44fbaba0d76f995c8b96 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:52.646092 8681 raft_consensus.cc:3037] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 2015ae63ce8c475691dd3d25fc15d3dd [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:52.650883 8601 raft_consensus.cc:2454] T e81d4ac0aefa4a7dbe95b3fb66f7228e P d13ca347dc3e44fbaba0d76f995c8b96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53ee44a9692247e0918779c7732d04c4 in term 1.
I20260619 18:44:52.651909 8461 leader_election.cc:302] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 53ee44a9692247e0918779c7732d04c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53ee44a9692247e0918779c7732d04c4, d13ca347dc3e44fbaba0d76f995c8b96; no voters:
I20260619 18:44:52.652367 8681 raft_consensus.cc:2454] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 2015ae63ce8c475691dd3d25fc15d3dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53ee44a9692247e0918779c7732d04c4 in term 1.
I20260619 18:44:52.653558 8541 raft_consensus.cc:2781] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 53ee44a9692247e0918779c7732d04c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:52.654568 8541 raft_consensus.cc:686] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 53ee44a9692247e0918779c7732d04c4 [term 1 LEADER]: Becoming Leader. State: Replica: 53ee44a9692247e0918779c7732d04c4, State: Running, Role: LEADER
I20260619 18:44:52.655377 8541 consensus_queue.cc:237] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 53ee44a9692247e0918779c7732d04c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } } peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } }
I20260619 18:44:52.697858 8384 catalog_manager.cc:5495] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 53ee44a9692247e0918779c7732d04c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 53ee44a9692247e0918779c7732d04c4 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "53ee44a9692247e0918779c7732d04c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } health_report { overall_health: UNKNOWN } } }
I20260619 18:44:52.762742 8601 raft_consensus.cc:1261] T e81d4ac0aefa4a7dbe95b3fb66f7228e P d13ca347dc3e44fbaba0d76f995c8b96 [term 1 FOLLOWER]: Refusing update from remote peer 53ee44a9692247e0918779c7732d04c4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 18:44:52.764166 8681 raft_consensus.cc:1261] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 2015ae63ce8c475691dd3d25fc15d3dd [term 1 FOLLOWER]: Refusing update from remote peer 53ee44a9692247e0918779c7732d04c4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 18:44:52.765156 8541 consensus_queue.cc:1035] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 53ee44a9692247e0918779c7732d04c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260619 18:44:52.766438 8504 raft_consensus.cc:1261] T 5bdd420404394b0a813ce08034fcb8e7 P 53ee44a9692247e0918779c7732d04c4 [term 1 FOLLOWER]: Refusing update from remote peer 2015ae63ce8c475691dd3d25fc15d3dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 18:44:52.766309 8727 consensus_queue.cc:1035] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 53ee44a9692247e0918779c7732d04c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 18:44:52.768257 8715 consensus_queue.cc:1035] T 5bdd420404394b0a813ce08034fcb8e7 P 2015ae63ce8c475691dd3d25fc15d3dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260619 18:44:52.768937 8601 raft_consensus.cc:1261] T 5bdd420404394b0a813ce08034fcb8e7 P d13ca347dc3e44fbaba0d76f995c8b96 [term 1 FOLLOWER]: Refusing update from remote peer 2015ae63ce8c475691dd3d25fc15d3dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 18:44:52.773152 8715 consensus_queue.cc:1035] T 5bdd420404394b0a813ce08034fcb8e7 P 2015ae63ce8c475691dd3d25fc15d3dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260619 18:44:52.804040 8734 mvcc.cc:205] Tried to move back new op lower bound from 7298640661516881920 to 7298640661126123520. Current Snapshot: MvccSnapshot[applied={T|T < 7298640661516881920}]
W20260619 18:44:53.342267 6632 kernel_stack_watchdog.cc:198] Thread 8535 stuck at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/rpc/outbound_call.cc:308 for 299ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x440ac0 __tsan::CallUserSignalHandler() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:1915
@ 0x443323 rtl_sigaction() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_atomic_clang_x86.h:81
@ 0x7f13851f9980 (unknown) at ??:0
@ 0x7f13851f8d50 __GI___nanosleep at ??:0
@ 0x46c0dc __interceptor_nanosleep at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:340
@ 0x7f13837ccecb base::SleepForNanoseconds() at ??:0
@ 0x7f1383dcc517 kudu::SleepFor() at ??:0
@ 0x5aae36 kudu::client::ClientTest_TestAutoFlushBackgroundAndErrorCollector_Test::TestBody()::CustomErrorCollector::AddError() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:4436
@ 0x7f138b48d196 kudu::client::internal::Batcher::ProcessWriteResponse() at ??:0
@ 0x7f138b48cabf kudu::client::internal::WriteRpc::Finish() at ??:0
@ 0x7f138b4971c4 kudu::rpc::RetriableRpc<>::SendRpcCb() at ??:0
@ 0x7f138b4ac4ab _ZZN4kudu3rpc12RetriableRpcINS_6client8internal18RemoteTabletServerENS_7tserver14WriteRequestPBENS5_15WriteResponsePBEE14ReplicaFoundCbERKNS_6StatusEPS4_ENKUlvE_clEv at ??:0
@ 0x7f138b4ac422 _ZNSt3__18__invokeIRZN4kudu3rpc12RetriableRpcINS1_6client8internal18RemoteTabletServerENS1_7tserver14WriteRequestPBENS7_15WriteResponsePBEE14ReplicaFoundCbERKNS1_6StatusEPS6_EUlvE_JEEEDTclclsr3std3__1E7forwardIT_Efp_Espclsr3std3__1E7forwardIT0_Efp0_EEEOSH_DpOSI_ at ??:0
@ 0x7f138b4ac3b2 _ZNSt3__128__invoke_void_return_wrapperIvE6__callIJRZN4kudu3rpc12RetriableRpcINS3_6client8internal18RemoteTabletServerENS3_7tserver14WriteRequestPBENS9_15WriteResponsePBEE14ReplicaFoundCbERKNS3_6StatusEPS8_EUlvE_EEEvDpOT_ at ??:0
@ 0x7f138b4ac372 _ZNSt3__110__function12__alloc_funcIZN4kudu3rpc12RetriableRpcINS2_6client8internal18RemoteTabletServerENS2_7tserver14WriteRequestPBENS8_15WriteResponsePBEE14ReplicaFoundCbERKNS2_6StatusEPS7_EUlvE_NS_9allocatorISG_EEFvvEEclEv at ??:0
@ 0x7f138b4aaffe _ZNSt3__110__function6__funcIZN4kudu3rpc12RetriableRpcINS2_6client8internal18RemoteTabletServerENS2_7tserver14WriteRequestPBENS8_15WriteResponsePBEE14ReplicaFoundCbERKNS2_6StatusEPS7_EUlvE_NS_9allocatorISG_EEFvvEEclEv at ??:0
W20260619 18:44:53.765877 6632 kernel_stack_watchdog.cc:198] Thread 8535 stuck at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/rpc/outbound_call.cc:308 for 718ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x440ac0 __tsan::CallUserSignalHandler() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:1915
@ 0x443323 rtl_sigaction() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_atomic_clang_x86.h:81
@ 0x7f13851f9980 (unknown) at ??:0
@ 0x7f13851f8d50 __GI___nanosleep at ??:0
@ 0x46c0dc __interceptor_nanosleep at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:340
@ 0x7f13837ccecb base::SleepForNanoseconds() at ??:0
@ 0x7f1383dcc517 kudu::SleepFor() at ??:0
@ 0x5aae36 kudu::client::ClientTest_TestAutoFlushBackgroundAndErrorCollector_Test::TestBody()::CustomErrorCollector::AddError() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:4436
@ 0x7f138b48d196 kudu::client::internal::Batcher::ProcessWriteResponse() at ??:0
@ 0x7f138b48cabf kudu::client::internal::WriteRpc::Finish() at ??:0
@ 0x7f138b4971c4 kudu::rpc::RetriableRpc<>::SendRpcCb() at ??:0
@ 0x7f138b4ac4ab _ZZN4kudu3rpc12RetriableRpcINS_6client8internal18RemoteTabletServerENS_7tserver14WriteRequestPBENS5_15WriteResponsePBEE14ReplicaFoundCbERKNS_6StatusEPS4_ENKUlvE_clEv at ??:0
@ 0x7f138b4ac422 _ZNSt3__18__invokeIRZN4kudu3rpc12RetriableRpcINS1_6client8internal18RemoteTabletServerENS1_7tserver14WriteRequestPBENS7_15WriteResponsePBEE14ReplicaFoundCbERKNS1_6StatusEPS6_EUlvE_JEEEDTclclsr3std3__1E7forwardIT_Efp_Espclsr3std3__1E7forwardIT0_Efp0_EEEOSH_DpOSI_ at ??:0
@ 0x7f138b4ac3b2 _ZNSt3__128__invoke_void_return_wrapperIvE6__callIJRZN4kudu3rpc12RetriableRpcINS3_6client8internal18RemoteTabletServerENS3_7tserver14WriteRequestPBENS9_15WriteResponsePBEE14ReplicaFoundCbERKNS3_6StatusEPS8_EUlvE_EEEvDpOT_ at ??:0
@ 0x7f138b4ac372 _ZNSt3__110__function12__alloc_funcIZN4kudu3rpc12RetriableRpcINS2_6client8internal18RemoteTabletServerENS2_7tserver14WriteRequestPBENS8_15WriteResponsePBEE14ReplicaFoundCbERKNS2_6StatusEPS7_EUlvE_NS_9allocatorISG_EEFvvEEclEv at ??:0
@ 0x7f138b4aaffe _ZNSt3__110__function6__funcIZN4kudu3rpc12RetriableRpcINS2_6client8internal18RemoteTabletServerENS2_7tserver14WriteRequestPBENS8_15WriteResponsePBEE14ReplicaFoundCbERKNS2_6StatusEPS7_EUlvE_NS_9allocatorISG_EEFvvEEclEv at ??:0
W20260619 18:44:53.828878 8535 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.6.120.195:42309, user_credentials={real_user=slave}} blocked reactor thread for 1.00361e+06us
I20260619 18:44:53.831007 8384 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41292:
name: "table.1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\001\000\000\000""\004\001\000\001\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 18:44:53.833039 8384 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table table.1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 18:44:53.878199 8591 tablet_service.cc:1467] Processing CreateTablet for tablet 477edff4095c47869451ca4f9c385e8f (DEFAULT_TABLE table=table.1 [id=be787a90946945f8af46fb99441bf644]), partition=RANGE (key) PARTITION VALUES < 1
I20260619 18:44:53.879823 8591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 477edff4095c47869451ca4f9c385e8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:53.881086 8493 tablet_service.cc:1467] Processing CreateTablet for tablet 477edff4095c47869451ca4f9c385e8f (DEFAULT_TABLE table=table.1 [id=be787a90946945f8af46fb99441bf644]), partition=RANGE (key) PARTITION VALUES < 1
I20260619 18:44:53.887415 8493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 477edff4095c47869451ca4f9c385e8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:53.887603 8671 tablet_service.cc:1467] Processing CreateTablet for tablet 0ffb155667f945e7a4308039c35039d7 (DEFAULT_TABLE table=table.1 [id=be787a90946945f8af46fb99441bf644]), partition=RANGE (key) PARTITION 1 <= VALUES
I20260619 18:44:53.888875 8671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ffb155667f945e7a4308039c35039d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:53.881203 8494 tablet_service.cc:1467] Processing CreateTablet for tablet 0ffb155667f945e7a4308039c35039d7 (DEFAULT_TABLE table=table.1 [id=be787a90946945f8af46fb99441bf644]), partition=RANGE (key) PARTITION 1 <= VALUES
I20260619 18:44:53.893708 8494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ffb155667f945e7a4308039c35039d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:53.884413 8670 tablet_service.cc:1467] Processing CreateTablet for tablet 477edff4095c47869451ca4f9c385e8f (DEFAULT_TABLE table=table.1 [id=be787a90946945f8af46fb99441bf644]), partition=RANGE (key) PARTITION VALUES < 1
I20260619 18:44:53.897524 8670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 477edff4095c47869451ca4f9c385e8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:53.884445 8590 tablet_service.cc:1467] Processing CreateTablet for tablet 0ffb155667f945e7a4308039c35039d7 (DEFAULT_TABLE table=table.1 [id=be787a90946945f8af46fb99441bf644]), partition=RANGE (key) PARTITION 1 <= VALUES
I20260619 18:44:53.899824 8590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ffb155667f945e7a4308039c35039d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:53.958678 8762 tablet_bootstrap.cc:492] T 477edff4095c47869451ca4f9c385e8f P 53ee44a9692247e0918779c7732d04c4: Bootstrap starting.
I20260619 18:44:53.966272 8762 tablet_bootstrap.cc:654] T 477edff4095c47869451ca4f9c385e8f P 53ee44a9692247e0918779c7732d04c4: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:53.997570 8761 tablet_bootstrap.cc:492] T 477edff4095c47869451ca4f9c385e8f P d13ca347dc3e44fbaba0d76f995c8b96: Bootstrap starting.
I20260619 18:44:53.998461 8764 tablet_bootstrap.cc:492] T 0ffb155667f945e7a4308039c35039d7 P 2015ae63ce8c475691dd3d25fc15d3dd: Bootstrap starting.
I20260619 18:44:53.999732 8762 tablet_bootstrap.cc:492] T 477edff4095c47869451ca4f9c385e8f P 53ee44a9692247e0918779c7732d04c4: No bootstrap required, opened a new log
I20260619 18:44:54.000250 8762 ts_tablet_manager.cc:1397] T 477edff4095c47869451ca4f9c385e8f P 53ee44a9692247e0918779c7732d04c4: Time spent bootstrapping tablet: real 0.042s user 0.010s sys 0.028s
I20260619 18:44:54.003435 8762 raft_consensus.cc:348] T 477edff4095c47869451ca4f9c385e8f P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } } peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } }
I20260619 18:44:54.004253 8762 raft_consensus.cc:374] T 477edff4095c47869451ca4f9c385e8f P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:54.004570 8762 raft_consensus.cc:729] T 477edff4095c47869451ca4f9c385e8f P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53ee44a9692247e0918779c7732d04c4, State: Initialized, Role: FOLLOWER
I20260619 18:44:54.006343 8762 consensus_queue.cc:260] T 477edff4095c47869451ca4f9c385e8f P 53ee44a9692247e0918779c7732d04c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } } peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } }
I20260619 18:44:54.008842 8762 ts_tablet_manager.cc:1428] T 477edff4095c47869451ca4f9c385e8f P 53ee44a9692247e0918779c7732d04c4: Time spent starting tablet: real 0.008s user 0.001s sys 0.006s
I20260619 18:44:54.009703 8762 tablet_bootstrap.cc:492] T 0ffb155667f945e7a4308039c35039d7 P 53ee44a9692247e0918779c7732d04c4: Bootstrap starting.
I20260619 18:44:54.012868 8764 tablet_bootstrap.cc:654] T 0ffb155667f945e7a4308039c35039d7 P 2015ae63ce8c475691dd3d25fc15d3dd: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:54.015511 8762 tablet_bootstrap.cc:654] T 0ffb155667f945e7a4308039c35039d7 P 53ee44a9692247e0918779c7732d04c4: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:54.003923 8761 tablet_bootstrap.cc:654] T 477edff4095c47869451ca4f9c385e8f P d13ca347dc3e44fbaba0d76f995c8b96: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:54.032527 8761 tablet_bootstrap.cc:492] T 477edff4095c47869451ca4f9c385e8f P d13ca347dc3e44fbaba0d76f995c8b96: No bootstrap required, opened a new log
I20260619 18:44:54.032995 8761 ts_tablet_manager.cc:1397] T 477edff4095c47869451ca4f9c385e8f P d13ca347dc3e44fbaba0d76f995c8b96: Time spent bootstrapping tablet: real 0.036s user 0.016s sys 0.000s
I20260619 18:44:54.036239 8762 tablet_bootstrap.cc:492] T 0ffb155667f945e7a4308039c35039d7 P 53ee44a9692247e0918779c7732d04c4: No bootstrap required, opened a new log
I20260619 18:44:54.036711 8762 ts_tablet_manager.cc:1397] T 0ffb155667f945e7a4308039c35039d7 P 53ee44a9692247e0918779c7732d04c4: Time spent bootstrapping tablet: real 0.027s user 0.005s sys 0.021s
I20260619 18:44:54.036988 8764 tablet_bootstrap.cc:492] T 0ffb155667f945e7a4308039c35039d7 P 2015ae63ce8c475691dd3d25fc15d3dd: No bootstrap required, opened a new log
I20260619 18:44:54.037413 8764 ts_tablet_manager.cc:1397] T 0ffb155667f945e7a4308039c35039d7 P 2015ae63ce8c475691dd3d25fc15d3dd: Time spent bootstrapping tablet: real 0.039s user 0.004s sys 0.011s
I20260619 18:44:54.039212 8761 raft_consensus.cc:348] T 477edff4095c47869451ca4f9c385e8f P d13ca347dc3e44fbaba0d76f995c8b96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } } peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } }
I20260619 18:44:54.041450 8761 raft_consensus.cc:374] T 477edff4095c47869451ca4f9c385e8f P d13ca347dc3e44fbaba0d76f995c8b96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:54.041728 8761 raft_consensus.cc:729] T 477edff4095c47869451ca4f9c385e8f P d13ca347dc3e44fbaba0d76f995c8b96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d13ca347dc3e44fbaba0d76f995c8b96, State: Initialized, Role: FOLLOWER
I20260619 18:44:54.042461 8761 consensus_queue.cc:260] T 477edff4095c47869451ca4f9c385e8f P d13ca347dc3e44fbaba0d76f995c8b96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } } peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } }
I20260619 18:44:54.044847 8762 raft_consensus.cc:348] T 0ffb155667f945e7a4308039c35039d7 P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } } peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } }
I20260619 18:44:54.045511 8762 raft_consensus.cc:374] T 0ffb155667f945e7a4308039c35039d7 P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:54.045770 8762 raft_consensus.cc:729] T 0ffb155667f945e7a4308039c35039d7 P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53ee44a9692247e0918779c7732d04c4, State: Initialized, Role: FOLLOWER
I20260619 18:44:54.046451 8762 consensus_queue.cc:260] T 0ffb155667f945e7a4308039c35039d7 P 53ee44a9692247e0918779c7732d04c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } } peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } }
I20260619 18:44:54.046984 8764 raft_consensus.cc:348] T 0ffb155667f945e7a4308039c35039d7 P 2015ae63ce8c475691dd3d25fc15d3dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } } peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } }
I20260619 18:44:54.051270 8764 raft_consensus.cc:374] T 0ffb155667f945e7a4308039c35039d7 P 2015ae63ce8c475691dd3d25fc15d3dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:54.051644 8764 raft_consensus.cc:729] T 0ffb155667f945e7a4308039c35039d7 P 2015ae63ce8c475691dd3d25fc15d3dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2015ae63ce8c475691dd3d25fc15d3dd, State: Initialized, Role: FOLLOWER
I20260619 18:44:54.052630 8764 consensus_queue.cc:260] T 0ffb155667f945e7a4308039c35039d7 P 2015ae63ce8c475691dd3d25fc15d3dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } } peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } }
I20260619 18:44:54.053452 8762 ts_tablet_manager.cc:1428] T 0ffb155667f945e7a4308039c35039d7 P 53ee44a9692247e0918779c7732d04c4: Time spent starting tablet: real 0.016s user 0.003s sys 0.003s
I20260619 18:44:54.057893 8764 ts_tablet_manager.cc:1428] T 0ffb155667f945e7a4308039c35039d7 P 2015ae63ce8c475691dd3d25fc15d3dd: Time spent starting tablet: real 0.020s user 0.004s sys 0.003s
I20260619 18:44:54.059120 8764 tablet_bootstrap.cc:492] T 477edff4095c47869451ca4f9c385e8f P 2015ae63ce8c475691dd3d25fc15d3dd: Bootstrap starting.
I20260619 18:44:54.064827 8761 ts_tablet_manager.cc:1428] T 477edff4095c47869451ca4f9c385e8f P d13ca347dc3e44fbaba0d76f995c8b96: Time spent starting tablet: real 0.032s user 0.010s sys 0.017s
I20260619 18:44:54.065678 8761 tablet_bootstrap.cc:492] T 0ffb155667f945e7a4308039c35039d7 P d13ca347dc3e44fbaba0d76f995c8b96: Bootstrap starting.
I20260619 18:44:54.069836 8764 tablet_bootstrap.cc:654] T 477edff4095c47869451ca4f9c385e8f P 2015ae63ce8c475691dd3d25fc15d3dd: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:54.071827 8761 tablet_bootstrap.cc:654] T 0ffb155667f945e7a4308039c35039d7 P d13ca347dc3e44fbaba0d76f995c8b96: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:54.082377 8764 tablet_bootstrap.cc:492] T 477edff4095c47869451ca4f9c385e8f P 2015ae63ce8c475691dd3d25fc15d3dd: No bootstrap required, opened a new log
I20260619 18:44:54.082973 8764 ts_tablet_manager.cc:1397] T 477edff4095c47869451ca4f9c385e8f P 2015ae63ce8c475691dd3d25fc15d3dd: Time spent bootstrapping tablet: real 0.024s user 0.011s sys 0.005s
I20260619 18:44:54.086396 8764 raft_consensus.cc:348] T 477edff4095c47869451ca4f9c385e8f P 2015ae63ce8c475691dd3d25fc15d3dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } } peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } }
I20260619 18:44:54.087383 8764 raft_consensus.cc:374] T 477edff4095c47869451ca4f9c385e8f P 2015ae63ce8c475691dd3d25fc15d3dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:54.087738 8764 raft_consensus.cc:729] T 477edff4095c47869451ca4f9c385e8f P 2015ae63ce8c475691dd3d25fc15d3dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2015ae63ce8c475691dd3d25fc15d3dd, State: Initialized, Role: FOLLOWER
I20260619 18:44:54.089555 8764 consensus_queue.cc:260] T 477edff4095c47869451ca4f9c385e8f P 2015ae63ce8c475691dd3d25fc15d3dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } } peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } }
I20260619 18:44:54.091948 8764 ts_tablet_manager.cc:1428] T 477edff4095c47869451ca4f9c385e8f P 2015ae63ce8c475691dd3d25fc15d3dd: Time spent starting tablet: real 0.009s user 0.007s sys 0.002s
I20260619 18:44:54.092558 8761 tablet_bootstrap.cc:492] T 0ffb155667f945e7a4308039c35039d7 P d13ca347dc3e44fbaba0d76f995c8b96: No bootstrap required, opened a new log
I20260619 18:44:54.092993 8761 ts_tablet_manager.cc:1397] T 0ffb155667f945e7a4308039c35039d7 P d13ca347dc3e44fbaba0d76f995c8b96: Time spent bootstrapping tablet: real 0.027s user 0.022s sys 0.003s
I20260619 18:44:54.095985 8761 raft_consensus.cc:348] T 0ffb155667f945e7a4308039c35039d7 P d13ca347dc3e44fbaba0d76f995c8b96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } } peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } }
I20260619 18:44:54.098165 8761 raft_consensus.cc:374] T 0ffb155667f945e7a4308039c35039d7 P d13ca347dc3e44fbaba0d76f995c8b96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:54.098418 8761 raft_consensus.cc:729] T 0ffb155667f945e7a4308039c35039d7 P d13ca347dc3e44fbaba0d76f995c8b96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d13ca347dc3e44fbaba0d76f995c8b96, State: Initialized, Role: FOLLOWER
I20260619 18:44:54.099009 8761 consensus_queue.cc:260] T 0ffb155667f945e7a4308039c35039d7 P d13ca347dc3e44fbaba0d76f995c8b96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } } peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } }
I20260619 18:44:54.100936 8761 ts_tablet_manager.cc:1428] T 0ffb155667f945e7a4308039c35039d7 P d13ca347dc3e44fbaba0d76f995c8b96: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260619 18:44:54.119594 8768 raft_consensus.cc:482] T 0ffb155667f945e7a4308039c35039d7 P d13ca347dc3e44fbaba0d76f995c8b96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 18:44:54.120178 8768 raft_consensus.cc:504] T 0ffb155667f945e7a4308039c35039d7 P d13ca347dc3e44fbaba0d76f995c8b96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } } peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } }
I20260619 18:44:54.122565 8768 leader_election.cc:288] T 0ffb155667f945e7a4308039c35039d7 P d13ca347dc3e44fbaba0d76f995c8b96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53ee44a9692247e0918779c7732d04c4 (127.6.120.193:34925), 2015ae63ce8c475691dd3d25fc15d3dd (127.6.120.195:42309)
I20260619 18:44:54.136888 8747 raft_consensus.cc:482] T 477edff4095c47869451ca4f9c385e8f P 2015ae63ce8c475691dd3d25fc15d3dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 18:44:54.137380 8747 raft_consensus.cc:504] T 477edff4095c47869451ca4f9c385e8f P 2015ae63ce8c475691dd3d25fc15d3dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } } peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } }
I20260619 18:44:54.139595 8747 leader_election.cc:288] T 477edff4095c47869451ca4f9c385e8f P 2015ae63ce8c475691dd3d25fc15d3dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d13ca347dc3e44fbaba0d76f995c8b96 (127.6.120.194:38223), 53ee44a9692247e0918779c7732d04c4 (127.6.120.193:34925)
I20260619 18:44:54.141701 8601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "477edff4095c47869451ca4f9c385e8f" candidate_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" is_pre_election: true
I20260619 18:44:54.142465 8601 raft_consensus.cc:2454] T 477edff4095c47869451ca4f9c385e8f P d13ca347dc3e44fbaba0d76f995c8b96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2015ae63ce8c475691dd3d25fc15d3dd in term 0.
I20260619 18:44:54.143537 8504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "477edff4095c47869451ca4f9c385e8f" candidate_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53ee44a9692247e0918779c7732d04c4" is_pre_election: true
I20260619 18:44:54.144177 8504 raft_consensus.cc:2454] T 477edff4095c47869451ca4f9c385e8f P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2015ae63ce8c475691dd3d25fc15d3dd in term 0.
I20260619 18:44:54.145609 8639 leader_election.cc:302] T 477edff4095c47869451ca4f9c385e8f P 2015ae63ce8c475691dd3d25fc15d3dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2015ae63ce8c475691dd3d25fc15d3dd, d13ca347dc3e44fbaba0d76f995c8b96; no voters:
I20260619 18:44:54.146931 8747 raft_consensus.cc:2781] T 477edff4095c47869451ca4f9c385e8f P 2015ae63ce8c475691dd3d25fc15d3dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 18:44:54.147262 8747 raft_consensus.cc:482] T 477edff4095c47869451ca4f9c385e8f P 2015ae63ce8c475691dd3d25fc15d3dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 18:44:54.147557 8747 raft_consensus.cc:3037] T 477edff4095c47869451ca4f9c385e8f P 2015ae63ce8c475691dd3d25fc15d3dd [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:54.154006 8747 raft_consensus.cc:504] T 477edff4095c47869451ca4f9c385e8f P 2015ae63ce8c475691dd3d25fc15d3dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } } peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } }
I20260619 18:44:54.154891 8504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ffb155667f945e7a4308039c35039d7" candidate_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53ee44a9692247e0918779c7732d04c4" is_pre_election: true
I20260619 18:44:54.155476 8504 raft_consensus.cc:2454] T 0ffb155667f945e7a4308039c35039d7 P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d13ca347dc3e44fbaba0d76f995c8b96 in term 0.
I20260619 18:44:54.156009 8680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ffb155667f945e7a4308039c35039d7" candidate_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" is_pre_election: true
I20260619 18:44:54.156661 8680 raft_consensus.cc:2454] T 0ffb155667f945e7a4308039c35039d7 P 2015ae63ce8c475691dd3d25fc15d3dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d13ca347dc3e44fbaba0d76f995c8b96 in term 0.
I20260619 18:44:54.156957 8601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "477edff4095c47869451ca4f9c385e8f" candidate_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d13ca347dc3e44fbaba0d76f995c8b96"
I20260619 18:44:54.157501 8601 raft_consensus.cc:3037] T 477edff4095c47869451ca4f9c385e8f P d13ca347dc3e44fbaba0d76f995c8b96 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:54.156651 8559 leader_election.cc:302] T 0ffb155667f945e7a4308039c35039d7 P d13ca347dc3e44fbaba0d76f995c8b96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53ee44a9692247e0918779c7732d04c4, d13ca347dc3e44fbaba0d76f995c8b96; no voters:
I20260619 18:44:54.161587 8768 raft_consensus.cc:2781] T 0ffb155667f945e7a4308039c35039d7 P d13ca347dc3e44fbaba0d76f995c8b96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 18:44:54.161887 8768 raft_consensus.cc:482] T 0ffb155667f945e7a4308039c35039d7 P d13ca347dc3e44fbaba0d76f995c8b96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 18:44:54.162215 8768 raft_consensus.cc:3037] T 0ffb155667f945e7a4308039c35039d7 P d13ca347dc3e44fbaba0d76f995c8b96 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:54.170328 8747 leader_election.cc:288] T 477edff4095c47869451ca4f9c385e8f P 2015ae63ce8c475691dd3d25fc15d3dd [CANDIDATE]: Term 1 election: Requested vote from peers d13ca347dc3e44fbaba0d76f995c8b96 (127.6.120.194:38223), 53ee44a9692247e0918779c7732d04c4 (127.6.120.193:34925)
I20260619 18:44:54.171833 8504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "477edff4095c47869451ca4f9c385e8f" candidate_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53ee44a9692247e0918779c7732d04c4"
I20260619 18:44:54.172426 8504 raft_consensus.cc:3037] T 477edff4095c47869451ca4f9c385e8f P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:54.174595 8601 raft_consensus.cc:2454] T 477edff4095c47869451ca4f9c385e8f P d13ca347dc3e44fbaba0d76f995c8b96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2015ae63ce8c475691dd3d25fc15d3dd in term 1.
I20260619 18:44:54.176400 8639 leader_election.cc:302] T 477edff4095c47869451ca4f9c385e8f P 2015ae63ce8c475691dd3d25fc15d3dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2015ae63ce8c475691dd3d25fc15d3dd, d13ca347dc3e44fbaba0d76f995c8b96; no voters:
I20260619 18:44:54.177165 8747 raft_consensus.cc:2781] T 477edff4095c47869451ca4f9c385e8f P 2015ae63ce8c475691dd3d25fc15d3dd [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:54.177048 8768 raft_consensus.cc:504] T 0ffb155667f945e7a4308039c35039d7 P d13ca347dc3e44fbaba0d76f995c8b96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } } peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } }
I20260619 18:44:54.179725 8768 leader_election.cc:288] T 0ffb155667f945e7a4308039c35039d7 P d13ca347dc3e44fbaba0d76f995c8b96 [CANDIDATE]: Term 1 election: Requested vote from peers 53ee44a9692247e0918779c7732d04c4 (127.6.120.193:34925), 2015ae63ce8c475691dd3d25fc15d3dd (127.6.120.195:42309)
I20260619 18:44:54.179775 8503 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ffb155667f945e7a4308039c35039d7" candidate_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53ee44a9692247e0918779c7732d04c4"
I20260619 18:44:54.180513 8503 raft_consensus.cc:3037] T 0ffb155667f945e7a4308039c35039d7 P 53ee44a9692247e0918779c7732d04c4 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:54.181181 8680 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ffb155667f945e7a4308039c35039d7" candidate_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2015ae63ce8c475691dd3d25fc15d3dd"
I20260619 18:44:54.181768 8680 raft_consensus.cc:3037] T 0ffb155667f945e7a4308039c35039d7 P 2015ae63ce8c475691dd3d25fc15d3dd [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:54.180464 8504 raft_consensus.cc:2454] T 477edff4095c47869451ca4f9c385e8f P 53ee44a9692247e0918779c7732d04c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2015ae63ce8c475691dd3d25fc15d3dd in term 1.
I20260619 18:44:54.187924 8503 raft_consensus.cc:2454] T 0ffb155667f945e7a4308039c35039d7 P 53ee44a9692247e0918779c7732d04c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d13ca347dc3e44fbaba0d76f995c8b96 in term 1.
I20260619 18:44:54.188984 8559 leader_election.cc:302] T 0ffb155667f945e7a4308039c35039d7 P d13ca347dc3e44fbaba0d76f995c8b96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53ee44a9692247e0918779c7732d04c4, d13ca347dc3e44fbaba0d76f995c8b96; no voters:
I20260619 18:44:54.189817 8768 raft_consensus.cc:2781] T 0ffb155667f945e7a4308039c35039d7 P d13ca347dc3e44fbaba0d76f995c8b96 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:54.190626 8680 raft_consensus.cc:2454] T 0ffb155667f945e7a4308039c35039d7 P 2015ae63ce8c475691dd3d25fc15d3dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d13ca347dc3e44fbaba0d76f995c8b96 in term 1.
I20260619 18:44:54.192404 8768 raft_consensus.cc:686] T 0ffb155667f945e7a4308039c35039d7 P d13ca347dc3e44fbaba0d76f995c8b96 [term 1 LEADER]: Becoming Leader. State: Replica: d13ca347dc3e44fbaba0d76f995c8b96, State: Running, Role: LEADER
I20260619 18:44:54.193260 8768 consensus_queue.cc:237] T 0ffb155667f945e7a4308039c35039d7 P d13ca347dc3e44fbaba0d76f995c8b96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } } peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } }
I20260619 18:44:54.194401 8747 raft_consensus.cc:686] T 477edff4095c47869451ca4f9c385e8f P 2015ae63ce8c475691dd3d25fc15d3dd [term 1 LEADER]: Becoming Leader. State: Replica: 2015ae63ce8c475691dd3d25fc15d3dd, State: Running, Role: LEADER
I20260619 18:44:54.195194 8747 consensus_queue.cc:237] T 477edff4095c47869451ca4f9c385e8f P 2015ae63ce8c475691dd3d25fc15d3dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } } peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } } peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } }
I20260619 18:44:54.202066 8383 catalog_manager.cc:5495] T 0ffb155667f945e7a4308039c35039d7 P d13ca347dc3e44fbaba0d76f995c8b96 reported cstate change: term changed from 0 to 1, leader changed from <none> to d13ca347dc3e44fbaba0d76f995c8b96 (127.6.120.194). New cstate: current_term: 1 leader_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } health_report { overall_health: UNKNOWN } } }
I20260619 18:44:54.203680 8382 catalog_manager.cc:5495] T 477edff4095c47869451ca4f9c385e8f P 2015ae63ce8c475691dd3d25fc15d3dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2015ae63ce8c475691dd3d25fc15d3dd (127.6.120.195). New cstate: current_term: 1 leader_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 } health_report { overall_health: UNKNOWN } } }
I20260619 18:44:54.245694 8503 raft_consensus.cc:1261] T 477edff4095c47869451ca4f9c385e8f P 53ee44a9692247e0918779c7732d04c4 [term 1 FOLLOWER]: Refusing update from remote peer 2015ae63ce8c475691dd3d25fc15d3dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 18:44:54.247141 8747 consensus_queue.cc:1035] T 477edff4095c47869451ca4f9c385e8f P 2015ae63ce8c475691dd3d25fc15d3dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 18:44:54.250694 8601 raft_consensus.cc:1261] T 477edff4095c47869451ca4f9c385e8f P d13ca347dc3e44fbaba0d76f995c8b96 [term 1 FOLLOWER]: Refusing update from remote peer 2015ae63ce8c475691dd3d25fc15d3dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 18:44:54.252138 8747 consensus_queue.cc:1035] T 477edff4095c47869451ca4f9c385e8f P 2015ae63ce8c475691dd3d25fc15d3dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "d13ca347dc3e44fbaba0d76f995c8b96" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 18:44:54.288421 8680 raft_consensus.cc:1261] T 0ffb155667f945e7a4308039c35039d7 P 2015ae63ce8c475691dd3d25fc15d3dd [term 1 FOLLOWER]: Refusing update from remote peer d13ca347dc3e44fbaba0d76f995c8b96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 18:44:54.289944 8768 consensus_queue.cc:1035] T 0ffb155667f945e7a4308039c35039d7 P d13ca347dc3e44fbaba0d76f995c8b96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2015ae63ce8c475691dd3d25fc15d3dd" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 42309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 18:44:54.289961 8504 raft_consensus.cc:1261] T 0ffb155667f945e7a4308039c35039d7 P 53ee44a9692247e0918779c7732d04c4 [term 1 FOLLOWER]: Refusing update from remote peer d13ca347dc3e44fbaba0d76f995c8b96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 18:44:54.296854 8768 consensus_queue.cc:1035] T 0ffb155667f945e7a4308039c35039d7 P d13ca347dc3e44fbaba0d76f995c8b96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53ee44a9692247e0918779c7732d04c4" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 18:44:54.347856 8639 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.120.194:38223, user_credentials={real_user=slave}} blocked reactor thread for 52615.7us
W20260619 18:44:54.807219 6632 kernel_stack_watchdog.cc:198] Thread 8534 stuck at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/rpc/outbound_call.cc:308 for 236ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x440ac0 __tsan::CallUserSignalHandler() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:1915
@ 0x443323 rtl_sigaction() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_atomic_clang_x86.h:81
@ 0x7f13851f9980 (unknown) at ??:0
@ 0x7f13851f8d50 __GI___nanosleep at ??:0
@ 0x46c0dc __interceptor_nanosleep at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:340
@ 0x7f13837ccecb base::SleepForNanoseconds() at ??:0
@ 0x7f1383dcc517 kudu::SleepFor() at ??:0
@ 0x5aae36 kudu::client::ClientTest_TestAutoFlushBackgroundAndErrorCollector_Test::TestBody()::CustomErrorCollector::AddError() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:4436
@ 0x7f138b48d196 kudu::client::internal::Batcher::ProcessWriteResponse() at ??:0
@ 0x7f138b48cabf kudu::client::internal::WriteRpc::Finish() at ??:0
@ 0x7f138b4971c4 kudu::rpc::RetriableRpc<>::SendRpcCb() at ??:0
@ 0x7f138b4ac4ab _ZZN4kudu3rpc12RetriableRpcINS_6client8internal18RemoteTabletServerENS_7tserver14WriteRequestPBENS5_15WriteResponsePBEE14ReplicaFoundCbERKNS_6StatusEPS4_ENKUlvE_clEv at ??:0
@ 0x7f138b4ac422 _ZNSt3__18__invokeIRZN4kudu3rpc12RetriableRpcINS1_6client8internal18RemoteTabletServerENS1_7tserver14WriteRequestPBENS7_15WriteResponsePBEE14ReplicaFoundCbERKNS1_6StatusEPS6_EUlvE_JEEEDTclclsr3std3__1E7forwardIT_Efp_Espclsr3std3__1E7forwardIT0_Efp0_EEEOSH_DpOSI_ at ??:0
@ 0x7f138b4ac3b2 _ZNSt3__128__invoke_void_return_wrapperIvE6__callIJRZN4kudu3rpc12RetriableRpcINS3_6client8internal18RemoteTabletServerENS3_7tserver14WriteRequestPBENS9_15WriteResponsePBEE14ReplicaFoundCbERKNS3_6StatusEPS8_EUlvE_EEEvDpOT_ at ??:0
@ 0x7f138b4ac372 _ZNSt3__110__function12__alloc_funcIZN4kudu3rpc12RetriableRpcINS2_6client8internal18RemoteTabletServerENS2_7tserver14WriteRequestPBENS8_15WriteResponsePBEE14ReplicaFoundCbERKNS2_6StatusEPS7_EUlvE_NS_9allocatorISG_EEFvvEEclEv at ??:0
@ 0x7f138b4aaffe _ZNSt3__110__function6__funcIZN4kudu3rpc12RetriableRpcINS2_6client8internal18RemoteTabletServerENS2_7tserver14WriteRequestPBENS8_15WriteResponsePBEE14ReplicaFoundCbERKNS2_6StatusEPS7_EUlvE_NS_9allocatorISG_EEFvvEEclEv at ??:0
W20260619 18:44:55.210305 6632 kernel_stack_watchdog.cc:198] Thread 8534 stuck at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/rpc/outbound_call.cc:308 for 673ms:
Kernel stack:
(could not read kernel stack)
User stack:
@ 0x440ac0 __tsan::CallUserSignalHandler() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:1915
@ 0x443323 rtl_sigaction() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/../sanitizer_common/sanitizer_atomic_clang_x86.h:81
@ 0x7f13851f9980 (unknown) at ??:0
@ 0x7f13851f8d50 __GI___nanosleep at ??:0
@ 0x46c0dc __interceptor_nanosleep at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:340
@ 0x7f13837ccecb base::SleepForNanoseconds() at ??:0
@ 0x7f1383dcc517 kudu::SleepFor() at ??:0
@ 0x5aae36 kudu::client::ClientTest_TestAutoFlushBackgroundAndErrorCollector_Test::TestBody()::CustomErrorCollector::AddError() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:4436
@ 0x7f138b48d196 kudu::client::internal::Batcher::ProcessWriteResponse() at ??:0
@ 0x7f138b48cabf kudu::client::internal::WriteRpc::Finish() at ??:0
@ 0x7f138b4971c4 kudu::rpc::RetriableRpc<>::SendRpcCb() at ??:0
@ 0x7f138b4ac4ab _ZZN4kudu3rpc12RetriableRpcINS_6client8internal18RemoteTabletServerENS_7tserver14WriteRequestPBENS5_15WriteResponsePBEE14ReplicaFoundCbERKNS_6StatusEPS4_ENKUlvE_clEv at ??:0
@ 0x7f138b4ac422 _ZNSt3__18__invokeIRZN4kudu3rpc12RetriableRpcINS1_6client8internal18RemoteTabletServerENS1_7tserver14WriteRequestPBENS7_15WriteResponsePBEE14ReplicaFoundCbERKNS1_6StatusEPS6_EUlvE_JEEEDTclclsr3std3__1E7forwardIT_Efp_Espclsr3std3__1E7forwardIT0_Efp0_EEEOSH_DpOSI_ at ??:0
@ 0x7f138b4ac3b2 _ZNSt3__128__invoke_void_return_wrapperIvE6__callIJRZN4kudu3rpc12RetriableRpcINS3_6client8internal18RemoteTabletServerENS3_7tserver14WriteRequestPBENS9_15WriteResponsePBEE14ReplicaFoundCbERKNS3_6StatusEPS8_EUlvE_EEEvDpOT_ at ??:0
@ 0x7f138b4ac372 _ZNSt3__110__function12__alloc_funcIZN4kudu3rpc12RetriableRpcINS2_6client8internal18RemoteTabletServerENS2_7tserver14WriteRequestPBENS8_15WriteResponsePBEE14ReplicaFoundCbERKNS2_6StatusEPS7_EUlvE_NS_9allocatorISG_EEFvvEEclEv at ??:0
@ 0x7f138b4aaffe _ZNSt3__110__function6__funcIZN4kudu3rpc12RetriableRpcINS2_6client8internal18RemoteTabletServerENS2_7tserver14WriteRequestPBENS8_15WriteResponsePBEE14ReplicaFoundCbERKNS2_6StatusEPS7_EUlvE_NS_9allocatorISG_EEFvvEEclEv at ??:0
W20260619 18:44:55.337286 8534 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.6.120.194:38223, user_credentials={real_user=slave}} blocked reactor thread for 1.00173e+06us
I20260619 18:44:55.338821 6627 tablet_server.cc:178] TabletServer@127.6.120.193:0 shutting down...
I20260619 18:44:55.373355 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:44:55.374150 6627 tablet_replica.cc:330] T 477edff4095c47869451ca4f9c385e8f P 53ee44a9692247e0918779c7732d04c4: stopping tablet replica
I20260619 18:44:55.374809 6627 raft_consensus.cc:2229] T 477edff4095c47869451ca4f9c385e8f P 53ee44a9692247e0918779c7732d04c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 18:44:55.375291 6627 raft_consensus.cc:2258] T 477edff4095c47869451ca4f9c385e8f P 53ee44a9692247e0918779c7732d04c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:55.376924 6627 tablet_replica.cc:330] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 53ee44a9692247e0918779c7732d04c4: stopping tablet replica
I20260619 18:44:55.377410 6627 raft_consensus.cc:2229] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 53ee44a9692247e0918779c7732d04c4 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:55.378393 6627 raft_consensus.cc:2258] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 53ee44a9692247e0918779c7732d04c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:55.380275 6627 tablet_replica.cc:330] T 0ffb155667f945e7a4308039c35039d7 P 53ee44a9692247e0918779c7732d04c4: stopping tablet replica
I20260619 18:44:55.380795 6627 raft_consensus.cc:2229] T 0ffb155667f945e7a4308039c35039d7 P 53ee44a9692247e0918779c7732d04c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 18:44:55.381337 6627 raft_consensus.cc:2258] T 0ffb155667f945e7a4308039c35039d7 P 53ee44a9692247e0918779c7732d04c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:55.383052 6627 tablet_replica.cc:330] T 5bdd420404394b0a813ce08034fcb8e7 P 53ee44a9692247e0918779c7732d04c4: stopping tablet replica
I20260619 18:44:55.383491 6627 raft_consensus.cc:2229] T 5bdd420404394b0a813ce08034fcb8e7 P 53ee44a9692247e0918779c7732d04c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 18:44:55.383908 6627 raft_consensus.cc:2258] T 5bdd420404394b0a813ce08034fcb8e7 P 53ee44a9692247e0918779c7732d04c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:55.385489 6627 tablet_replica.cc:330] T a5eedeb5018d4d48b1a44b59f95b2c38 P 53ee44a9692247e0918779c7732d04c4: stopping tablet replica
I20260619 18:44:55.385950 6627 raft_consensus.cc:2229] T a5eedeb5018d4d48b1a44b59f95b2c38 P 53ee44a9692247e0918779c7732d04c4 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:55.386348 6627 raft_consensus.cc:2258] T a5eedeb5018d4d48b1a44b59f95b2c38 P 53ee44a9692247e0918779c7732d04c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:55.387854 6627 tablet_replica.cc:330] T d9412d09e87e4fe89f101bbec15eb10a P 53ee44a9692247e0918779c7732d04c4: stopping tablet replica
I20260619 18:44:55.388363 6627 raft_consensus.cc:2229] T d9412d09e87e4fe89f101bbec15eb10a P 53ee44a9692247e0918779c7732d04c4 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:55.388759 6627 raft_consensus.cc:2258] T d9412d09e87e4fe89f101bbec15eb10a P 53ee44a9692247e0918779c7732d04c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:55.412768 6627 tablet_server.cc:194] TabletServer@127.6.120.193:0 shutdown complete.
I20260619 18:44:55.431861 6627 tablet_server.cc:178] TabletServer@127.6.120.194:0 shutting down...
I20260619 18:44:55.457120 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:44:55.457635 6627 tablet_replica.cc:330] T 477edff4095c47869451ca4f9c385e8f P d13ca347dc3e44fbaba0d76f995c8b96: stopping tablet replica
I20260619 18:44:55.458230 6627 raft_consensus.cc:2229] T 477edff4095c47869451ca4f9c385e8f P d13ca347dc3e44fbaba0d76f995c8b96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 18:44:55.458657 6627 raft_consensus.cc:2258] T 477edff4095c47869451ca4f9c385e8f P d13ca347dc3e44fbaba0d76f995c8b96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:55.460251 6627 tablet_replica.cc:330] T 0ffb155667f945e7a4308039c35039d7 P d13ca347dc3e44fbaba0d76f995c8b96: stopping tablet replica
I20260619 18:44:55.460693 6627 raft_consensus.cc:2229] T 0ffb155667f945e7a4308039c35039d7 P d13ca347dc3e44fbaba0d76f995c8b96 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:55.461324 6627 raft_consensus.cc:2258] T 0ffb155667f945e7a4308039c35039d7 P d13ca347dc3e44fbaba0d76f995c8b96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:55.462728 6627 tablet_replica.cc:330] T e81d4ac0aefa4a7dbe95b3fb66f7228e P d13ca347dc3e44fbaba0d76f995c8b96: stopping tablet replica
I20260619 18:44:55.463207 6627 raft_consensus.cc:2229] T e81d4ac0aefa4a7dbe95b3fb66f7228e P d13ca347dc3e44fbaba0d76f995c8b96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 18:44:55.463688 6627 raft_consensus.cc:2258] T e81d4ac0aefa4a7dbe95b3fb66f7228e P d13ca347dc3e44fbaba0d76f995c8b96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:55.465400 6627 tablet_replica.cc:330] T 5bdd420404394b0a813ce08034fcb8e7 P d13ca347dc3e44fbaba0d76f995c8b96: stopping tablet replica
I20260619 18:44:55.465808 6627 raft_consensus.cc:2229] T 5bdd420404394b0a813ce08034fcb8e7 P d13ca347dc3e44fbaba0d76f995c8b96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 18:44:55.466280 6627 raft_consensus.cc:2258] T 5bdd420404394b0a813ce08034fcb8e7 P d13ca347dc3e44fbaba0d76f995c8b96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:55.487537 6627 tablet_server.cc:194] TabletServer@127.6.120.194:0 shutdown complete.
I20260619 18:44:55.501049 6627 tablet_server.cc:178] TabletServer@127.6.120.195:0 shutting down...
W20260619 18:44:55.525560 8639 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.120.194:38223: connect: Connection refused (error 111)
I20260619 18:44:55.526572 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:44:55.527371 6627 tablet_replica.cc:330] T 477edff4095c47869451ca4f9c385e8f P 2015ae63ce8c475691dd3d25fc15d3dd: stopping tablet replica
I20260619 18:44:55.528075 6627 raft_consensus.cc:2229] T 477edff4095c47869451ca4f9c385e8f P 2015ae63ce8c475691dd3d25fc15d3dd [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:55.528891 6627 raft_consensus.cc:2258] T 477edff4095c47869451ca4f9c385e8f P 2015ae63ce8c475691dd3d25fc15d3dd [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 18:44:55.528995 8639 consensus_peers.cc:487] T 5bdd420404394b0a813ce08034fcb8e7 P 2015ae63ce8c475691dd3d25fc15d3dd -> Peer d13ca347dc3e44fbaba0d76f995c8b96 (127.6.120.194:38223): Couldn't send request to peer d13ca347dc3e44fbaba0d76f995c8b96. Status: Network error: Client connection negotiation failed: client connection to 127.6.120.194:38223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260619 18:44:55.530606 6627 tablet_replica.cc:330] T 0ffb155667f945e7a4308039c35039d7 P 2015ae63ce8c475691dd3d25fc15d3dd: stopping tablet replica
I20260619 18:44:55.531056 6627 raft_consensus.cc:2229] T 0ffb155667f945e7a4308039c35039d7 P 2015ae63ce8c475691dd3d25fc15d3dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 18:44:55.531423 6627 raft_consensus.cc:2258] T 0ffb155667f945e7a4308039c35039d7 P 2015ae63ce8c475691dd3d25fc15d3dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:55.532956 6627 tablet_replica.cc:330] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 2015ae63ce8c475691dd3d25fc15d3dd: stopping tablet replica
I20260619 18:44:55.533408 6627 raft_consensus.cc:2229] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 2015ae63ce8c475691dd3d25fc15d3dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 18:44:55.533807 6627 raft_consensus.cc:2258] T e81d4ac0aefa4a7dbe95b3fb66f7228e P 2015ae63ce8c475691dd3d25fc15d3dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:55.535276 6627 tablet_replica.cc:330] T 5bdd420404394b0a813ce08034fcb8e7 P 2015ae63ce8c475691dd3d25fc15d3dd: stopping tablet replica
I20260619 18:44:55.535705 6627 raft_consensus.cc:2229] T 5bdd420404394b0a813ce08034fcb8e7 P 2015ae63ce8c475691dd3d25fc15d3dd [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:55.536448 6627 raft_consensus.cc:2258] T 5bdd420404394b0a813ce08034fcb8e7 P 2015ae63ce8c475691dd3d25fc15d3dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:55.557394 6627 tablet_server.cc:194] TabletServer@127.6.120.195:0 shutdown complete.
I20260619 18:44:55.570180 6627 master.cc:537] Master@127.6.120.254:38561 shutting down...
I20260619 18:44:55.592365 6627 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 18a0aff9d4d0488e91c9e94f78e48dd0 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:55.592823 6627 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 18a0aff9d4d0488e91c9e94f78e48dd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:55.593113 6627 tablet_replica.cc:330] T 00000000000000000000000000000000 P 18a0aff9d4d0488e91c9e94f78e48dd0: stopping tablet replica
I20260619 18:44:55.613004 6627 master.cc:552] Master@127.6.120.254:38561 shutdown complete.
[ OK ] ClientTest.TestAutoFlushBackgroundAndErrorCollector (4150 ms)
[ RUN ] ClientTest.TestMutationsWork
I20260619 18:44:55.648057 6627 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.120.254:46541
I20260619 18:44:55.649051 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:55.654872 8807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:55.654919 8808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:55.655692 8810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:55.659143 6627 server_base.cc:1034] running on GCE node
I20260619 18:44:55.659849 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:55.660028 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:55.660230 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894695660190 us; error 0 us; skew 500 ppm
I20260619 18:44:55.660732 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:55.666154 6627 webserver.cc:460] Webserver started at http://127.6.120.254:38007/ using document root <none> and password file <none>
I20260619 18:44:55.666563 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:55.666703 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:55.666926 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:55.667934 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestMutationsWork.1781894682485826-6627-0/minicluster-data/master-0-root/instance:
uuid: "a8f423ae60d241489caacfe630a9392e"
format_stamp: "Formatted at 2026-06-19 18:44:55 on dist-test-slave-90mn"
I20260619 18:44:55.672279 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260619 18:44:55.675271 8815 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:55.676014 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260619 18:44:55.676339 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestMutationsWork.1781894682485826-6627-0/minicluster-data/master-0-root
uuid: "a8f423ae60d241489caacfe630a9392e"
format_stamp: "Formatted at 2026-06-19 18:44:55 on dist-test-slave-90mn"
I20260619 18:44:55.676573 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestMutationsWork.1781894682485826-6627-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestMutationsWork.1781894682485826-6627-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestMutationsWork.1781894682485826-6627-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:55.689322 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:55.690454 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:55.733708 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.254:46541
I20260619 18:44:55.733916 8876 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.254:46541 every 8 connection(s)
I20260619 18:44:55.737524 8877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:55.747212 8877 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8f423ae60d241489caacfe630a9392e: Bootstrap starting.
I20260619 18:44:55.751325 8877 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a8f423ae60d241489caacfe630a9392e: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:55.755453 8877 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8f423ae60d241489caacfe630a9392e: No bootstrap required, opened a new log
I20260619 18:44:55.757323 8877 raft_consensus.cc:348] T 00000000000000000000000000000000 P a8f423ae60d241489caacfe630a9392e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8f423ae60d241489caacfe630a9392e" member_type: VOTER }
I20260619 18:44:55.757726 8877 raft_consensus.cc:374] T 00000000000000000000000000000000 P a8f423ae60d241489caacfe630a9392e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:55.757913 8877 raft_consensus.cc:729] T 00000000000000000000000000000000 P a8f423ae60d241489caacfe630a9392e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8f423ae60d241489caacfe630a9392e, State: Initialized, Role: FOLLOWER
I20260619 18:44:55.758492 8877 consensus_queue.cc:260] T 00000000000000000000000000000000 P a8f423ae60d241489caacfe630a9392e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8f423ae60d241489caacfe630a9392e" member_type: VOTER }
I20260619 18:44:55.758950 8877 raft_consensus.cc:388] T 00000000000000000000000000000000 P a8f423ae60d241489caacfe630a9392e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:55.759135 8877 raft_consensus.cc:482] T 00000000000000000000000000000000 P a8f423ae60d241489caacfe630a9392e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:55.759337 8877 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a8f423ae60d241489caacfe630a9392e [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:55.763545 8877 raft_consensus.cc:504] T 00000000000000000000000000000000 P a8f423ae60d241489caacfe630a9392e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8f423ae60d241489caacfe630a9392e" member_type: VOTER }
I20260619 18:44:55.764012 8877 leader_election.cc:302] T 00000000000000000000000000000000 P a8f423ae60d241489caacfe630a9392e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a8f423ae60d241489caacfe630a9392e; no voters:
I20260619 18:44:55.765041 8877 leader_election.cc:288] T 00000000000000000000000000000000 P a8f423ae60d241489caacfe630a9392e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:55.765395 8880 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a8f423ae60d241489caacfe630a9392e [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:55.766669 8880 raft_consensus.cc:686] T 00000000000000000000000000000000 P a8f423ae60d241489caacfe630a9392e [term 1 LEADER]: Becoming Leader. State: Replica: a8f423ae60d241489caacfe630a9392e, State: Running, Role: LEADER
I20260619 18:44:55.767288 8880 consensus_queue.cc:237] T 00000000000000000000000000000000 P a8f423ae60d241489caacfe630a9392e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8f423ae60d241489caacfe630a9392e" member_type: VOTER }
I20260619 18:44:55.767887 8877 sys_catalog.cc:564] T 00000000000000000000000000000000 P a8f423ae60d241489caacfe630a9392e [sys.catalog]: configured and running, proceeding with master startup.
I20260619 18:44:55.772339 8882 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8f423ae60d241489caacfe630a9392e [sys.catalog]: SysCatalogTable state changed. Reason: New leader a8f423ae60d241489caacfe630a9392e. Latest consensus state: current_term: 1 leader_uuid: "a8f423ae60d241489caacfe630a9392e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8f423ae60d241489caacfe630a9392e" member_type: VOTER } }
I20260619 18:44:55.772428 8881 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8f423ae60d241489caacfe630a9392e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a8f423ae60d241489caacfe630a9392e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8f423ae60d241489caacfe630a9392e" member_type: VOTER } }
I20260619 18:44:55.773180 8882 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8f423ae60d241489caacfe630a9392e [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:55.773259 8881 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8f423ae60d241489caacfe630a9392e [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:55.775415 8887 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 18:44:55.780576 8887 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 18:44:55.784873 6627 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260619 18:44:55.788992 8887 catalog_manager.cc:1347] Generated new cluster ID: f99ae09e4cbb495f81a142ca9791be6a
I20260619 18:44:55.789319 8887 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 18:44:55.807436 8887 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 18:44:55.809084 8887 catalog_manager.cc:1504] Loading token signing keys...
I20260619 18:44:55.822575 8887 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a8f423ae60d241489caacfe630a9392e: Generated new TSK 0
I20260619 18:44:55.823261 8887 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 18:44:55.851267 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:55.857532 8898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:55.858529 8899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:55.860129 8901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:55.860524 6627 server_base.cc:1034] running on GCE node
I20260619 18:44:55.861371 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:55.861590 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:55.861768 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894695861754 us; error 0 us; skew 500 ppm
I20260619 18:44:55.862303 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:55.868386 6627 webserver.cc:460] Webserver started at http://127.6.120.193:42963/ using document root <none> and password file <none>
I20260619 18:44:55.868882 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:55.869098 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:55.869397 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:55.870487 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestMutationsWork.1781894682485826-6627-0/minicluster-data/ts-0-root/instance:
uuid: "979ac567685048d1b0d9d041f4b9fc46"
format_stamp: "Formatted at 2026-06-19 18:44:55 on dist-test-slave-90mn"
I20260619 18:44:55.874887 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260619 18:44:55.878194 8906 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:55.879065 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260619 18:44:55.879372 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestMutationsWork.1781894682485826-6627-0/minicluster-data/ts-0-root
uuid: "979ac567685048d1b0d9d041f4b9fc46"
format_stamp: "Formatted at 2026-06-19 18:44:55 on dist-test-slave-90mn"
I20260619 18:44:55.879670 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestMutationsWork.1781894682485826-6627-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestMutationsWork.1781894682485826-6627-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestMutationsWork.1781894682485826-6627-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:55.910097 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:55.911269 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:55.917362 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:44:55.917703 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:55.917972 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:44:55.918147 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:55.969967 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.193:39761
I20260619 18:44:55.970033 8976 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.193:39761 every 8 connection(s)
I20260619 18:44:55.974735 8977 heartbeater.cc:347] Connected to a master server at 127.6.120.254:46541
I20260619 18:44:55.975108 8977 heartbeater.cc:464] Registering TS with master...
I20260619 18:44:55.975816 8977 heartbeater.cc:511] Master 127.6.120.254:46541 requested a full tablet report, sending...
I20260619 18:44:55.977869 8832 ts_manager.cc:194] Registered new tserver with Master: 979ac567685048d1b0d9d041f4b9fc46 (127.6.120.193:39761)
I20260619 18:44:55.978410 6627 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.005107361s
I20260619 18:44:55.980150 8832 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49636
I20260619 18:44:56.001210 8977 heartbeater.cc:503] Master 127.6.120.254:46541 was elected leader, sending a full tablet report...
I20260619 18:44:56.010600 8832 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49650:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 18:44:56.064988 8942 tablet_service.cc:1467] Processing CreateTablet for tablet 6fbd53e584834abc9a4cb00a40f815ff (DEFAULT_TABLE table=client-testtb [id=f19025962d4349ef90ea84c6e2ce901e]), partition=RANGE (key) PARTITION VALUES < 9
I20260619 18:44:56.065290 8941 tablet_service.cc:1467] Processing CreateTablet for tablet 8576a84b05784eb2aeaecff6ae6d5bae (DEFAULT_TABLE table=client-testtb [id=f19025962d4349ef90ea84c6e2ce901e]), partition=RANGE (key) PARTITION 9 <= VALUES
I20260619 18:44:56.066372 8942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6fbd53e584834abc9a4cb00a40f815ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:56.067129 8941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8576a84b05784eb2aeaecff6ae6d5bae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:56.082773 8987 tablet_bootstrap.cc:492] T 6fbd53e584834abc9a4cb00a40f815ff P 979ac567685048d1b0d9d041f4b9fc46: Bootstrap starting.
I20260619 18:44:56.087575 8987 tablet_bootstrap.cc:654] T 6fbd53e584834abc9a4cb00a40f815ff P 979ac567685048d1b0d9d041f4b9fc46: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:56.091431 8987 tablet_bootstrap.cc:492] T 6fbd53e584834abc9a4cb00a40f815ff P 979ac567685048d1b0d9d041f4b9fc46: No bootstrap required, opened a new log
I20260619 18:44:56.091806 8987 ts_tablet_manager.cc:1397] T 6fbd53e584834abc9a4cb00a40f815ff P 979ac567685048d1b0d9d041f4b9fc46: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.004s
I20260619 18:44:56.093562 8987 raft_consensus.cc:348] T 6fbd53e584834abc9a4cb00a40f815ff P 979ac567685048d1b0d9d041f4b9fc46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "979ac567685048d1b0d9d041f4b9fc46" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 39761 } }
I20260619 18:44:56.093959 8987 raft_consensus.cc:374] T 6fbd53e584834abc9a4cb00a40f815ff P 979ac567685048d1b0d9d041f4b9fc46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:56.094209 8987 raft_consensus.cc:729] T 6fbd53e584834abc9a4cb00a40f815ff P 979ac567685048d1b0d9d041f4b9fc46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 979ac567685048d1b0d9d041f4b9fc46, State: Initialized, Role: FOLLOWER
I20260619 18:44:56.094815 8987 consensus_queue.cc:260] T 6fbd53e584834abc9a4cb00a40f815ff P 979ac567685048d1b0d9d041f4b9fc46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "979ac567685048d1b0d9d041f4b9fc46" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 39761 } }
I20260619 18:44:56.095270 8987 raft_consensus.cc:388] T 6fbd53e584834abc9a4cb00a40f815ff P 979ac567685048d1b0d9d041f4b9fc46 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:56.095510 8987 raft_consensus.cc:482] T 6fbd53e584834abc9a4cb00a40f815ff P 979ac567685048d1b0d9d041f4b9fc46 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:56.095795 8987 raft_consensus.cc:3037] T 6fbd53e584834abc9a4cb00a40f815ff P 979ac567685048d1b0d9d041f4b9fc46 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:56.100898 8987 raft_consensus.cc:504] T 6fbd53e584834abc9a4cb00a40f815ff P 979ac567685048d1b0d9d041f4b9fc46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "979ac567685048d1b0d9d041f4b9fc46" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 39761 } }
I20260619 18:44:56.101579 8987 leader_election.cc:302] T 6fbd53e584834abc9a4cb00a40f815ff P 979ac567685048d1b0d9d041f4b9fc46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 979ac567685048d1b0d9d041f4b9fc46; no voters:
I20260619 18:44:56.102700 8987 leader_election.cc:288] T 6fbd53e584834abc9a4cb00a40f815ff P 979ac567685048d1b0d9d041f4b9fc46 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:56.103006 8989 raft_consensus.cc:2781] T 6fbd53e584834abc9a4cb00a40f815ff P 979ac567685048d1b0d9d041f4b9fc46 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:56.104451 8989 raft_consensus.cc:686] T 6fbd53e584834abc9a4cb00a40f815ff P 979ac567685048d1b0d9d041f4b9fc46 [term 1 LEADER]: Becoming Leader. State: Replica: 979ac567685048d1b0d9d041f4b9fc46, State: Running, Role: LEADER
I20260619 18:44:56.105103 8987 ts_tablet_manager.cc:1428] T 6fbd53e584834abc9a4cb00a40f815ff P 979ac567685048d1b0d9d041f4b9fc46: Time spent starting tablet: real 0.013s user 0.013s sys 0.001s
I20260619 18:44:56.105106 8989 consensus_queue.cc:237] T 6fbd53e584834abc9a4cb00a40f815ff P 979ac567685048d1b0d9d041f4b9fc46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "979ac567685048d1b0d9d041f4b9fc46" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 39761 } }
I20260619 18:44:56.105940 8987 tablet_bootstrap.cc:492] T 8576a84b05784eb2aeaecff6ae6d5bae P 979ac567685048d1b0d9d041f4b9fc46: Bootstrap starting.
I20260619 18:44:56.111848 8987 tablet_bootstrap.cc:654] T 8576a84b05784eb2aeaecff6ae6d5bae P 979ac567685048d1b0d9d041f4b9fc46: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:56.113830 8832 catalog_manager.cc:5495] T 6fbd53e584834abc9a4cb00a40f815ff P 979ac567685048d1b0d9d041f4b9fc46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 979ac567685048d1b0d9d041f4b9fc46 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "979ac567685048d1b0d9d041f4b9fc46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "979ac567685048d1b0d9d041f4b9fc46" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 39761 } health_report { overall_health: HEALTHY } } }
I20260619 18:44:56.116834 8987 tablet_bootstrap.cc:492] T 8576a84b05784eb2aeaecff6ae6d5bae P 979ac567685048d1b0d9d041f4b9fc46: No bootstrap required, opened a new log
I20260619 18:44:56.117214 8987 ts_tablet_manager.cc:1397] T 8576a84b05784eb2aeaecff6ae6d5bae P 979ac567685048d1b0d9d041f4b9fc46: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.002s
I20260619 18:44:56.119356 8987 raft_consensus.cc:348] T 8576a84b05784eb2aeaecff6ae6d5bae P 979ac567685048d1b0d9d041f4b9fc46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "979ac567685048d1b0d9d041f4b9fc46" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 39761 } }
I20260619 18:44:56.119784 8987 raft_consensus.cc:374] T 8576a84b05784eb2aeaecff6ae6d5bae P 979ac567685048d1b0d9d041f4b9fc46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:56.120064 8987 raft_consensus.cc:729] T 8576a84b05784eb2aeaecff6ae6d5bae P 979ac567685048d1b0d9d041f4b9fc46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 979ac567685048d1b0d9d041f4b9fc46, State: Initialized, Role: FOLLOWER
I20260619 18:44:56.120693 8987 consensus_queue.cc:260] T 8576a84b05784eb2aeaecff6ae6d5bae P 979ac567685048d1b0d9d041f4b9fc46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "979ac567685048d1b0d9d041f4b9fc46" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 39761 } }
I20260619 18:44:56.121178 8987 raft_consensus.cc:388] T 8576a84b05784eb2aeaecff6ae6d5bae P 979ac567685048d1b0d9d041f4b9fc46 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:56.121410 8987 raft_consensus.cc:482] T 8576a84b05784eb2aeaecff6ae6d5bae P 979ac567685048d1b0d9d041f4b9fc46 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:56.121662 8987 raft_consensus.cc:3037] T 8576a84b05784eb2aeaecff6ae6d5bae P 979ac567685048d1b0d9d041f4b9fc46 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:56.126787 8987 raft_consensus.cc:504] T 8576a84b05784eb2aeaecff6ae6d5bae P 979ac567685048d1b0d9d041f4b9fc46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "979ac567685048d1b0d9d041f4b9fc46" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 39761 } }
I20260619 18:44:56.127416 8987 leader_election.cc:302] T 8576a84b05784eb2aeaecff6ae6d5bae P 979ac567685048d1b0d9d041f4b9fc46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 979ac567685048d1b0d9d041f4b9fc46; no voters:
I20260619 18:44:56.127832 8987 leader_election.cc:288] T 8576a84b05784eb2aeaecff6ae6d5bae P 979ac567685048d1b0d9d041f4b9fc46 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:56.127985 8989 raft_consensus.cc:2781] T 8576a84b05784eb2aeaecff6ae6d5bae P 979ac567685048d1b0d9d041f4b9fc46 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:56.128542 8989 raft_consensus.cc:686] T 8576a84b05784eb2aeaecff6ae6d5bae P 979ac567685048d1b0d9d041f4b9fc46 [term 1 LEADER]: Becoming Leader. State: Replica: 979ac567685048d1b0d9d041f4b9fc46, State: Running, Role: LEADER
I20260619 18:44:56.129324 8987 ts_tablet_manager.cc:1428] T 8576a84b05784eb2aeaecff6ae6d5bae P 979ac567685048d1b0d9d041f4b9fc46: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260619 18:44:56.129208 8989 consensus_queue.cc:237] T 8576a84b05784eb2aeaecff6ae6d5bae P 979ac567685048d1b0d9d041f4b9fc46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "979ac567685048d1b0d9d041f4b9fc46" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 39761 } }
I20260619 18:44:56.134744 8832 catalog_manager.cc:5495] T 8576a84b05784eb2aeaecff6ae6d5bae P 979ac567685048d1b0d9d041f4b9fc46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 979ac567685048d1b0d9d041f4b9fc46 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "979ac567685048d1b0d9d041f4b9fc46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "979ac567685048d1b0d9d041f4b9fc46" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 39761 } health_report { overall_health: HEALTHY } } }
I20260619 18:44:56.224630 6627 tablet_server.cc:178] TabletServer@127.6.120.193:0 shutting down...
I20260619 18:44:56.245630 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:44:56.246357 6627 tablet_replica.cc:330] T 8576a84b05784eb2aeaecff6ae6d5bae P 979ac567685048d1b0d9d041f4b9fc46: stopping tablet replica
I20260619 18:44:56.246896 6627 raft_consensus.cc:2229] T 8576a84b05784eb2aeaecff6ae6d5bae P 979ac567685048d1b0d9d041f4b9fc46 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:56.247304 6627 raft_consensus.cc:2258] T 8576a84b05784eb2aeaecff6ae6d5bae P 979ac567685048d1b0d9d041f4b9fc46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:56.249418 6627 tablet_replica.cc:330] T 6fbd53e584834abc9a4cb00a40f815ff P 979ac567685048d1b0d9d041f4b9fc46: stopping tablet replica
I20260619 18:44:56.249855 6627 raft_consensus.cc:2229] T 6fbd53e584834abc9a4cb00a40f815ff P 979ac567685048d1b0d9d041f4b9fc46 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:56.250263 6627 raft_consensus.cc:2258] T 6fbd53e584834abc9a4cb00a40f815ff P 979ac567685048d1b0d9d041f4b9fc46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:56.271015 6627 tablet_server.cc:194] TabletServer@127.6.120.193:0 shutdown complete.
I20260619 18:44:56.281467 6627 master.cc:537] Master@127.6.120.254:46541 shutting down...
I20260619 18:44:56.298177 6627 raft_consensus.cc:2229] T 00000000000000000000000000000000 P a8f423ae60d241489caacfe630a9392e [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:56.298704 6627 raft_consensus.cc:2258] T 00000000000000000000000000000000 P a8f423ae60d241489caacfe630a9392e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:56.299132 6627 tablet_replica.cc:330] T 00000000000000000000000000000000 P a8f423ae60d241489caacfe630a9392e: stopping tablet replica
I20260619 18:44:56.317205 6627 master.cc:552] Master@127.6.120.254:46541 shutdown complete.
[ OK ] ClientTest.TestMutationsWork (688 ms)
[ RUN ] ClientTest.TestSoftDeleteAndReserveTable
I20260619 18:44:56.337201 6627 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.120.254:42921
I20260619 18:44:56.338183 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:56.342680 8998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:56.343734 8999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:56.344138 9001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:56.345309 6627 server_base.cc:1034] running on GCE node
I20260619 18:44:56.346118 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:56.346283 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:56.346442 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894696346433 us; error 0 us; skew 500 ppm
I20260619 18:44:56.346956 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:56.349247 6627 webserver.cc:460] Webserver started at http://127.6.120.254:45659/ using document root <none> and password file <none>
I20260619 18:44:56.349664 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:56.349850 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:56.350099 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:56.351092 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestSoftDeleteAndReserveTable.1781894682485826-6627-0/minicluster-data/master-0-root/instance:
uuid: "20a3eda47bdb4c2daa866c9c7642e277"
format_stamp: "Formatted at 2026-06-19 18:44:56 on dist-test-slave-90mn"
I20260619 18:44:56.355115 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260619 18:44:56.358101 9006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:56.358825 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260619 18:44:56.359094 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestSoftDeleteAndReserveTable.1781894682485826-6627-0/minicluster-data/master-0-root
uuid: "20a3eda47bdb4c2daa866c9c7642e277"
format_stamp: "Formatted at 2026-06-19 18:44:56 on dist-test-slave-90mn"
I20260619 18:44:56.359370 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestSoftDeleteAndReserveTable.1781894682485826-6627-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestSoftDeleteAndReserveTable.1781894682485826-6627-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestSoftDeleteAndReserveTable.1781894682485826-6627-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:56.387784 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:56.388795 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:56.428303 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.254:42921
I20260619 18:44:56.428391 9067 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.254:42921 every 8 connection(s)
I20260619 18:44:56.431751 9068 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:56.441010 9068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20a3eda47bdb4c2daa866c9c7642e277: Bootstrap starting.
I20260619 18:44:56.444837 9068 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 20a3eda47bdb4c2daa866c9c7642e277: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:56.448657 9068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 20a3eda47bdb4c2daa866c9c7642e277: No bootstrap required, opened a new log
I20260619 18:44:56.450461 9068 raft_consensus.cc:348] T 00000000000000000000000000000000 P 20a3eda47bdb4c2daa866c9c7642e277 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20a3eda47bdb4c2daa866c9c7642e277" member_type: VOTER }
I20260619 18:44:56.450829 9068 raft_consensus.cc:374] T 00000000000000000000000000000000 P 20a3eda47bdb4c2daa866c9c7642e277 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:56.451078 9068 raft_consensus.cc:729] T 00000000000000000000000000000000 P 20a3eda47bdb4c2daa866c9c7642e277 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20a3eda47bdb4c2daa866c9c7642e277, State: Initialized, Role: FOLLOWER
I20260619 18:44:56.451660 9068 consensus_queue.cc:260] T 00000000000000000000000000000000 P 20a3eda47bdb4c2daa866c9c7642e277 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20a3eda47bdb4c2daa866c9c7642e277" member_type: VOTER }
I20260619 18:44:56.452078 9068 raft_consensus.cc:388] T 00000000000000000000000000000000 P 20a3eda47bdb4c2daa866c9c7642e277 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:56.452328 9068 raft_consensus.cc:482] T 00000000000000000000000000000000 P 20a3eda47bdb4c2daa866c9c7642e277 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:56.452613 9068 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 20a3eda47bdb4c2daa866c9c7642e277 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:56.456838 9068 raft_consensus.cc:504] T 00000000000000000000000000000000 P 20a3eda47bdb4c2daa866c9c7642e277 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20a3eda47bdb4c2daa866c9c7642e277" member_type: VOTER }
I20260619 18:44:56.457368 9068 leader_election.cc:302] T 00000000000000000000000000000000 P 20a3eda47bdb4c2daa866c9c7642e277 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 20a3eda47bdb4c2daa866c9c7642e277; no voters:
I20260619 18:44:56.458439 9068 leader_election.cc:288] T 00000000000000000000000000000000 P 20a3eda47bdb4c2daa866c9c7642e277 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:56.458768 9071 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 20a3eda47bdb4c2daa866c9c7642e277 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:56.460201 9071 raft_consensus.cc:686] T 00000000000000000000000000000000 P 20a3eda47bdb4c2daa866c9c7642e277 [term 1 LEADER]: Becoming Leader. State: Replica: 20a3eda47bdb4c2daa866c9c7642e277, State: Running, Role: LEADER
I20260619 18:44:56.460820 9071 consensus_queue.cc:237] T 00000000000000000000000000000000 P 20a3eda47bdb4c2daa866c9c7642e277 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20a3eda47bdb4c2daa866c9c7642e277" member_type: VOTER }
I20260619 18:44:56.461587 9068 sys_catalog.cc:564] T 00000000000000000000000000000000 P 20a3eda47bdb4c2daa866c9c7642e277 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 18:44:56.463670 9072 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20a3eda47bdb4c2daa866c9c7642e277 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "20a3eda47bdb4c2daa866c9c7642e277" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20a3eda47bdb4c2daa866c9c7642e277" member_type: VOTER } }
I20260619 18:44:56.463717 9073 sys_catalog.cc:455] T 00000000000000000000000000000000 P 20a3eda47bdb4c2daa866c9c7642e277 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 20a3eda47bdb4c2daa866c9c7642e277. Latest consensus state: current_term: 1 leader_uuid: "20a3eda47bdb4c2daa866c9c7642e277" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "20a3eda47bdb4c2daa866c9c7642e277" member_type: VOTER } }
I20260619 18:44:56.464506 9073 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20a3eda47bdb4c2daa866c9c7642e277 [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:56.464479 9072 sys_catalog.cc:458] T 00000000000000000000000000000000 P 20a3eda47bdb4c2daa866c9c7642e277 [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:56.469264 9076 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 18:44:56.476501 9076 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 18:44:56.477439 6627 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260619 18:44:56.484274 9076 catalog_manager.cc:1347] Generated new cluster ID: 578b9b9a8ea14af2a9a9c1c78cfdeb07
I20260619 18:44:56.484519 9076 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 18:44:56.503707 9076 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 18:44:56.505335 9076 catalog_manager.cc:1504] Loading token signing keys...
I20260619 18:44:56.520027 9076 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 20a3eda47bdb4c2daa866c9c7642e277: Generated new TSK 0
I20260619 18:44:56.520730 9076 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 18:44:56.543766 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:56.549517 9089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:56.550745 9090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:56.552342 6627 server_base.cc:1034] running on GCE node
W20260619 18:44:56.552551 9092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:56.553582 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:56.553790 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:56.553964 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894696553952 us; error 0 us; skew 500 ppm
I20260619 18:44:56.554463 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:56.556833 6627 webserver.cc:460] Webserver started at http://127.6.120.193:34329/ using document root <none> and password file <none>
I20260619 18:44:56.557272 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:56.557492 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:56.557745 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:56.558789 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestSoftDeleteAndReserveTable.1781894682485826-6627-0/minicluster-data/ts-0-root/instance:
uuid: "6fd948d5688343319f7323dfd56244e2"
format_stamp: "Formatted at 2026-06-19 18:44:56 on dist-test-slave-90mn"
I20260619 18:44:56.563349 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260619 18:44:56.566323 9097 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:56.567175 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260619 18:44:56.567410 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestSoftDeleteAndReserveTable.1781894682485826-6627-0/minicluster-data/ts-0-root
uuid: "6fd948d5688343319f7323dfd56244e2"
format_stamp: "Formatted at 2026-06-19 18:44:56 on dist-test-slave-90mn"
I20260619 18:44:56.567643 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestSoftDeleteAndReserveTable.1781894682485826-6627-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestSoftDeleteAndReserveTable.1781894682485826-6627-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestSoftDeleteAndReserveTable.1781894682485826-6627-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:56.603588 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:56.604524 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:56.608842 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:44:56.609211 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:56.609570 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:44:56.609822 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:56.659703 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.193:40855
I20260619 18:44:56.659777 9167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.193:40855 every 8 connection(s)
I20260619 18:44:56.664527 9168 heartbeater.cc:347] Connected to a master server at 127.6.120.254:42921
I20260619 18:44:56.664973 9168 heartbeater.cc:464] Registering TS with master...
I20260619 18:44:56.665635 9168 heartbeater.cc:511] Master 127.6.120.254:42921 requested a full tablet report, sending...
I20260619 18:44:56.667367 9023 ts_manager.cc:194] Registered new tserver with Master: 6fd948d5688343319f7323dfd56244e2 (127.6.120.193:40855)
I20260619 18:44:56.667791 6627 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.004802437s
I20260619 18:44:56.669407 9023 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54416
I20260619 18:44:56.683142 9168 heartbeater.cc:503] Master 127.6.120.254:42921 was elected leader, sending a full tablet report...
I20260619 18:44:56.690317 9022 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54428:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 18:44:56.721288 9133 tablet_service.cc:1467] Processing CreateTablet for tablet ace3f7525e5941408f8e0e2c590bdd58 (DEFAULT_TABLE table=client-testtb [id=8b952e21f76248419139c3774aaae182]), partition=RANGE (key) PARTITION VALUES < 9
I20260619 18:44:56.721508 9132 tablet_service.cc:1467] Processing CreateTablet for tablet da97192b6b6e4afebc12bdfce7bd701f (DEFAULT_TABLE table=client-testtb [id=8b952e21f76248419139c3774aaae182]), partition=RANGE (key) PARTITION 9 <= VALUES
I20260619 18:44:56.722337 9133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ace3f7525e5941408f8e0e2c590bdd58. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:56.722960 9132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da97192b6b6e4afebc12bdfce7bd701f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:56.736253 9178 tablet_bootstrap.cc:492] T da97192b6b6e4afebc12bdfce7bd701f P 6fd948d5688343319f7323dfd56244e2: Bootstrap starting.
I20260619 18:44:56.740890 9178 tablet_bootstrap.cc:654] T da97192b6b6e4afebc12bdfce7bd701f P 6fd948d5688343319f7323dfd56244e2: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:56.744522 9178 tablet_bootstrap.cc:492] T da97192b6b6e4afebc12bdfce7bd701f P 6fd948d5688343319f7323dfd56244e2: No bootstrap required, opened a new log
I20260619 18:44:56.744832 9178 ts_tablet_manager.cc:1397] T da97192b6b6e4afebc12bdfce7bd701f P 6fd948d5688343319f7323dfd56244e2: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.004s
I20260619 18:44:56.746477 9178 raft_consensus.cc:348] T da97192b6b6e4afebc12bdfce7bd701f P 6fd948d5688343319f7323dfd56244e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fd948d5688343319f7323dfd56244e2" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40855 } }
I20260619 18:44:56.746909 9178 raft_consensus.cc:374] T da97192b6b6e4afebc12bdfce7bd701f P 6fd948d5688343319f7323dfd56244e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:56.747179 9178 raft_consensus.cc:729] T da97192b6b6e4afebc12bdfce7bd701f P 6fd948d5688343319f7323dfd56244e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fd948d5688343319f7323dfd56244e2, State: Initialized, Role: FOLLOWER
I20260619 18:44:56.747776 9178 consensus_queue.cc:260] T da97192b6b6e4afebc12bdfce7bd701f P 6fd948d5688343319f7323dfd56244e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fd948d5688343319f7323dfd56244e2" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40855 } }
I20260619 18:44:56.748459 9178 raft_consensus.cc:388] T da97192b6b6e4afebc12bdfce7bd701f P 6fd948d5688343319f7323dfd56244e2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:56.748757 9178 raft_consensus.cc:482] T da97192b6b6e4afebc12bdfce7bd701f P 6fd948d5688343319f7323dfd56244e2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:56.749037 9178 raft_consensus.cc:3037] T da97192b6b6e4afebc12bdfce7bd701f P 6fd948d5688343319f7323dfd56244e2 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:56.753885 9178 raft_consensus.cc:504] T da97192b6b6e4afebc12bdfce7bd701f P 6fd948d5688343319f7323dfd56244e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fd948d5688343319f7323dfd56244e2" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40855 } }
I20260619 18:44:56.754460 9178 leader_election.cc:302] T da97192b6b6e4afebc12bdfce7bd701f P 6fd948d5688343319f7323dfd56244e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6fd948d5688343319f7323dfd56244e2; no voters:
I20260619 18:44:56.755627 9178 leader_election.cc:288] T da97192b6b6e4afebc12bdfce7bd701f P 6fd948d5688343319f7323dfd56244e2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:56.756039 9180 raft_consensus.cc:2781] T da97192b6b6e4afebc12bdfce7bd701f P 6fd948d5688343319f7323dfd56244e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:56.758018 9178 ts_tablet_manager.cc:1428] T da97192b6b6e4afebc12bdfce7bd701f P 6fd948d5688343319f7323dfd56244e2: Time spent starting tablet: real 0.013s user 0.011s sys 0.001s
I20260619 18:44:56.758783 9180 raft_consensus.cc:686] T da97192b6b6e4afebc12bdfce7bd701f P 6fd948d5688343319f7323dfd56244e2 [term 1 LEADER]: Becoming Leader. State: Replica: 6fd948d5688343319f7323dfd56244e2, State: Running, Role: LEADER
I20260619 18:44:56.758875 9178 tablet_bootstrap.cc:492] T ace3f7525e5941408f8e0e2c590bdd58 P 6fd948d5688343319f7323dfd56244e2: Bootstrap starting.
I20260619 18:44:56.759493 9180 consensus_queue.cc:237] T da97192b6b6e4afebc12bdfce7bd701f P 6fd948d5688343319f7323dfd56244e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fd948d5688343319f7323dfd56244e2" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40855 } }
I20260619 18:44:56.764411 9178 tablet_bootstrap.cc:654] T ace3f7525e5941408f8e0e2c590bdd58 P 6fd948d5688343319f7323dfd56244e2: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:56.766566 9022 catalog_manager.cc:5495] T da97192b6b6e4afebc12bdfce7bd701f P 6fd948d5688343319f7323dfd56244e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fd948d5688343319f7323dfd56244e2 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "6fd948d5688343319f7323dfd56244e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fd948d5688343319f7323dfd56244e2" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40855 } health_report { overall_health: HEALTHY } } }
I20260619 18:44:56.769440 9178 tablet_bootstrap.cc:492] T ace3f7525e5941408f8e0e2c590bdd58 P 6fd948d5688343319f7323dfd56244e2: No bootstrap required, opened a new log
I20260619 18:44:56.769905 9178 ts_tablet_manager.cc:1397] T ace3f7525e5941408f8e0e2c590bdd58 P 6fd948d5688343319f7323dfd56244e2: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.001s
I20260619 18:44:56.772271 9178 raft_consensus.cc:348] T ace3f7525e5941408f8e0e2c590bdd58 P 6fd948d5688343319f7323dfd56244e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fd948d5688343319f7323dfd56244e2" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40855 } }
I20260619 18:44:56.772833 9178 raft_consensus.cc:374] T ace3f7525e5941408f8e0e2c590bdd58 P 6fd948d5688343319f7323dfd56244e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:56.773095 9178 raft_consensus.cc:729] T ace3f7525e5941408f8e0e2c590bdd58 P 6fd948d5688343319f7323dfd56244e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fd948d5688343319f7323dfd56244e2, State: Initialized, Role: FOLLOWER
I20260619 18:44:56.773685 9178 consensus_queue.cc:260] T ace3f7525e5941408f8e0e2c590bdd58 P 6fd948d5688343319f7323dfd56244e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fd948d5688343319f7323dfd56244e2" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40855 } }
I20260619 18:44:56.774286 9178 raft_consensus.cc:388] T ace3f7525e5941408f8e0e2c590bdd58 P 6fd948d5688343319f7323dfd56244e2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:56.774556 9178 raft_consensus.cc:482] T ace3f7525e5941408f8e0e2c590bdd58 P 6fd948d5688343319f7323dfd56244e2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:56.774886 9178 raft_consensus.cc:3037] T ace3f7525e5941408f8e0e2c590bdd58 P 6fd948d5688343319f7323dfd56244e2 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:56.780088 9178 raft_consensus.cc:504] T ace3f7525e5941408f8e0e2c590bdd58 P 6fd948d5688343319f7323dfd56244e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fd948d5688343319f7323dfd56244e2" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40855 } }
I20260619 18:44:56.780824 9178 leader_election.cc:302] T ace3f7525e5941408f8e0e2c590bdd58 P 6fd948d5688343319f7323dfd56244e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6fd948d5688343319f7323dfd56244e2; no voters:
I20260619 18:44:56.781438 9178 leader_election.cc:288] T ace3f7525e5941408f8e0e2c590bdd58 P 6fd948d5688343319f7323dfd56244e2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:56.781579 9180 raft_consensus.cc:2781] T ace3f7525e5941408f8e0e2c590bdd58 P 6fd948d5688343319f7323dfd56244e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:56.782022 9180 raft_consensus.cc:686] T ace3f7525e5941408f8e0e2c590bdd58 P 6fd948d5688343319f7323dfd56244e2 [term 1 LEADER]: Becoming Leader. State: Replica: 6fd948d5688343319f7323dfd56244e2, State: Running, Role: LEADER
I20260619 18:44:56.783044 9178 ts_tablet_manager.cc:1428] T ace3f7525e5941408f8e0e2c590bdd58 P 6fd948d5688343319f7323dfd56244e2: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260619 18:44:56.782693 9180 consensus_queue.cc:237] T ace3f7525e5941408f8e0e2c590bdd58 P 6fd948d5688343319f7323dfd56244e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fd948d5688343319f7323dfd56244e2" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40855 } }
I20260619 18:44:56.788187 9022 catalog_manager.cc:5495] T ace3f7525e5941408f8e0e2c590bdd58 P 6fd948d5688343319f7323dfd56244e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6fd948d5688343319f7323dfd56244e2 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "6fd948d5688343319f7323dfd56244e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fd948d5688343319f7323dfd56244e2" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40855 } health_report { overall_health: HEALTHY } } }
I20260619 18:44:56.863788 9021 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54428:
table { table_name: "client-testtb" } modify_external_catalogs: true reserve_seconds: 600
I20260619 18:44:56.874413 9021 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54428:
table { table_name: "client-testtb" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260619 18:44:56.888458 9190 tablet.cc:1722] T ace3f7525e5941408f8e0e2c590bdd58 P 6fd948d5688343319f7323dfd56244e2: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:non_null_with_default INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:non_null_with_default INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 18:44:56.888669 9189 tablet.cc:1722] T da97192b6b6e4afebc12bdfce7bd701f P 6fd948d5688343319f7323dfd56244e2: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:non_null_with_default INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:non_null_with_default INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260619 18:44:56.892584 9021 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54428:
table { table_name: "client-testtb" } new_table_name: "client-testtb" modify_external_catalogs: true
I20260619 18:44:56.895907 9021 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54428:
table { table_name: "client-testtb" } alter_schema_steps { type: DROP_COLUMN drop_column { name: "int_val" } } alter_schema_steps { type: ADD_COLUMN add_column { schema { name: "new_col" type: INT32 is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 immutable: false } } } modify_external_catalogs: true
I20260619 18:44:56.899864 9020 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54428:
table { table_name: "client-testtb" } modify_external_catalogs: true reserve_seconds: 600
I20260619 18:44:56.903106 9021 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54428:
table { table_name: "client-testtb" } modify_external_catalogs: true new_extra_configs { key: "kudu.table.maintenance_priority" value: "3" }
I20260619 18:44:56.911330 9020 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 20a3eda47bdb4c2daa866c9c7642e277: client-testtb [id=8b952e21f76248419139c3774aaae182] alter complete (version 1)
I20260619 18:44:56.938503 9021 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54428:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 18:44:56.943378 9021 catalog_manager.cc:2831] Servicing RecallDeletedTableRpc request from {username='slave'} at 127.0.0.1:54428:
table { table_id: "8b952e21f76248419139c3774aaae182" }
I20260619 18:44:56.953191 9021 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54428:
table { table_id: "8b952e21f76248419139c3774aaae182" } new_extra_configs { key: "kudu.table.disable_compaction" value: "false" }
I20260619 18:44:56.967850 9190 tablet.cc:1722] T da97192b6b6e4afebc12bdfce7bd701f P 6fd948d5688343319f7323dfd56244e2: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:non_null_with_default INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:non_null_with_default INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 18:44:56.967731 9189 tablet.cc:1722] T ace3f7525e5941408f8e0e2c590bdd58 P 6fd948d5688343319f7323dfd56244e2: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:non_null_with_default INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:non_null_with_default INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260619 18:44:56.969496 9022 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54428:
table { table_name: "client-testtb" } modify_external_catalogs: true reserve_seconds: 0
I20260619 18:44:56.970115 9022 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54428:
table { table_name: "client-testtb" } modify_external_catalogs: true reserve_seconds: 0
I20260619 18:44:56.979637 9022 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 20a3eda47bdb4c2daa866c9c7642e277: Sending DeleteTablet for 1 replicas of tablet ace3f7525e5941408f8e0e2c590bdd58
I20260619 18:44:56.980439 9022 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 20a3eda47bdb4c2daa866c9c7642e277: Sending DeleteTablet for 1 replicas of tablet da97192b6b6e4afebc12bdfce7bd701f
I20260619 18:44:56.985352 9132 tablet_service.cc:1514] Processing DeleteTablet for tablet ace3f7525e5941408f8e0e2c590bdd58 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 18:44:56 UTC) from {username='slave'} at 127.0.0.1:54108
I20260619 18:44:56.986879 6627 tablet_server.cc:178] TabletServer@127.6.120.193:0 shutting down...
I20260619 18:44:56.987399 9191 tablet_replica.cc:330] T ace3f7525e5941408f8e0e2c590bdd58 P 6fd948d5688343319f7323dfd56244e2: stopping tablet replica
I20260619 18:44:56.988332 9191 raft_consensus.cc:2229] T ace3f7525e5941408f8e0e2c590bdd58 P 6fd948d5688343319f7323dfd56244e2 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:56.988857 9191 raft_consensus.cc:2258] T ace3f7525e5941408f8e0e2c590bdd58 P 6fd948d5688343319f7323dfd56244e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:56.993893 9191 ts_tablet_manager.cc:1905] T ace3f7525e5941408f8e0e2c590bdd58 P 6fd948d5688343319f7323dfd56244e2: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 18:44:56.995004 9008 catalog_manager.cc:4584] TS 6fd948d5688343319f7323dfd56244e2 (127.6.120.193:40855): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet da97192b6b6e4afebc12bdfce7bd701f: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260619 18:44:57.011289 9191 ts_tablet_manager.cc:1918] T ace3f7525e5941408f8e0e2c590bdd58 P 6fd948d5688343319f7323dfd56244e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.4
I20260619 18:44:57.011785 9191 log.cc:1196] T ace3f7525e5941408f8e0e2c590bdd58 P 6fd948d5688343319f7323dfd56244e2: Deleting WAL directory at /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestSoftDeleteAndReserveTable.1781894682485826-6627-0/minicluster-data/ts-0-root/wals/ace3f7525e5941408f8e0e2c590bdd58
I20260619 18:44:57.012617 9191 ts_tablet_manager.cc:1939] T ace3f7525e5941408f8e0e2c590bdd58 P 6fd948d5688343319f7323dfd56244e2: Deleting consensus metadata
I20260619 18:44:57.014976 9008 catalog_manager.cc:4841] TS 6fd948d5688343319f7323dfd56244e2 (127.6.120.193:40855): tablet ace3f7525e5941408f8e0e2c590bdd58 (table client-testtb [id=8b952e21f76248419139c3774aaae182]) successfully deleted
I20260619 18:44:57.016408 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:44:57.017308 6627 tablet_replica.cc:330] T da97192b6b6e4afebc12bdfce7bd701f P 6fd948d5688343319f7323dfd56244e2: stopping tablet replica
I20260619 18:44:57.017791 6627 raft_consensus.cc:2229] T da97192b6b6e4afebc12bdfce7bd701f P 6fd948d5688343319f7323dfd56244e2 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:57.018208 6627 raft_consensus.cc:2258] T da97192b6b6e4afebc12bdfce7bd701f P 6fd948d5688343319f7323dfd56244e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:57.038004 6627 tablet_server.cc:194] TabletServer@127.6.120.193:0 shutdown complete.
I20260619 18:44:57.048607 6627 master.cc:537] Master@127.6.120.254:42921 shutting down...
I20260619 18:44:57.076668 6627 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 20a3eda47bdb4c2daa866c9c7642e277 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:57.077185 6627 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 20a3eda47bdb4c2daa866c9c7642e277 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:57.077535 6627 tablet_replica.cc:330] T 00000000000000000000000000000000 P 20a3eda47bdb4c2daa866c9c7642e277: stopping tablet replica
I20260619 18:44:57.095638 6627 master.cc:552] Master@127.6.120.254:42921 shutdown complete.
[ OK ] ClientTest.TestSoftDeleteAndReserveTable (779 ms)
[ RUN ] ClientTest.TestGetTableSchema
I20260619 18:44:57.116501 6627 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.120.254:39635
I20260619 18:44:57.117533 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:57.122395 9193 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:57.123176 9194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:57.123946 9196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:57.125034 6627 server_base.cc:1034] running on GCE node
I20260619 18:44:57.125815 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:57.126070 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:57.126261 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894697126228 us; error 0 us; skew 500 ppm
I20260619 18:44:57.126820 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:57.129204 6627 webserver.cc:460] Webserver started at http://127.6.120.254:35023/ using document root <none> and password file <none>
I20260619 18:44:57.129709 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:57.129923 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:57.130201 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:57.131371 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestGetTableSchema.1781894682485826-6627-0/minicluster-data/master-0-root/instance:
uuid: "ae63aacee4a14160aa065904281dc424"
format_stamp: "Formatted at 2026-06-19 18:44:57 on dist-test-slave-90mn"
I20260619 18:44:57.135959 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260619 18:44:57.139256 9201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:57.140066 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260619 18:44:57.140369 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestGetTableSchema.1781894682485826-6627-0/minicluster-data/master-0-root
uuid: "ae63aacee4a14160aa065904281dc424"
format_stamp: "Formatted at 2026-06-19 18:44:57 on dist-test-slave-90mn"
I20260619 18:44:57.140627 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestGetTableSchema.1781894682485826-6627-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestGetTableSchema.1781894682485826-6627-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestGetTableSchema.1781894682485826-6627-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:57.174854 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:57.175771 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:57.219637 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.254:39635
I20260619 18:44:57.219734 9262 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.254:39635 every 8 connection(s)
I20260619 18:44:57.223553 9263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:57.233187 9263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae63aacee4a14160aa065904281dc424: Bootstrap starting.
I20260619 18:44:57.237123 9263 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ae63aacee4a14160aa065904281dc424: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:57.241062 9263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ae63aacee4a14160aa065904281dc424: No bootstrap required, opened a new log
I20260619 18:44:57.243680 9263 raft_consensus.cc:348] T 00000000000000000000000000000000 P ae63aacee4a14160aa065904281dc424 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae63aacee4a14160aa065904281dc424" member_type: VOTER }
I20260619 18:44:57.244118 9263 raft_consensus.cc:374] T 00000000000000000000000000000000 P ae63aacee4a14160aa065904281dc424 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:57.244391 9263 raft_consensus.cc:729] T 00000000000000000000000000000000 P ae63aacee4a14160aa065904281dc424 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae63aacee4a14160aa065904281dc424, State: Initialized, Role: FOLLOWER
I20260619 18:44:57.244917 9263 consensus_queue.cc:260] T 00000000000000000000000000000000 P ae63aacee4a14160aa065904281dc424 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae63aacee4a14160aa065904281dc424" member_type: VOTER }
I20260619 18:44:57.245365 9263 raft_consensus.cc:388] T 00000000000000000000000000000000 P ae63aacee4a14160aa065904281dc424 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:57.245606 9263 raft_consensus.cc:482] T 00000000000000000000000000000000 P ae63aacee4a14160aa065904281dc424 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:57.245884 9263 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ae63aacee4a14160aa065904281dc424 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:57.264834 9263 raft_consensus.cc:504] T 00000000000000000000000000000000 P ae63aacee4a14160aa065904281dc424 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae63aacee4a14160aa065904281dc424" member_type: VOTER }
I20260619 18:44:57.265654 9263 leader_election.cc:302] T 00000000000000000000000000000000 P ae63aacee4a14160aa065904281dc424 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ae63aacee4a14160aa065904281dc424; no voters:
I20260619 18:44:57.267192 9263 leader_election.cc:288] T 00000000000000000000000000000000 P ae63aacee4a14160aa065904281dc424 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:57.267448 9266 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ae63aacee4a14160aa065904281dc424 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:57.269584 9266 raft_consensus.cc:686] T 00000000000000000000000000000000 P ae63aacee4a14160aa065904281dc424 [term 1 LEADER]: Becoming Leader. State: Replica: ae63aacee4a14160aa065904281dc424, State: Running, Role: LEADER
I20260619 18:44:57.270232 9266 consensus_queue.cc:237] T 00000000000000000000000000000000 P ae63aacee4a14160aa065904281dc424 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae63aacee4a14160aa065904281dc424" member_type: VOTER }
I20260619 18:44:57.270524 9263 sys_catalog.cc:564] T 00000000000000000000000000000000 P ae63aacee4a14160aa065904281dc424 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 18:44:57.273533 9268 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae63aacee4a14160aa065904281dc424 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ae63aacee4a14160aa065904281dc424. Latest consensus state: current_term: 1 leader_uuid: "ae63aacee4a14160aa065904281dc424" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae63aacee4a14160aa065904281dc424" member_type: VOTER } }
I20260619 18:44:57.273456 9267 sys_catalog.cc:455] T 00000000000000000000000000000000 P ae63aacee4a14160aa065904281dc424 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ae63aacee4a14160aa065904281dc424" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ae63aacee4a14160aa065904281dc424" member_type: VOTER } }
I20260619 18:44:57.274037 9268 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae63aacee4a14160aa065904281dc424 [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:57.274183 9267 sys_catalog.cc:458] T 00000000000000000000000000000000 P ae63aacee4a14160aa065904281dc424 [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:57.277221 9271 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 18:44:57.283481 9271 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 18:44:57.284580 6627 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260619 18:44:57.292796 9271 catalog_manager.cc:1347] Generated new cluster ID: 0e1faeffcb764a7e87ba5277474e6f71
I20260619 18:44:57.293092 9271 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 18:44:57.309088 9271 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 18:44:57.310659 9271 catalog_manager.cc:1504] Loading token signing keys...
I20260619 18:44:57.324203 9271 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ae63aacee4a14160aa065904281dc424: Generated new TSK 0
I20260619 18:44:57.324810 9271 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 18:44:57.351040 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:57.357266 9284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:57.358210 9285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:57.360311 9287 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:57.361351 6627 server_base.cc:1034] running on GCE node
I20260619 18:44:57.362139 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:57.362471 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:57.362658 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894697362644 us; error 0 us; skew 500 ppm
I20260619 18:44:57.363385 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:57.366142 6627 webserver.cc:460] Webserver started at http://127.6.120.193:35477/ using document root <none> and password file <none>
I20260619 18:44:57.366624 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:57.366803 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:57.367084 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:57.368196 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestGetTableSchema.1781894682485826-6627-0/minicluster-data/ts-0-root/instance:
uuid: "71d92b01cf8f4180b811fe293a5fb7da"
format_stamp: "Formatted at 2026-06-19 18:44:57 on dist-test-slave-90mn"
I20260619 18:44:57.372562 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260619 18:44:57.376463 9292 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:57.377334 6627 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 18:44:57.377566 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestGetTableSchema.1781894682485826-6627-0/minicluster-data/ts-0-root
uuid: "71d92b01cf8f4180b811fe293a5fb7da"
format_stamp: "Formatted at 2026-06-19 18:44:57 on dist-test-slave-90mn"
I20260619 18:44:57.377812 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestGetTableSchema.1781894682485826-6627-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestGetTableSchema.1781894682485826-6627-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestGetTableSchema.1781894682485826-6627-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:57.398370 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:57.399292 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:57.403802 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:44:57.404095 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:57.404422 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:44:57.404632 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:57.456205 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.193:40105
I20260619 18:44:57.456372 9362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.193:40105 every 8 connection(s)
I20260619 18:44:57.460824 9363 heartbeater.cc:347] Connected to a master server at 127.6.120.254:39635
I20260619 18:44:57.461215 9363 heartbeater.cc:464] Registering TS with master...
I20260619 18:44:57.461933 9363 heartbeater.cc:511] Master 127.6.120.254:39635 requested a full tablet report, sending...
I20260619 18:44:57.464016 9218 ts_manager.cc:194] Registered new tserver with Master: 71d92b01cf8f4180b811fe293a5fb7da (127.6.120.193:40105)
I20260619 18:44:57.464231 6627 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.004993061s
I20260619 18:44:57.466712 9218 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51608
I20260619 18:44:57.480161 9363 heartbeater.cc:503] Master 127.6.120.254:39635 was elected leader, sending a full tablet report...
I20260619 18:44:57.489571 9218 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51634:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 18:44:57.523850 9328 tablet_service.cc:1467] Processing CreateTablet for tablet 898300e79e224ca7adc6906974b604d9 (DEFAULT_TABLE table=client-testtb [id=ac3e1ed1d93b42d59225925e75961794]), partition=RANGE (key) PARTITION VALUES < 9
I20260619 18:44:57.524062 9326 tablet_service.cc:1467] Processing CreateTablet for tablet 61d941caaec740fcb6e8cfc04007d079 (DEFAULT_TABLE table=client-testtb [id=ac3e1ed1d93b42d59225925e75961794]), partition=RANGE (key) PARTITION 9 <= VALUES
I20260619 18:44:57.525285 9328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 898300e79e224ca7adc6906974b604d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:57.525892 9326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61d941caaec740fcb6e8cfc04007d079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:57.539649 9373 tablet_bootstrap.cc:492] T 898300e79e224ca7adc6906974b604d9 P 71d92b01cf8f4180b811fe293a5fb7da: Bootstrap starting.
I20260619 18:44:57.543908 9373 tablet_bootstrap.cc:654] T 898300e79e224ca7adc6906974b604d9 P 71d92b01cf8f4180b811fe293a5fb7da: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:57.548163 9373 tablet_bootstrap.cc:492] T 898300e79e224ca7adc6906974b604d9 P 71d92b01cf8f4180b811fe293a5fb7da: No bootstrap required, opened a new log
I20260619 18:44:57.548619 9373 ts_tablet_manager.cc:1397] T 898300e79e224ca7adc6906974b604d9 P 71d92b01cf8f4180b811fe293a5fb7da: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260619 18:44:57.550508 9373 raft_consensus.cc:348] T 898300e79e224ca7adc6906974b604d9 P 71d92b01cf8f4180b811fe293a5fb7da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71d92b01cf8f4180b811fe293a5fb7da" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40105 } }
I20260619 18:44:57.550940 9373 raft_consensus.cc:374] T 898300e79e224ca7adc6906974b604d9 P 71d92b01cf8f4180b811fe293a5fb7da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:57.551168 9373 raft_consensus.cc:729] T 898300e79e224ca7adc6906974b604d9 P 71d92b01cf8f4180b811fe293a5fb7da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71d92b01cf8f4180b811fe293a5fb7da, State: Initialized, Role: FOLLOWER
I20260619 18:44:57.551690 9373 consensus_queue.cc:260] T 898300e79e224ca7adc6906974b604d9 P 71d92b01cf8f4180b811fe293a5fb7da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71d92b01cf8f4180b811fe293a5fb7da" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40105 } }
I20260619 18:44:57.552191 9373 raft_consensus.cc:388] T 898300e79e224ca7adc6906974b604d9 P 71d92b01cf8f4180b811fe293a5fb7da [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:57.552433 9373 raft_consensus.cc:482] T 898300e79e224ca7adc6906974b604d9 P 71d92b01cf8f4180b811fe293a5fb7da [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:57.552690 9373 raft_consensus.cc:3037] T 898300e79e224ca7adc6906974b604d9 P 71d92b01cf8f4180b811fe293a5fb7da [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:57.561467 9373 raft_consensus.cc:504] T 898300e79e224ca7adc6906974b604d9 P 71d92b01cf8f4180b811fe293a5fb7da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71d92b01cf8f4180b811fe293a5fb7da" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40105 } }
I20260619 18:44:57.562297 9373 leader_election.cc:302] T 898300e79e224ca7adc6906974b604d9 P 71d92b01cf8f4180b811fe293a5fb7da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 71d92b01cf8f4180b811fe293a5fb7da; no voters:
I20260619 18:44:57.563803 9373 leader_election.cc:288] T 898300e79e224ca7adc6906974b604d9 P 71d92b01cf8f4180b811fe293a5fb7da [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:57.564153 9375 raft_consensus.cc:2781] T 898300e79e224ca7adc6906974b604d9 P 71d92b01cf8f4180b811fe293a5fb7da [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:57.565580 9375 raft_consensus.cc:686] T 898300e79e224ca7adc6906974b604d9 P 71d92b01cf8f4180b811fe293a5fb7da [term 1 LEADER]: Becoming Leader. State: Replica: 71d92b01cf8f4180b811fe293a5fb7da, State: Running, Role: LEADER
I20260619 18:44:57.566287 9375 consensus_queue.cc:237] T 898300e79e224ca7adc6906974b604d9 P 71d92b01cf8f4180b811fe293a5fb7da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71d92b01cf8f4180b811fe293a5fb7da" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40105 } }
I20260619 18:44:57.570065 9373 ts_tablet_manager.cc:1428] T 898300e79e224ca7adc6906974b604d9 P 71d92b01cf8f4180b811fe293a5fb7da: Time spent starting tablet: real 0.021s user 0.016s sys 0.000s
I20260619 18:44:57.571038 9373 tablet_bootstrap.cc:492] T 61d941caaec740fcb6e8cfc04007d079 P 71d92b01cf8f4180b811fe293a5fb7da: Bootstrap starting.
I20260619 18:44:57.572853 9218 catalog_manager.cc:5495] T 898300e79e224ca7adc6906974b604d9 P 71d92b01cf8f4180b811fe293a5fb7da reported cstate change: term changed from 0 to 1, leader changed from <none> to 71d92b01cf8f4180b811fe293a5fb7da (127.6.120.193). New cstate: current_term: 1 leader_uuid: "71d92b01cf8f4180b811fe293a5fb7da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71d92b01cf8f4180b811fe293a5fb7da" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40105 } health_report { overall_health: HEALTHY } } }
I20260619 18:44:57.575990 9373 tablet_bootstrap.cc:654] T 61d941caaec740fcb6e8cfc04007d079 P 71d92b01cf8f4180b811fe293a5fb7da: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:57.581012 9373 tablet_bootstrap.cc:492] T 61d941caaec740fcb6e8cfc04007d079 P 71d92b01cf8f4180b811fe293a5fb7da: No bootstrap required, opened a new log
I20260619 18:44:57.581365 9373 ts_tablet_manager.cc:1397] T 61d941caaec740fcb6e8cfc04007d079 P 71d92b01cf8f4180b811fe293a5fb7da: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.004s
I20260619 18:44:57.583122 9373 raft_consensus.cc:348] T 61d941caaec740fcb6e8cfc04007d079 P 71d92b01cf8f4180b811fe293a5fb7da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71d92b01cf8f4180b811fe293a5fb7da" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40105 } }
I20260619 18:44:57.583631 9373 raft_consensus.cc:374] T 61d941caaec740fcb6e8cfc04007d079 P 71d92b01cf8f4180b811fe293a5fb7da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:57.583904 9373 raft_consensus.cc:729] T 61d941caaec740fcb6e8cfc04007d079 P 71d92b01cf8f4180b811fe293a5fb7da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71d92b01cf8f4180b811fe293a5fb7da, State: Initialized, Role: FOLLOWER
I20260619 18:44:57.584571 9373 consensus_queue.cc:260] T 61d941caaec740fcb6e8cfc04007d079 P 71d92b01cf8f4180b811fe293a5fb7da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71d92b01cf8f4180b811fe293a5fb7da" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40105 } }
I20260619 18:44:57.585057 9373 raft_consensus.cc:388] T 61d941caaec740fcb6e8cfc04007d079 P 71d92b01cf8f4180b811fe293a5fb7da [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:57.585325 9373 raft_consensus.cc:482] T 61d941caaec740fcb6e8cfc04007d079 P 71d92b01cf8f4180b811fe293a5fb7da [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:57.585631 9373 raft_consensus.cc:3037] T 61d941caaec740fcb6e8cfc04007d079 P 71d92b01cf8f4180b811fe293a5fb7da [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:57.692040 9373 raft_consensus.cc:504] T 61d941caaec740fcb6e8cfc04007d079 P 71d92b01cf8f4180b811fe293a5fb7da [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71d92b01cf8f4180b811fe293a5fb7da" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40105 } }
I20260619 18:44:57.692790 9373 leader_election.cc:302] T 61d941caaec740fcb6e8cfc04007d079 P 71d92b01cf8f4180b811fe293a5fb7da [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 71d92b01cf8f4180b811fe293a5fb7da; no voters:
I20260619 18:44:57.693305 9373 leader_election.cc:288] T 61d941caaec740fcb6e8cfc04007d079 P 71d92b01cf8f4180b811fe293a5fb7da [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:57.693475 9376 raft_consensus.cc:2781] T 61d941caaec740fcb6e8cfc04007d079 P 71d92b01cf8f4180b811fe293a5fb7da [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:57.694132 9376 raft_consensus.cc:686] T 61d941caaec740fcb6e8cfc04007d079 P 71d92b01cf8f4180b811fe293a5fb7da [term 1 LEADER]: Becoming Leader. State: Replica: 71d92b01cf8f4180b811fe293a5fb7da, State: Running, Role: LEADER
I20260619 18:44:57.694948 9373 ts_tablet_manager.cc:1428] T 61d941caaec740fcb6e8cfc04007d079 P 71d92b01cf8f4180b811fe293a5fb7da: Time spent starting tablet: real 0.113s user 0.011s sys 0.000s
I20260619 18:44:57.694829 9376 consensus_queue.cc:237] T 61d941caaec740fcb6e8cfc04007d079 P 71d92b01cf8f4180b811fe293a5fb7da [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71d92b01cf8f4180b811fe293a5fb7da" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40105 } }
I20260619 18:44:57.699987 9218 catalog_manager.cc:5495] T 61d941caaec740fcb6e8cfc04007d079 P 71d92b01cf8f4180b811fe293a5fb7da reported cstate change: term changed from 0 to 1, leader changed from <none> to 71d92b01cf8f4180b811fe293a5fb7da (127.6.120.193). New cstate: current_term: 1 leader_uuid: "71d92b01cf8f4180b811fe293a5fb7da" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71d92b01cf8f4180b811fe293a5fb7da" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40105 } health_report { overall_health: HEALTHY } } }
I20260619 18:44:57.729023 6627 tablet_server.cc:178] TabletServer@127.6.120.193:0 shutting down...
I20260619 18:44:57.750980 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:44:57.751742 6627 tablet_replica.cc:330] T 61d941caaec740fcb6e8cfc04007d079 P 71d92b01cf8f4180b811fe293a5fb7da: stopping tablet replica
I20260619 18:44:57.752429 6627 raft_consensus.cc:2229] T 61d941caaec740fcb6e8cfc04007d079 P 71d92b01cf8f4180b811fe293a5fb7da [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:57.752818 6627 raft_consensus.cc:2258] T 61d941caaec740fcb6e8cfc04007d079 P 71d92b01cf8f4180b811fe293a5fb7da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:57.754940 6627 tablet_replica.cc:330] T 898300e79e224ca7adc6906974b604d9 P 71d92b01cf8f4180b811fe293a5fb7da: stopping tablet replica
I20260619 18:44:57.755343 6627 raft_consensus.cc:2229] T 898300e79e224ca7adc6906974b604d9 P 71d92b01cf8f4180b811fe293a5fb7da [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:57.755695 6627 raft_consensus.cc:2258] T 898300e79e224ca7adc6906974b604d9 P 71d92b01cf8f4180b811fe293a5fb7da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:57.776296 6627 tablet_server.cc:194] TabletServer@127.6.120.193:0 shutdown complete.
I20260619 18:44:57.787380 6627 master.cc:537] Master@127.6.120.254:39635 shutting down...
I20260619 18:44:57.802807 6627 raft_consensus.cc:2229] T 00000000000000000000000000000000 P ae63aacee4a14160aa065904281dc424 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:57.803258 6627 raft_consensus.cc:2258] T 00000000000000000000000000000000 P ae63aacee4a14160aa065904281dc424 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:57.803637 6627 tablet_replica.cc:330] T 00000000000000000000000000000000 P ae63aacee4a14160aa065904281dc424: stopping tablet replica
I20260619 18:44:57.822235 6627 master.cc:552] Master@127.6.120.254:39635 shutdown complete.
[ OK ] ClientTest.TestGetTableSchema (726 ms)
[ RUN ] ClientTest.TestCreateDuplicateTable
I20260619 18:44:57.843087 6627 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.120.254:41781
I20260619 18:44:57.844015 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:57.848664 9382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:57.850596 9383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:57.851272 6627 server_base.cc:1034] running on GCE node
W20260619 18:44:57.851287 9385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:57.852478 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:57.852651 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:57.852761 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894697852751 us; error 0 us; skew 500 ppm
I20260619 18:44:57.853179 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:57.855379 6627 webserver.cc:460] Webserver started at http://127.6.120.254:35385/ using document root <none> and password file <none>
I20260619 18:44:57.855787 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:57.855932 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:57.856210 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:57.857234 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestCreateDuplicateTable.1781894682485826-6627-0/minicluster-data/master-0-root/instance:
uuid: "7587bd35c36047f3bb1fb424cffb4f2a"
format_stamp: "Formatted at 2026-06-19 18:44:57 on dist-test-slave-90mn"
I20260619 18:44:57.861428 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260619 18:44:57.864663 9390 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:57.865437 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260619 18:44:57.865726 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestCreateDuplicateTable.1781894682485826-6627-0/minicluster-data/master-0-root
uuid: "7587bd35c36047f3bb1fb424cffb4f2a"
format_stamp: "Formatted at 2026-06-19 18:44:57 on dist-test-slave-90mn"
I20260619 18:44:57.866010 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestCreateDuplicateTable.1781894682485826-6627-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestCreateDuplicateTable.1781894682485826-6627-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestCreateDuplicateTable.1781894682485826-6627-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:57.913475 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:57.914487 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:57.955099 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.254:41781
I20260619 18:44:57.955209 9451 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.254:41781 every 8 connection(s)
I20260619 18:44:57.958675 9452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:57.969503 9452 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7587bd35c36047f3bb1fb424cffb4f2a: Bootstrap starting.
I20260619 18:44:57.973372 9452 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7587bd35c36047f3bb1fb424cffb4f2a: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:57.977171 9452 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7587bd35c36047f3bb1fb424cffb4f2a: No bootstrap required, opened a new log
I20260619 18:44:57.978950 9452 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7587bd35c36047f3bb1fb424cffb4f2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7587bd35c36047f3bb1fb424cffb4f2a" member_type: VOTER }
I20260619 18:44:57.979315 9452 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7587bd35c36047f3bb1fb424cffb4f2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:57.979488 9452 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7587bd35c36047f3bb1fb424cffb4f2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7587bd35c36047f3bb1fb424cffb4f2a, State: Initialized, Role: FOLLOWER
I20260619 18:44:57.980067 9452 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7587bd35c36047f3bb1fb424cffb4f2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7587bd35c36047f3bb1fb424cffb4f2a" member_type: VOTER }
I20260619 18:44:57.980484 9452 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7587bd35c36047f3bb1fb424cffb4f2a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:57.980680 9452 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7587bd35c36047f3bb1fb424cffb4f2a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:57.980875 9452 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7587bd35c36047f3bb1fb424cffb4f2a [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:57.994057 9452 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7587bd35c36047f3bb1fb424cffb4f2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7587bd35c36047f3bb1fb424cffb4f2a" member_type: VOTER }
I20260619 18:44:57.994843 9452 leader_election.cc:302] T 00000000000000000000000000000000 P 7587bd35c36047f3bb1fb424cffb4f2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7587bd35c36047f3bb1fb424cffb4f2a; no voters:
I20260619 18:44:57.996874 9452 leader_election.cc:288] T 00000000000000000000000000000000 P 7587bd35c36047f3bb1fb424cffb4f2a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:57.997275 9455 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7587bd35c36047f3bb1fb424cffb4f2a [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:57.998711 9455 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7587bd35c36047f3bb1fb424cffb4f2a [term 1 LEADER]: Becoming Leader. State: Replica: 7587bd35c36047f3bb1fb424cffb4f2a, State: Running, Role: LEADER
I20260619 18:44:57.999472 9455 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7587bd35c36047f3bb1fb424cffb4f2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7587bd35c36047f3bb1fb424cffb4f2a" member_type: VOTER }
I20260619 18:44:58.001128 9452 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7587bd35c36047f3bb1fb424cffb4f2a [sys.catalog]: configured and running, proceeding with master startup.
I20260619 18:44:58.002274 9456 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7587bd35c36047f3bb1fb424cffb4f2a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7587bd35c36047f3bb1fb424cffb4f2a. Latest consensus state: current_term: 1 leader_uuid: "7587bd35c36047f3bb1fb424cffb4f2a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7587bd35c36047f3bb1fb424cffb4f2a" member_type: VOTER } }
I20260619 18:44:58.002278 9457 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7587bd35c36047f3bb1fb424cffb4f2a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7587bd35c36047f3bb1fb424cffb4f2a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7587bd35c36047f3bb1fb424cffb4f2a" member_type: VOTER } }
I20260619 18:44:58.002964 9456 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7587bd35c36047f3bb1fb424cffb4f2a [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:58.003087 9457 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7587bd35c36047f3bb1fb424cffb4f2a [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:58.005779 9459 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 18:44:58.011128 9459 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 18:44:58.015035 6627 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260619 18:44:58.019465 9459 catalog_manager.cc:1347] Generated new cluster ID: 287366d19d7d49f7a04ec1523de9c482
I20260619 18:44:58.019763 9459 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 18:44:58.041469 9459 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 18:44:58.043077 9459 catalog_manager.cc:1504] Loading token signing keys...
I20260619 18:44:58.055840 9459 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7587bd35c36047f3bb1fb424cffb4f2a: Generated new TSK 0
I20260619 18:44:58.056583 9459 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 18:44:58.081284 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:58.086896 9473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:58.088018 9474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:58.090646 6627 server_base.cc:1034] running on GCE node
W20260619 18:44:58.091153 9476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:58.091938 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:58.092203 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:58.092374 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894698092360 us; error 0 us; skew 500 ppm
I20260619 18:44:58.092926 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:58.095317 6627 webserver.cc:460] Webserver started at http://127.6.120.193:44525/ using document root <none> and password file <none>
I20260619 18:44:58.095796 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:58.095993 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:58.096287 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:58.097342 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestCreateDuplicateTable.1781894682485826-6627-0/minicluster-data/ts-0-root/instance:
uuid: "ac395ef37f7743b08ca3b6ba73fa4761"
format_stamp: "Formatted at 2026-06-19 18:44:58 on dist-test-slave-90mn"
I20260619 18:44:58.101925 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260619 18:44:58.105276 9481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:58.106048 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260619 18:44:58.106339 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestCreateDuplicateTable.1781894682485826-6627-0/minicluster-data/ts-0-root
uuid: "ac395ef37f7743b08ca3b6ba73fa4761"
format_stamp: "Formatted at 2026-06-19 18:44:58 on dist-test-slave-90mn"
I20260619 18:44:58.106638 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestCreateDuplicateTable.1781894682485826-6627-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestCreateDuplicateTable.1781894682485826-6627-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestCreateDuplicateTable.1781894682485826-6627-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:58.126833 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:58.127830 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:58.132658 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:44:58.132947 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:58.133242 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:44:58.133464 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:58.185981 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.193:43887
I20260619 18:44:58.186090 9551 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.193:43887 every 8 connection(s)
I20260619 18:44:58.190297 9552 heartbeater.cc:347] Connected to a master server at 127.6.120.254:41781
I20260619 18:44:58.190603 9552 heartbeater.cc:464] Registering TS with master...
I20260619 18:44:58.191306 9552 heartbeater.cc:511] Master 127.6.120.254:41781 requested a full tablet report, sending...
I20260619 18:44:58.193092 9407 ts_manager.cc:194] Registered new tserver with Master: ac395ef37f7743b08ca3b6ba73fa4761 (127.6.120.193:43887)
I20260619 18:44:58.193740 6627 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.004720659s
I20260619 18:44:58.194963 9407 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40718
I20260619 18:44:58.208504 9552 heartbeater.cc:503] Master 127.6.120.254:41781 was elected leader, sending a full tablet report...
I20260619 18:44:58.217083 9407 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40728:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 18:44:58.251844 9517 tablet_service.cc:1467] Processing CreateTablet for tablet ebabe93389c9433ea03f82d1ca0dd133 (DEFAULT_TABLE table=client-testtb [id=cdfbea268d5f4055bf12454d0f177d25]), partition=RANGE (key) PARTITION VALUES < 9
I20260619 18:44:58.252058 9516 tablet_service.cc:1467] Processing CreateTablet for tablet e14c22e6ddef4bfdb9bd031973a11a32 (DEFAULT_TABLE table=client-testtb [id=cdfbea268d5f4055bf12454d0f177d25]), partition=RANGE (key) PARTITION 9 <= VALUES
I20260619 18:44:58.253298 9517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebabe93389c9433ea03f82d1ca0dd133. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:58.253930 9516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e14c22e6ddef4bfdb9bd031973a11a32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:58.266101 9562 tablet_bootstrap.cc:492] T e14c22e6ddef4bfdb9bd031973a11a32 P ac395ef37f7743b08ca3b6ba73fa4761: Bootstrap starting.
I20260619 18:44:58.270583 9562 tablet_bootstrap.cc:654] T e14c22e6ddef4bfdb9bd031973a11a32 P ac395ef37f7743b08ca3b6ba73fa4761: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:58.274749 9562 tablet_bootstrap.cc:492] T e14c22e6ddef4bfdb9bd031973a11a32 P ac395ef37f7743b08ca3b6ba73fa4761: No bootstrap required, opened a new log
I20260619 18:44:58.275189 9562 ts_tablet_manager.cc:1397] T e14c22e6ddef4bfdb9bd031973a11a32 P ac395ef37f7743b08ca3b6ba73fa4761: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260619 18:44:58.277240 9562 raft_consensus.cc:348] T e14c22e6ddef4bfdb9bd031973a11a32 P ac395ef37f7743b08ca3b6ba73fa4761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac395ef37f7743b08ca3b6ba73fa4761" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 43887 } }
I20260619 18:44:58.277812 9562 raft_consensus.cc:374] T e14c22e6ddef4bfdb9bd031973a11a32 P ac395ef37f7743b08ca3b6ba73fa4761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:58.278043 9562 raft_consensus.cc:729] T e14c22e6ddef4bfdb9bd031973a11a32 P ac395ef37f7743b08ca3b6ba73fa4761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac395ef37f7743b08ca3b6ba73fa4761, State: Initialized, Role: FOLLOWER
I20260619 18:44:58.278575 9562 consensus_queue.cc:260] T e14c22e6ddef4bfdb9bd031973a11a32 P ac395ef37f7743b08ca3b6ba73fa4761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac395ef37f7743b08ca3b6ba73fa4761" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 43887 } }
I20260619 18:44:58.279148 9562 raft_consensus.cc:388] T e14c22e6ddef4bfdb9bd031973a11a32 P ac395ef37f7743b08ca3b6ba73fa4761 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:58.279436 9562 raft_consensus.cc:482] T e14c22e6ddef4bfdb9bd031973a11a32 P ac395ef37f7743b08ca3b6ba73fa4761 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:58.279659 9562 raft_consensus.cc:3037] T e14c22e6ddef4bfdb9bd031973a11a32 P ac395ef37f7743b08ca3b6ba73fa4761 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:58.371436 9562 raft_consensus.cc:504] T e14c22e6ddef4bfdb9bd031973a11a32 P ac395ef37f7743b08ca3b6ba73fa4761 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac395ef37f7743b08ca3b6ba73fa4761" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 43887 } }
I20260619 18:44:58.372081 9562 leader_election.cc:302] T e14c22e6ddef4bfdb9bd031973a11a32 P ac395ef37f7743b08ca3b6ba73fa4761 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac395ef37f7743b08ca3b6ba73fa4761; no voters:
I20260619 18:44:58.373531 9562 leader_election.cc:288] T e14c22e6ddef4bfdb9bd031973a11a32 P ac395ef37f7743b08ca3b6ba73fa4761 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:58.373893 9564 raft_consensus.cc:2781] T e14c22e6ddef4bfdb9bd031973a11a32 P ac395ef37f7743b08ca3b6ba73fa4761 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:58.375934 9564 raft_consensus.cc:686] T e14c22e6ddef4bfdb9bd031973a11a32 P ac395ef37f7743b08ca3b6ba73fa4761 [term 1 LEADER]: Becoming Leader. State: Replica: ac395ef37f7743b08ca3b6ba73fa4761, State: Running, Role: LEADER
I20260619 18:44:58.376784 9564 consensus_queue.cc:237] T e14c22e6ddef4bfdb9bd031973a11a32 P ac395ef37f7743b08ca3b6ba73fa4761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac395ef37f7743b08ca3b6ba73fa4761" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 43887 } }
I20260619 18:44:58.377698 9562 ts_tablet_manager.cc:1428] T e14c22e6ddef4bfdb9bd031973a11a32 P ac395ef37f7743b08ca3b6ba73fa4761: Time spent starting tablet: real 0.102s user 0.008s sys 0.008s
I20260619 18:44:58.378466 9562 tablet_bootstrap.cc:492] T ebabe93389c9433ea03f82d1ca0dd133 P ac395ef37f7743b08ca3b6ba73fa4761: Bootstrap starting.
I20260619 18:44:58.383028 9406 catalog_manager.cc:5495] T e14c22e6ddef4bfdb9bd031973a11a32 P ac395ef37f7743b08ca3b6ba73fa4761 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac395ef37f7743b08ca3b6ba73fa4761 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "ac395ef37f7743b08ca3b6ba73fa4761" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac395ef37f7743b08ca3b6ba73fa4761" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 43887 } health_report { overall_health: HEALTHY } } }
I20260619 18:44:58.383955 9562 tablet_bootstrap.cc:654] T ebabe93389c9433ea03f82d1ca0dd133 P ac395ef37f7743b08ca3b6ba73fa4761: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:58.388657 9562 tablet_bootstrap.cc:492] T ebabe93389c9433ea03f82d1ca0dd133 P ac395ef37f7743b08ca3b6ba73fa4761: No bootstrap required, opened a new log
I20260619 18:44:58.389039 9562 ts_tablet_manager.cc:1397] T ebabe93389c9433ea03f82d1ca0dd133 P ac395ef37f7743b08ca3b6ba73fa4761: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260619 18:44:58.391175 9562 raft_consensus.cc:348] T ebabe93389c9433ea03f82d1ca0dd133 P ac395ef37f7743b08ca3b6ba73fa4761 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac395ef37f7743b08ca3b6ba73fa4761" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 43887 } }
I20260619 18:44:58.391651 9562 raft_consensus.cc:374] T ebabe93389c9433ea03f82d1ca0dd133 P ac395ef37f7743b08ca3b6ba73fa4761 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:58.391875 9562 raft_consensus.cc:729] T ebabe93389c9433ea03f82d1ca0dd133 P ac395ef37f7743b08ca3b6ba73fa4761 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac395ef37f7743b08ca3b6ba73fa4761, State: Initialized, Role: FOLLOWER
I20260619 18:44:58.392436 9562 consensus_queue.cc:260] T ebabe93389c9433ea03f82d1ca0dd133 P ac395ef37f7743b08ca3b6ba73fa4761 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac395ef37f7743b08ca3b6ba73fa4761" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 43887 } }
I20260619 18:44:58.392939 9562 raft_consensus.cc:388] T ebabe93389c9433ea03f82d1ca0dd133 P ac395ef37f7743b08ca3b6ba73fa4761 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:58.393234 9562 raft_consensus.cc:482] T ebabe93389c9433ea03f82d1ca0dd133 P ac395ef37f7743b08ca3b6ba73fa4761 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:58.393569 9562 raft_consensus.cc:3037] T ebabe93389c9433ea03f82d1ca0dd133 P ac395ef37f7743b08ca3b6ba73fa4761 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:58.472465 9562 raft_consensus.cc:504] T ebabe93389c9433ea03f82d1ca0dd133 P ac395ef37f7743b08ca3b6ba73fa4761 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac395ef37f7743b08ca3b6ba73fa4761" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 43887 } }
I20260619 18:44:58.473307 9562 leader_election.cc:302] T ebabe93389c9433ea03f82d1ca0dd133 P ac395ef37f7743b08ca3b6ba73fa4761 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac395ef37f7743b08ca3b6ba73fa4761; no voters:
I20260619 18:44:58.474028 9562 leader_election.cc:288] T ebabe93389c9433ea03f82d1ca0dd133 P ac395ef37f7743b08ca3b6ba73fa4761 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:58.474188 9564 raft_consensus.cc:2781] T ebabe93389c9433ea03f82d1ca0dd133 P ac395ef37f7743b08ca3b6ba73fa4761 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:58.474706 9564 raft_consensus.cc:686] T ebabe93389c9433ea03f82d1ca0dd133 P ac395ef37f7743b08ca3b6ba73fa4761 [term 1 LEADER]: Becoming Leader. State: Replica: ac395ef37f7743b08ca3b6ba73fa4761, State: Running, Role: LEADER
I20260619 18:44:58.475447 9564 consensus_queue.cc:237] T ebabe93389c9433ea03f82d1ca0dd133 P ac395ef37f7743b08ca3b6ba73fa4761 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac395ef37f7743b08ca3b6ba73fa4761" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 43887 } }
I20260619 18:44:58.475916 9562 ts_tablet_manager.cc:1428] T ebabe93389c9433ea03f82d1ca0dd133 P ac395ef37f7743b08ca3b6ba73fa4761: Time spent starting tablet: real 0.087s user 0.008s sys 0.003s
I20260619 18:44:58.480914 9406 catalog_manager.cc:5495] T ebabe93389c9433ea03f82d1ca0dd133 P ac395ef37f7743b08ca3b6ba73fa4761 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac395ef37f7743b08ca3b6ba73fa4761 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "ac395ef37f7743b08ca3b6ba73fa4761" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac395ef37f7743b08ca3b6ba73fa4761" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 43887 } health_report { overall_health: HEALTHY } } }
I20260619 18:44:58.497011 9406 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40728:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 18:44:58.501348 6627 tablet_server.cc:178] TabletServer@127.6.120.193:0 shutting down...
I20260619 18:44:58.523697 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:44:58.524466 6627 tablet_replica.cc:330] T ebabe93389c9433ea03f82d1ca0dd133 P ac395ef37f7743b08ca3b6ba73fa4761: stopping tablet replica
I20260619 18:44:58.524928 6627 raft_consensus.cc:2229] T ebabe93389c9433ea03f82d1ca0dd133 P ac395ef37f7743b08ca3b6ba73fa4761 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:58.525331 6627 raft_consensus.cc:2258] T ebabe93389c9433ea03f82d1ca0dd133 P ac395ef37f7743b08ca3b6ba73fa4761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:58.527436 6627 tablet_replica.cc:330] T e14c22e6ddef4bfdb9bd031973a11a32 P ac395ef37f7743b08ca3b6ba73fa4761: stopping tablet replica
I20260619 18:44:58.527868 6627 raft_consensus.cc:2229] T e14c22e6ddef4bfdb9bd031973a11a32 P ac395ef37f7743b08ca3b6ba73fa4761 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:58.528327 6627 raft_consensus.cc:2258] T e14c22e6ddef4bfdb9bd031973a11a32 P ac395ef37f7743b08ca3b6ba73fa4761 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:58.548846 6627 tablet_server.cc:194] TabletServer@127.6.120.193:0 shutdown complete.
I20260619 18:44:58.560211 6627 master.cc:537] Master@127.6.120.254:41781 shutting down...
I20260619 18:44:58.579406 6627 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 7587bd35c36047f3bb1fb424cffb4f2a [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:58.579922 6627 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 7587bd35c36047f3bb1fb424cffb4f2a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:58.580264 6627 tablet_replica.cc:330] T 00000000000000000000000000000000 P 7587bd35c36047f3bb1fb424cffb4f2a: stopping tablet replica
I20260619 18:44:58.588769 6627 master.cc:552] Master@127.6.120.254:41781 shutdown complete.
[ OK ] ClientTest.TestCreateDuplicateTable (765 ms)
[ RUN ] ClientTest.TestInsertEmptyPK
I20260619 18:44:58.608515 6627 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.120.254:33785
I20260619 18:44:58.609534 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:58.614303 9571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:58.616010 9572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:58.616483 9574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:58.616834 6627 server_base.cc:1034] running on GCE node
I20260619 18:44:58.617529 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:58.617787 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:58.617956 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894698617942 us; error 0 us; skew 500 ppm
I20260619 18:44:58.618475 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:58.620802 6627 webserver.cc:460] Webserver started at http://127.6.120.254:45219/ using document root <none> and password file <none>
I20260619 18:44:58.621249 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:58.621448 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:58.621713 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:58.622766 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestInsertEmptyPK.1781894682485826-6627-0/minicluster-data/master-0-root/instance:
uuid: "7227385ad01c44c39eee596a882f8a34"
format_stamp: "Formatted at 2026-06-19 18:44:58 on dist-test-slave-90mn"
I20260619 18:44:58.627358 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260619 18:44:58.630528 9579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:58.631422 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260619 18:44:58.631668 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestInsertEmptyPK.1781894682485826-6627-0/minicluster-data/master-0-root
uuid: "7227385ad01c44c39eee596a882f8a34"
format_stamp: "Formatted at 2026-06-19 18:44:58 on dist-test-slave-90mn"
I20260619 18:44:58.631896 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestInsertEmptyPK.1781894682485826-6627-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestInsertEmptyPK.1781894682485826-6627-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestInsertEmptyPK.1781894682485826-6627-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:58.656083 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:58.657044 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:58.699133 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.254:33785
I20260619 18:44:58.699231 9640 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.254:33785 every 8 connection(s)
I20260619 18:44:58.702966 9641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:58.712288 9641 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7227385ad01c44c39eee596a882f8a34: Bootstrap starting.
I20260619 18:44:58.716125 9641 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7227385ad01c44c39eee596a882f8a34: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:58.719774 9641 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7227385ad01c44c39eee596a882f8a34: No bootstrap required, opened a new log
I20260619 18:44:58.721529 9641 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7227385ad01c44c39eee596a882f8a34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7227385ad01c44c39eee596a882f8a34" member_type: VOTER }
I20260619 18:44:58.721894 9641 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7227385ad01c44c39eee596a882f8a34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:58.722057 9641 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7227385ad01c44c39eee596a882f8a34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7227385ad01c44c39eee596a882f8a34, State: Initialized, Role: FOLLOWER
I20260619 18:44:58.722658 9641 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7227385ad01c44c39eee596a882f8a34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7227385ad01c44c39eee596a882f8a34" member_type: VOTER }
I20260619 18:44:58.723084 9641 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7227385ad01c44c39eee596a882f8a34 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:58.723317 9641 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7227385ad01c44c39eee596a882f8a34 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:58.723575 9641 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7227385ad01c44c39eee596a882f8a34 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:58.777441 9641 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7227385ad01c44c39eee596a882f8a34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7227385ad01c44c39eee596a882f8a34" member_type: VOTER }
I20260619 18:44:58.778146 9641 leader_election.cc:302] T 00000000000000000000000000000000 P 7227385ad01c44c39eee596a882f8a34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7227385ad01c44c39eee596a882f8a34; no voters:
I20260619 18:44:58.779363 9641 leader_election.cc:288] T 00000000000000000000000000000000 P 7227385ad01c44c39eee596a882f8a34 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:58.779789 9644 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7227385ad01c44c39eee596a882f8a34 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:58.781416 9644 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7227385ad01c44c39eee596a882f8a34 [term 1 LEADER]: Becoming Leader. State: Replica: 7227385ad01c44c39eee596a882f8a34, State: Running, Role: LEADER
I20260619 18:44:58.782223 9644 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7227385ad01c44c39eee596a882f8a34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7227385ad01c44c39eee596a882f8a34" member_type: VOTER }
I20260619 18:44:58.782470 9641 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7227385ad01c44c39eee596a882f8a34 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 18:44:58.784935 9645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7227385ad01c44c39eee596a882f8a34 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7227385ad01c44c39eee596a882f8a34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7227385ad01c44c39eee596a882f8a34" member_type: VOTER } }
I20260619 18:44:58.785648 9645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7227385ad01c44c39eee596a882f8a34 [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:58.784950 9646 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7227385ad01c44c39eee596a882f8a34 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7227385ad01c44c39eee596a882f8a34. Latest consensus state: current_term: 1 leader_uuid: "7227385ad01c44c39eee596a882f8a34" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7227385ad01c44c39eee596a882f8a34" member_type: VOTER } }
I20260619 18:44:58.786125 9646 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7227385ad01c44c39eee596a882f8a34 [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:58.789486 9650 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 18:44:58.797103 9650 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 18:44:58.798027 6627 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260619 18:44:58.805389 9650 catalog_manager.cc:1347] Generated new cluster ID: f3628a5d28264bcc92fc91fdc1651edd
I20260619 18:44:58.805691 9650 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 18:44:58.830660 9650 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 18:44:58.832481 9650 catalog_manager.cc:1504] Loading token signing keys...
I20260619 18:44:58.851471 9650 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7227385ad01c44c39eee596a882f8a34: Generated new TSK 0
I20260619 18:44:58.852267 9650 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 18:44:58.865031 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:58.871021 9662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:58.872581 9663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:58.874104 6627 server_base.cc:1034] running on GCE node
W20260619 18:44:58.874018 9665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:58.875012 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:58.875182 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:58.875377 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894698875346 us; error 0 us; skew 500 ppm
I20260619 18:44:58.875873 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:58.878237 6627 webserver.cc:460] Webserver started at http://127.6.120.193:39071/ using document root <none> and password file <none>
I20260619 18:44:58.878676 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:58.878854 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:58.879112 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:58.880203 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestInsertEmptyPK.1781894682485826-6627-0/minicluster-data/ts-0-root/instance:
uuid: "902a55ae488c4b06803c5dc8b0968256"
format_stamp: "Formatted at 2026-06-19 18:44:58 on dist-test-slave-90mn"
I20260619 18:44:58.885010 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260619 18:44:58.888262 9670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:58.889036 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260619 18:44:58.889329 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestInsertEmptyPK.1781894682485826-6627-0/minicluster-data/ts-0-root
uuid: "902a55ae488c4b06803c5dc8b0968256"
format_stamp: "Formatted at 2026-06-19 18:44:58 on dist-test-slave-90mn"
I20260619 18:44:58.889600 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestInsertEmptyPK.1781894682485826-6627-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestInsertEmptyPK.1781894682485826-6627-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestInsertEmptyPK.1781894682485826-6627-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:58.917809 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:58.918812 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:58.923743 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:44:58.924053 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:58.924372 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:44:58.924578 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:58.976886 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.193:38975
I20260619 18:44:58.976948 9740 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.193:38975 every 8 connection(s)
I20260619 18:44:58.981657 9741 heartbeater.cc:347] Connected to a master server at 127.6.120.254:33785
I20260619 18:44:58.982002 9741 heartbeater.cc:464] Registering TS with master...
I20260619 18:44:58.982738 9741 heartbeater.cc:511] Master 127.6.120.254:33785 requested a full tablet report, sending...
I20260619 18:44:58.984751 9596 ts_manager.cc:194] Registered new tserver with Master: 902a55ae488c4b06803c5dc8b0968256 (127.6.120.193:38975)
I20260619 18:44:58.984836 6627 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.004831674s
I20260619 18:44:58.986999 9596 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34288
I20260619 18:44:59.000864 9741 heartbeater.cc:503] Master 127.6.120.254:33785 was elected leader, sending a full tablet report...
I20260619 18:44:59.008749 9596 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34316:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 18:44:59.042476 9706 tablet_service.cc:1467] Processing CreateTablet for tablet 58fb54d34a94436da1105ba8dc7e406b (DEFAULT_TABLE table=client-testtb [id=5fa53b2d538a4be19c9e3649f75cca9c]), partition=RANGE (key) PARTITION VALUES < 9
I20260619 18:44:59.042665 9705 tablet_service.cc:1467] Processing CreateTablet for tablet b0117de58d434be28e7d69890d01c93b (DEFAULT_TABLE table=client-testtb [id=5fa53b2d538a4be19c9e3649f75cca9c]), partition=RANGE (key) PARTITION 9 <= VALUES
I20260619 18:44:59.043906 9706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58fb54d34a94436da1105ba8dc7e406b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:59.044826 9705 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0117de58d434be28e7d69890d01c93b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:59.060225 9751 tablet_bootstrap.cc:492] T 58fb54d34a94436da1105ba8dc7e406b P 902a55ae488c4b06803c5dc8b0968256: Bootstrap starting.
I20260619 18:44:59.063980 9751 tablet_bootstrap.cc:654] T 58fb54d34a94436da1105ba8dc7e406b P 902a55ae488c4b06803c5dc8b0968256: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:59.067875 9751 tablet_bootstrap.cc:492] T 58fb54d34a94436da1105ba8dc7e406b P 902a55ae488c4b06803c5dc8b0968256: No bootstrap required, opened a new log
I20260619 18:44:59.068269 9751 ts_tablet_manager.cc:1397] T 58fb54d34a94436da1105ba8dc7e406b P 902a55ae488c4b06803c5dc8b0968256: Time spent bootstrapping tablet: real 0.008s user 0.008s sys 0.000s
I20260619 18:44:59.070426 9751 raft_consensus.cc:348] T 58fb54d34a94436da1105ba8dc7e406b P 902a55ae488c4b06803c5dc8b0968256 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "902a55ae488c4b06803c5dc8b0968256" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38975 } }
I20260619 18:44:59.070951 9751 raft_consensus.cc:374] T 58fb54d34a94436da1105ba8dc7e406b P 902a55ae488c4b06803c5dc8b0968256 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:59.071163 9751 raft_consensus.cc:729] T 58fb54d34a94436da1105ba8dc7e406b P 902a55ae488c4b06803c5dc8b0968256 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 902a55ae488c4b06803c5dc8b0968256, State: Initialized, Role: FOLLOWER
I20260619 18:44:59.071725 9751 consensus_queue.cc:260] T 58fb54d34a94436da1105ba8dc7e406b P 902a55ae488c4b06803c5dc8b0968256 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "902a55ae488c4b06803c5dc8b0968256" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38975 } }
I20260619 18:44:59.072296 9751 raft_consensus.cc:388] T 58fb54d34a94436da1105ba8dc7e406b P 902a55ae488c4b06803c5dc8b0968256 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:59.072613 9751 raft_consensus.cc:482] T 58fb54d34a94436da1105ba8dc7e406b P 902a55ae488c4b06803c5dc8b0968256 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:59.072896 9751 raft_consensus.cc:3037] T 58fb54d34a94436da1105ba8dc7e406b P 902a55ae488c4b06803c5dc8b0968256 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:59.086205 9751 raft_consensus.cc:504] T 58fb54d34a94436da1105ba8dc7e406b P 902a55ae488c4b06803c5dc8b0968256 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "902a55ae488c4b06803c5dc8b0968256" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38975 } }
I20260619 18:44:59.087054 9751 leader_election.cc:302] T 58fb54d34a94436da1105ba8dc7e406b P 902a55ae488c4b06803c5dc8b0968256 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 902a55ae488c4b06803c5dc8b0968256; no voters:
I20260619 18:44:59.088653 9751 leader_election.cc:288] T 58fb54d34a94436da1105ba8dc7e406b P 902a55ae488c4b06803c5dc8b0968256 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:59.088984 9753 raft_consensus.cc:2781] T 58fb54d34a94436da1105ba8dc7e406b P 902a55ae488c4b06803c5dc8b0968256 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:59.090588 9753 raft_consensus.cc:686] T 58fb54d34a94436da1105ba8dc7e406b P 902a55ae488c4b06803c5dc8b0968256 [term 1 LEADER]: Becoming Leader. State: Replica: 902a55ae488c4b06803c5dc8b0968256, State: Running, Role: LEADER
I20260619 18:44:59.091202 9751 ts_tablet_manager.cc:1428] T 58fb54d34a94436da1105ba8dc7e406b P 902a55ae488c4b06803c5dc8b0968256: Time spent starting tablet: real 0.023s user 0.014s sys 0.000s
I20260619 18:44:59.091365 9753 consensus_queue.cc:237] T 58fb54d34a94436da1105ba8dc7e406b P 902a55ae488c4b06803c5dc8b0968256 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "902a55ae488c4b06803c5dc8b0968256" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38975 } }
I20260619 18:44:59.092147 9751 tablet_bootstrap.cc:492] T b0117de58d434be28e7d69890d01c93b P 902a55ae488c4b06803c5dc8b0968256: Bootstrap starting.
I20260619 18:44:59.097607 9751 tablet_bootstrap.cc:654] T b0117de58d434be28e7d69890d01c93b P 902a55ae488c4b06803c5dc8b0968256: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:59.097442 9595 catalog_manager.cc:5495] T 58fb54d34a94436da1105ba8dc7e406b P 902a55ae488c4b06803c5dc8b0968256 reported cstate change: term changed from 0 to 1, leader changed from <none> to 902a55ae488c4b06803c5dc8b0968256 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "902a55ae488c4b06803c5dc8b0968256" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "902a55ae488c4b06803c5dc8b0968256" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38975 } health_report { overall_health: HEALTHY } } }
I20260619 18:44:59.101974 9751 tablet_bootstrap.cc:492] T b0117de58d434be28e7d69890d01c93b P 902a55ae488c4b06803c5dc8b0968256: No bootstrap required, opened a new log
I20260619 18:44:59.102391 9751 ts_tablet_manager.cc:1397] T b0117de58d434be28e7d69890d01c93b P 902a55ae488c4b06803c5dc8b0968256: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260619 18:44:59.104534 9751 raft_consensus.cc:348] T b0117de58d434be28e7d69890d01c93b P 902a55ae488c4b06803c5dc8b0968256 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "902a55ae488c4b06803c5dc8b0968256" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38975 } }
I20260619 18:44:59.105093 9751 raft_consensus.cc:374] T b0117de58d434be28e7d69890d01c93b P 902a55ae488c4b06803c5dc8b0968256 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:59.105332 9751 raft_consensus.cc:729] T b0117de58d434be28e7d69890d01c93b P 902a55ae488c4b06803c5dc8b0968256 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 902a55ae488c4b06803c5dc8b0968256, State: Initialized, Role: FOLLOWER
I20260619 18:44:59.105930 9751 consensus_queue.cc:260] T b0117de58d434be28e7d69890d01c93b P 902a55ae488c4b06803c5dc8b0968256 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "902a55ae488c4b06803c5dc8b0968256" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38975 } }
I20260619 18:44:59.106534 9751 raft_consensus.cc:388] T b0117de58d434be28e7d69890d01c93b P 902a55ae488c4b06803c5dc8b0968256 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:59.106832 9751 raft_consensus.cc:482] T b0117de58d434be28e7d69890d01c93b P 902a55ae488c4b06803c5dc8b0968256 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:59.107146 9751 raft_consensus.cc:3037] T b0117de58d434be28e7d69890d01c93b P 902a55ae488c4b06803c5dc8b0968256 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:59.185101 9751 raft_consensus.cc:504] T b0117de58d434be28e7d69890d01c93b P 902a55ae488c4b06803c5dc8b0968256 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "902a55ae488c4b06803c5dc8b0968256" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38975 } }
I20260619 18:44:59.185775 9751 leader_election.cc:302] T b0117de58d434be28e7d69890d01c93b P 902a55ae488c4b06803c5dc8b0968256 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 902a55ae488c4b06803c5dc8b0968256; no voters:
I20260619 18:44:59.186276 9751 leader_election.cc:288] T b0117de58d434be28e7d69890d01c93b P 902a55ae488c4b06803c5dc8b0968256 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:59.186525 9753 raft_consensus.cc:2781] T b0117de58d434be28e7d69890d01c93b P 902a55ae488c4b06803c5dc8b0968256 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:59.187302 9753 raft_consensus.cc:686] T b0117de58d434be28e7d69890d01c93b P 902a55ae488c4b06803c5dc8b0968256 [term 1 LEADER]: Becoming Leader. State: Replica: 902a55ae488c4b06803c5dc8b0968256, State: Running, Role: LEADER
I20260619 18:44:59.187875 9751 ts_tablet_manager.cc:1428] T b0117de58d434be28e7d69890d01c93b P 902a55ae488c4b06803c5dc8b0968256: Time spent starting tablet: real 0.085s user 0.012s sys 0.000s
I20260619 18:44:59.188068 9753 consensus_queue.cc:237] T b0117de58d434be28e7d69890d01c93b P 902a55ae488c4b06803c5dc8b0968256 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "902a55ae488c4b06803c5dc8b0968256" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38975 } }
I20260619 18:44:59.194425 9596 catalog_manager.cc:5495] T b0117de58d434be28e7d69890d01c93b P 902a55ae488c4b06803c5dc8b0968256 reported cstate change: term changed from 0 to 1, leader changed from <none> to 902a55ae488c4b06803c5dc8b0968256 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "902a55ae488c4b06803c5dc8b0968256" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "902a55ae488c4b06803c5dc8b0968256" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38975 } health_report { overall_health: HEALTHY } } }
I20260619 18:44:59.241262 9596 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34316:
name: "empty-pk"
schema {
columns {
name: "k1"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "v1"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "k1"
}
}
}
I20260619 18:44:59.259939 9706 tablet_service.cc:1467] Processing CreateTablet for tablet df0c304807874e45bd3bbd0a8f8e011f (DEFAULT_TABLE table=empty-pk [id=2c4b79faecc04f2c88009ee5b5cbb07a]), partition=RANGE (k1) PARTITION UNBOUNDED
I20260619 18:44:59.261081 9706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df0c304807874e45bd3bbd0a8f8e011f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:59.271711 9751 tablet_bootstrap.cc:492] T df0c304807874e45bd3bbd0a8f8e011f P 902a55ae488c4b06803c5dc8b0968256: Bootstrap starting.
I20260619 18:44:59.276059 9751 tablet_bootstrap.cc:654] T df0c304807874e45bd3bbd0a8f8e011f P 902a55ae488c4b06803c5dc8b0968256: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:59.279490 9751 tablet_bootstrap.cc:492] T df0c304807874e45bd3bbd0a8f8e011f P 902a55ae488c4b06803c5dc8b0968256: No bootstrap required, opened a new log
I20260619 18:44:59.279888 9751 ts_tablet_manager.cc:1397] T df0c304807874e45bd3bbd0a8f8e011f P 902a55ae488c4b06803c5dc8b0968256: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260619 18:44:59.281936 9751 raft_consensus.cc:348] T df0c304807874e45bd3bbd0a8f8e011f P 902a55ae488c4b06803c5dc8b0968256 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "902a55ae488c4b06803c5dc8b0968256" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38975 } }
I20260619 18:44:59.282356 9751 raft_consensus.cc:374] T df0c304807874e45bd3bbd0a8f8e011f P 902a55ae488c4b06803c5dc8b0968256 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:59.282596 9751 raft_consensus.cc:729] T df0c304807874e45bd3bbd0a8f8e011f P 902a55ae488c4b06803c5dc8b0968256 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 902a55ae488c4b06803c5dc8b0968256, State: Initialized, Role: FOLLOWER
I20260619 18:44:59.283149 9751 consensus_queue.cc:260] T df0c304807874e45bd3bbd0a8f8e011f P 902a55ae488c4b06803c5dc8b0968256 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "902a55ae488c4b06803c5dc8b0968256" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38975 } }
I20260619 18:44:59.283708 9751 raft_consensus.cc:388] T df0c304807874e45bd3bbd0a8f8e011f P 902a55ae488c4b06803c5dc8b0968256 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:59.283942 9751 raft_consensus.cc:482] T df0c304807874e45bd3bbd0a8f8e011f P 902a55ae488c4b06803c5dc8b0968256 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:59.284225 9751 raft_consensus.cc:3037] T df0c304807874e45bd3bbd0a8f8e011f P 902a55ae488c4b06803c5dc8b0968256 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:59.289685 9751 raft_consensus.cc:504] T df0c304807874e45bd3bbd0a8f8e011f P 902a55ae488c4b06803c5dc8b0968256 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "902a55ae488c4b06803c5dc8b0968256" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38975 } }
I20260619 18:44:59.290354 9751 leader_election.cc:302] T df0c304807874e45bd3bbd0a8f8e011f P 902a55ae488c4b06803c5dc8b0968256 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 902a55ae488c4b06803c5dc8b0968256; no voters:
I20260619 18:44:59.290881 9751 leader_election.cc:288] T df0c304807874e45bd3bbd0a8f8e011f P 902a55ae488c4b06803c5dc8b0968256 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:59.291034 9753 raft_consensus.cc:2781] T df0c304807874e45bd3bbd0a8f8e011f P 902a55ae488c4b06803c5dc8b0968256 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:59.291493 9753 raft_consensus.cc:686] T df0c304807874e45bd3bbd0a8f8e011f P 902a55ae488c4b06803c5dc8b0968256 [term 1 LEADER]: Becoming Leader. State: Replica: 902a55ae488c4b06803c5dc8b0968256, State: Running, Role: LEADER
I20260619 18:44:59.292281 9753 consensus_queue.cc:237] T df0c304807874e45bd3bbd0a8f8e011f P 902a55ae488c4b06803c5dc8b0968256 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "902a55ae488c4b06803c5dc8b0968256" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38975 } }
I20260619 18:44:59.292649 9751 ts_tablet_manager.cc:1428] T df0c304807874e45bd3bbd0a8f8e011f P 902a55ae488c4b06803c5dc8b0968256: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20260619 18:44:59.299310 9595 catalog_manager.cc:5495] T df0c304807874e45bd3bbd0a8f8e011f P 902a55ae488c4b06803c5dc8b0968256 reported cstate change: term changed from 0 to 1, leader changed from <none> to 902a55ae488c4b06803c5dc8b0968256 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "902a55ae488c4b06803c5dc8b0968256" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "902a55ae488c4b06803c5dc8b0968256" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38975 } health_report { overall_health: HEALTHY } } }
I20260619 18:44:59.580184 6627 tablet_server.cc:178] TabletServer@127.6.120.193:0 shutting down...
I20260619 18:44:59.608407 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:44:59.609499 6627 tablet_replica.cc:330] T b0117de58d434be28e7d69890d01c93b P 902a55ae488c4b06803c5dc8b0968256: stopping tablet replica
I20260619 18:44:59.610039 6627 raft_consensus.cc:2229] T b0117de58d434be28e7d69890d01c93b P 902a55ae488c4b06803c5dc8b0968256 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:59.610596 6627 raft_consensus.cc:2258] T b0117de58d434be28e7d69890d01c93b P 902a55ae488c4b06803c5dc8b0968256 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:59.612689 6627 tablet_replica.cc:330] T df0c304807874e45bd3bbd0a8f8e011f P 902a55ae488c4b06803c5dc8b0968256: stopping tablet replica
I20260619 18:44:59.613174 6627 raft_consensus.cc:2229] T df0c304807874e45bd3bbd0a8f8e011f P 902a55ae488c4b06803c5dc8b0968256 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:59.613572 6627 raft_consensus.cc:2258] T df0c304807874e45bd3bbd0a8f8e011f P 902a55ae488c4b06803c5dc8b0968256 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:59.615845 6627 tablet_replica.cc:330] T 58fb54d34a94436da1105ba8dc7e406b P 902a55ae488c4b06803c5dc8b0968256: stopping tablet replica
I20260619 18:44:59.616349 6627 raft_consensus.cc:2229] T 58fb54d34a94436da1105ba8dc7e406b P 902a55ae488c4b06803c5dc8b0968256 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:59.616725 6627 raft_consensus.cc:2258] T 58fb54d34a94436da1105ba8dc7e406b P 902a55ae488c4b06803c5dc8b0968256 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:59.637842 6627 tablet_server.cc:194] TabletServer@127.6.120.193:0 shutdown complete.
I20260619 18:44:59.652696 6627 master.cc:537] Master@127.6.120.254:33785 shutting down...
I20260619 18:44:59.674901 6627 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 7227385ad01c44c39eee596a882f8a34 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:44:59.675397 6627 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 7227385ad01c44c39eee596a882f8a34 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:44:59.675705 6627 tablet_replica.cc:330] T 00000000000000000000000000000000 P 7227385ad01c44c39eee596a882f8a34: stopping tablet replica
I20260619 18:44:59.694355 6627 master.cc:552] Master@127.6.120.254:33785 shutdown complete.
[ OK ] ClientTest.TestInsertEmptyPK (1106 ms)
[ RUN ] ClientTest.TestClonePredicates
I20260619 18:44:59.714972 6627 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.120.254:44207
I20260619 18:44:59.715945 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:59.721114 9768 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:59.721419 9769 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:59.724886 6627 server_base.cc:1034] running on GCE node
W20260619 18:44:59.725279 9771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:59.726217 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:59.726459 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:59.726627 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894699726614 us; error 0 us; skew 500 ppm
I20260619 18:44:59.727279 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:59.730170 6627 webserver.cc:460] Webserver started at http://127.6.120.254:36493/ using document root <none> and password file <none>
I20260619 18:44:59.730762 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:59.730988 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:59.731290 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:59.732720 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestClonePredicates.1781894682485826-6627-0/minicluster-data/master-0-root/instance:
uuid: "4ba8e9c848a84e7481e6bbfb79809564"
format_stamp: "Formatted at 2026-06-19 18:44:59 on dist-test-slave-90mn"
I20260619 18:44:59.738510 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260619 18:44:59.742723 9776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:59.743620 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260619 18:44:59.743953 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestClonePredicates.1781894682485826-6627-0/minicluster-data/master-0-root
uuid: "4ba8e9c848a84e7481e6bbfb79809564"
format_stamp: "Formatted at 2026-06-19 18:44:59 on dist-test-slave-90mn"
I20260619 18:44:59.744341 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestClonePredicates.1781894682485826-6627-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestClonePredicates.1781894682485826-6627-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestClonePredicates.1781894682485826-6627-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:44:59.770699 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:44:59.772017 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:44:59.823220 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.254:44207
I20260619 18:44:59.823292 9837 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.254:44207 every 8 connection(s)
I20260619 18:44:59.827847 9838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:44:59.837988 9838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ba8e9c848a84e7481e6bbfb79809564: Bootstrap starting.
I20260619 18:44:59.841909 9838 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ba8e9c848a84e7481e6bbfb79809564: Neither blocks nor log segments found. Creating new log.
I20260619 18:44:59.845885 9838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ba8e9c848a84e7481e6bbfb79809564: No bootstrap required, opened a new log
I20260619 18:44:59.847775 9838 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ba8e9c848a84e7481e6bbfb79809564 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ba8e9c848a84e7481e6bbfb79809564" member_type: VOTER }
I20260619 18:44:59.848248 9838 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ba8e9c848a84e7481e6bbfb79809564 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:44:59.848480 9838 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ba8e9c848a84e7481e6bbfb79809564 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ba8e9c848a84e7481e6bbfb79809564, State: Initialized, Role: FOLLOWER
I20260619 18:44:59.849025 9838 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ba8e9c848a84e7481e6bbfb79809564 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ba8e9c848a84e7481e6bbfb79809564" member_type: VOTER }
I20260619 18:44:59.849472 9838 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ba8e9c848a84e7481e6bbfb79809564 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:44:59.849714 9838 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ba8e9c848a84e7481e6bbfb79809564 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:44:59.849965 9838 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ba8e9c848a84e7481e6bbfb79809564 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:44:59.854465 9838 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ba8e9c848a84e7481e6bbfb79809564 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ba8e9c848a84e7481e6bbfb79809564" member_type: VOTER }
I20260619 18:44:59.855043 9838 leader_election.cc:302] T 00000000000000000000000000000000 P 4ba8e9c848a84e7481e6bbfb79809564 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ba8e9c848a84e7481e6bbfb79809564; no voters:
I20260619 18:44:59.856745 9838 leader_election.cc:288] T 00000000000000000000000000000000 P 4ba8e9c848a84e7481e6bbfb79809564 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:44:59.857074 9841 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ba8e9c848a84e7481e6bbfb79809564 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:44:59.860594 9838 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ba8e9c848a84e7481e6bbfb79809564 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 18:44:59.864974 9841 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ba8e9c848a84e7481e6bbfb79809564 [term 1 LEADER]: Becoming Leader. State: Replica: 4ba8e9c848a84e7481e6bbfb79809564, State: Running, Role: LEADER
I20260619 18:44:59.865919 9841 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ba8e9c848a84e7481e6bbfb79809564 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ba8e9c848a84e7481e6bbfb79809564" member_type: VOTER }
I20260619 18:44:59.869063 9843 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ba8e9c848a84e7481e6bbfb79809564 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ba8e9c848a84e7481e6bbfb79809564. Latest consensus state: current_term: 1 leader_uuid: "4ba8e9c848a84e7481e6bbfb79809564" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ba8e9c848a84e7481e6bbfb79809564" member_type: VOTER } }
I20260619 18:44:59.869624 9843 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ba8e9c848a84e7481e6bbfb79809564 [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:59.869803 9842 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ba8e9c848a84e7481e6bbfb79809564 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ba8e9c848a84e7481e6bbfb79809564" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ba8e9c848a84e7481e6bbfb79809564" member_type: VOTER } }
I20260619 18:44:59.870324 9842 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ba8e9c848a84e7481e6bbfb79809564 [sys.catalog]: This master's current role is: LEADER
I20260619 18:44:59.879717 9850 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 18:44:59.887163 9850 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 18:44:59.888262 6627 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260619 18:44:59.895987 9850 catalog_manager.cc:1347] Generated new cluster ID: 6825623631e34da58e6d49db153954c3
I20260619 18:44:59.896315 9850 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 18:44:59.910923 9850 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 18:44:59.912525 9850 catalog_manager.cc:1504] Loading token signing keys...
I20260619 18:44:59.924360 9850 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ba8e9c848a84e7481e6bbfb79809564: Generated new TSK 0
I20260619 18:44:59.925056 9850 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 18:44:59.955459 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:44:59.962476 9859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:59.962800 9860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:44:59.966316 9862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:44:59.966758 6627 server_base.cc:1034] running on GCE node
I20260619 18:44:59.967593 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:44:59.967793 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:44:59.968250 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894699968228 us; error 0 us; skew 500 ppm
I20260619 18:44:59.968853 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:44:59.972067 6627 webserver.cc:460] Webserver started at http://127.6.120.193:33899/ using document root <none> and password file <none>
I20260619 18:44:59.972616 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:44:59.972816 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:44:59.973096 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:44:59.974145 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestClonePredicates.1781894682485826-6627-0/minicluster-data/ts-0-root/instance:
uuid: "3a62ba20ef584591ac067eb808776fcf"
format_stamp: "Formatted at 2026-06-19 18:44:59 on dist-test-slave-90mn"
I20260619 18:44:59.978760 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260619 18:44:59.982148 9867 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:44:59.983013 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260619 18:44:59.983350 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestClonePredicates.1781894682485826-6627-0/minicluster-data/ts-0-root
uuid: "3a62ba20ef584591ac067eb808776fcf"
format_stamp: "Formatted at 2026-06-19 18:44:59 on dist-test-slave-90mn"
I20260619 18:44:59.983701 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestClonePredicates.1781894682485826-6627-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestClonePredicates.1781894682485826-6627-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestClonePredicates.1781894682485826-6627-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:45:00.000268 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:45:00.001600 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:45:00.014804 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:45:00.015138 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 18:45:00.015434 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:45:00.015631 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:45:00.091149 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.193:37347
I20260619 18:45:00.091249 9937 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.193:37347 every 8 connection(s)
I20260619 18:45:00.096982 9938 heartbeater.cc:347] Connected to a master server at 127.6.120.254:44207
I20260619 18:45:00.097396 9938 heartbeater.cc:464] Registering TS with master...
I20260619 18:45:00.098222 9938 heartbeater.cc:511] Master 127.6.120.254:44207 requested a full tablet report, sending...
I20260619 18:45:00.100361 9793 ts_manager.cc:194] Registered new tserver with Master: 3a62ba20ef584591ac067eb808776fcf (127.6.120.193:37347)
I20260619 18:45:00.101272 6627 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.005990588s
I20260619 18:45:00.102463 9793 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53386
I20260619 18:45:00.115697 9938 heartbeater.cc:503] Master 127.6.120.254:44207 was elected leader, sending a full tablet report...
I20260619 18:45:00.128758 9793 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53410:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 18:45:00.168054 9903 tablet_service.cc:1467] Processing CreateTablet for tablet 7a3b4871f70f47a288b37669a5695f3e (DEFAULT_TABLE table=client-testtb [id=671b49d6937a4960a55564faf092c0af]), partition=RANGE (key) PARTITION VALUES < 9
I20260619 18:45:00.168526 9902 tablet_service.cc:1467] Processing CreateTablet for tablet 57aa6258901042848f5ca555aba3653a (DEFAULT_TABLE table=client-testtb [id=671b49d6937a4960a55564faf092c0af]), partition=RANGE (key) PARTITION 9 <= VALUES
I20260619 18:45:00.169574 9903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a3b4871f70f47a288b37669a5695f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:45:00.170267 9902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 57aa6258901042848f5ca555aba3653a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:45:00.185290 9948 tablet_bootstrap.cc:492] T 7a3b4871f70f47a288b37669a5695f3e P 3a62ba20ef584591ac067eb808776fcf: Bootstrap starting.
I20260619 18:45:00.189451 9948 tablet_bootstrap.cc:654] T 7a3b4871f70f47a288b37669a5695f3e P 3a62ba20ef584591ac067eb808776fcf: Neither blocks nor log segments found. Creating new log.
I20260619 18:45:00.194150 9948 tablet_bootstrap.cc:492] T 7a3b4871f70f47a288b37669a5695f3e P 3a62ba20ef584591ac067eb808776fcf: No bootstrap required, opened a new log
I20260619 18:45:00.194538 9948 ts_tablet_manager.cc:1397] T 7a3b4871f70f47a288b37669a5695f3e P 3a62ba20ef584591ac067eb808776fcf: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.005s
I20260619 18:45:00.196303 9948 raft_consensus.cc:348] T 7a3b4871f70f47a288b37669a5695f3e P 3a62ba20ef584591ac067eb808776fcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a62ba20ef584591ac067eb808776fcf" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37347 } }
I20260619 18:45:00.196727 9948 raft_consensus.cc:374] T 7a3b4871f70f47a288b37669a5695f3e P 3a62ba20ef584591ac067eb808776fcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:45:00.197027 9948 raft_consensus.cc:729] T 7a3b4871f70f47a288b37669a5695f3e P 3a62ba20ef584591ac067eb808776fcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a62ba20ef584591ac067eb808776fcf, State: Initialized, Role: FOLLOWER
I20260619 18:45:00.197587 9948 consensus_queue.cc:260] T 7a3b4871f70f47a288b37669a5695f3e P 3a62ba20ef584591ac067eb808776fcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a62ba20ef584591ac067eb808776fcf" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37347 } }
I20260619 18:45:00.198185 9948 raft_consensus.cc:388] T 7a3b4871f70f47a288b37669a5695f3e P 3a62ba20ef584591ac067eb808776fcf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:45:00.198477 9948 raft_consensus.cc:482] T 7a3b4871f70f47a288b37669a5695f3e P 3a62ba20ef584591ac067eb808776fcf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:45:00.198805 9948 raft_consensus.cc:3037] T 7a3b4871f70f47a288b37669a5695f3e P 3a62ba20ef584591ac067eb808776fcf [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:45:00.203411 9948 raft_consensus.cc:504] T 7a3b4871f70f47a288b37669a5695f3e P 3a62ba20ef584591ac067eb808776fcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a62ba20ef584591ac067eb808776fcf" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37347 } }
I20260619 18:45:00.204155 9948 leader_election.cc:302] T 7a3b4871f70f47a288b37669a5695f3e P 3a62ba20ef584591ac067eb808776fcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a62ba20ef584591ac067eb808776fcf; no voters:
I20260619 18:45:00.205700 9948 leader_election.cc:288] T 7a3b4871f70f47a288b37669a5695f3e P 3a62ba20ef584591ac067eb808776fcf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:45:00.206058 9950 raft_consensus.cc:2781] T 7a3b4871f70f47a288b37669a5695f3e P 3a62ba20ef584591ac067eb808776fcf [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:45:00.212086 9948 ts_tablet_manager.cc:1428] T 7a3b4871f70f47a288b37669a5695f3e P 3a62ba20ef584591ac067eb808776fcf: Time spent starting tablet: real 0.017s user 0.016s sys 0.002s
I20260619 18:45:00.212924 9948 tablet_bootstrap.cc:492] T 57aa6258901042848f5ca555aba3653a P 3a62ba20ef584591ac067eb808776fcf: Bootstrap starting.
I20260619 18:45:00.214645 9950 raft_consensus.cc:686] T 7a3b4871f70f47a288b37669a5695f3e P 3a62ba20ef584591ac067eb808776fcf [term 1 LEADER]: Becoming Leader. State: Replica: 3a62ba20ef584591ac067eb808776fcf, State: Running, Role: LEADER
I20260619 18:45:00.215467 9950 consensus_queue.cc:237] T 7a3b4871f70f47a288b37669a5695f3e P 3a62ba20ef584591ac067eb808776fcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a62ba20ef584591ac067eb808776fcf" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37347 } }
I20260619 18:45:00.217187 9948 tablet_bootstrap.cc:654] T 57aa6258901042848f5ca555aba3653a P 3a62ba20ef584591ac067eb808776fcf: Neither blocks nor log segments found. Creating new log.
I20260619 18:45:00.222180 9793 catalog_manager.cc:5495] T 7a3b4871f70f47a288b37669a5695f3e P 3a62ba20ef584591ac067eb808776fcf reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a62ba20ef584591ac067eb808776fcf (127.6.120.193). New cstate: current_term: 1 leader_uuid: "3a62ba20ef584591ac067eb808776fcf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a62ba20ef584591ac067eb808776fcf" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37347 } health_report { overall_health: HEALTHY } } }
I20260619 18:45:00.229895 9948 tablet_bootstrap.cc:492] T 57aa6258901042848f5ca555aba3653a P 3a62ba20ef584591ac067eb808776fcf: No bootstrap required, opened a new log
I20260619 18:45:00.230310 9948 ts_tablet_manager.cc:1397] T 57aa6258901042848f5ca555aba3653a P 3a62ba20ef584591ac067eb808776fcf: Time spent bootstrapping tablet: real 0.018s user 0.010s sys 0.004s
I20260619 18:45:00.233389 9948 raft_consensus.cc:348] T 57aa6258901042848f5ca555aba3653a P 3a62ba20ef584591ac067eb808776fcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a62ba20ef584591ac067eb808776fcf" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37347 } }
I20260619 18:45:00.233989 9948 raft_consensus.cc:374] T 57aa6258901042848f5ca555aba3653a P 3a62ba20ef584591ac067eb808776fcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:45:00.234187 9948 raft_consensus.cc:729] T 57aa6258901042848f5ca555aba3653a P 3a62ba20ef584591ac067eb808776fcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a62ba20ef584591ac067eb808776fcf, State: Initialized, Role: FOLLOWER
I20260619 18:45:00.234752 9948 consensus_queue.cc:260] T 57aa6258901042848f5ca555aba3653a P 3a62ba20ef584591ac067eb808776fcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a62ba20ef584591ac067eb808776fcf" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37347 } }
I20260619 18:45:00.235278 9948 raft_consensus.cc:388] T 57aa6258901042848f5ca555aba3653a P 3a62ba20ef584591ac067eb808776fcf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:45:00.235463 9948 raft_consensus.cc:482] T 57aa6258901042848f5ca555aba3653a P 3a62ba20ef584591ac067eb808776fcf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:45:00.235668 9948 raft_consensus.cc:3037] T 57aa6258901042848f5ca555aba3653a P 3a62ba20ef584591ac067eb808776fcf [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:45:00.240797 9948 raft_consensus.cc:504] T 57aa6258901042848f5ca555aba3653a P 3a62ba20ef584591ac067eb808776fcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a62ba20ef584591ac067eb808776fcf" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37347 } }
I20260619 18:45:00.241371 9948 leader_election.cc:302] T 57aa6258901042848f5ca555aba3653a P 3a62ba20ef584591ac067eb808776fcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a62ba20ef584591ac067eb808776fcf; no voters:
I20260619 18:45:00.241905 9948 leader_election.cc:288] T 57aa6258901042848f5ca555aba3653a P 3a62ba20ef584591ac067eb808776fcf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:45:00.242115 9952 raft_consensus.cc:2781] T 57aa6258901042848f5ca555aba3653a P 3a62ba20ef584591ac067eb808776fcf [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:45:00.242617 9952 raft_consensus.cc:686] T 57aa6258901042848f5ca555aba3653a P 3a62ba20ef584591ac067eb808776fcf [term 1 LEADER]: Becoming Leader. State: Replica: 3a62ba20ef584591ac067eb808776fcf, State: Running, Role: LEADER
I20260619 18:45:00.243561 9948 ts_tablet_manager.cc:1428] T 57aa6258901042848f5ca555aba3653a P 3a62ba20ef584591ac067eb808776fcf: Time spent starting tablet: real 0.013s user 0.006s sys 0.005s
I20260619 18:45:00.243247 9952 consensus_queue.cc:237] T 57aa6258901042848f5ca555aba3653a P 3a62ba20ef584591ac067eb808776fcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a62ba20ef584591ac067eb808776fcf" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37347 } }
I20260619 18:45:00.249249 9792 catalog_manager.cc:5495] T 57aa6258901042848f5ca555aba3653a P 3a62ba20ef584591ac067eb808776fcf reported cstate change: term changed from 0 to 1, leader changed from <none> to 3a62ba20ef584591ac067eb808776fcf (127.6.120.193). New cstate: current_term: 1 leader_uuid: "3a62ba20ef584591ac067eb808776fcf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a62ba20ef584591ac067eb808776fcf" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37347 } health_report { overall_health: HEALTHY } } }
I20260619 18:45:00.326721 6627 tablet_server.cc:178] TabletServer@127.6.120.193:0 shutting down...
I20260619 18:45:00.355226 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:45:00.355981 6627 tablet_replica.cc:330] T 57aa6258901042848f5ca555aba3653a P 3a62ba20ef584591ac067eb808776fcf: stopping tablet replica
I20260619 18:45:00.356618 6627 raft_consensus.cc:2229] T 57aa6258901042848f5ca555aba3653a P 3a62ba20ef584591ac067eb808776fcf [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:45:00.357023 6627 raft_consensus.cc:2258] T 57aa6258901042848f5ca555aba3653a P 3a62ba20ef584591ac067eb808776fcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:45:00.359378 6627 tablet_replica.cc:330] T 7a3b4871f70f47a288b37669a5695f3e P 3a62ba20ef584591ac067eb808776fcf: stopping tablet replica
I20260619 18:45:00.359839 6627 raft_consensus.cc:2229] T 7a3b4871f70f47a288b37669a5695f3e P 3a62ba20ef584591ac067eb808776fcf [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:45:00.360285 6627 raft_consensus.cc:2258] T 7a3b4871f70f47a288b37669a5695f3e P 3a62ba20ef584591ac067eb808776fcf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:45:00.373889 6627 tablet_server.cc:194] TabletServer@127.6.120.193:0 shutdown complete.
I20260619 18:45:00.384941 6627 master.cc:537] Master@127.6.120.254:44207 shutting down...
I20260619 18:45:00.408741 6627 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 4ba8e9c848a84e7481e6bbfb79809564 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:45:00.409281 6627 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 4ba8e9c848a84e7481e6bbfb79809564 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:45:00.409683 6627 tablet_replica.cc:330] T 00000000000000000000000000000000 P 4ba8e9c848a84e7481e6bbfb79809564: stopping tablet replica
I20260619 18:45:00.419008 6627 master.cc:552] Master@127.6.120.254:44207 shutdown complete.
[ OK ] ClientTest.TestClonePredicates (731 ms)
[ RUN ] ClientTest.TestErrorCollector
I20260619 18:45:00.448505 6627 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.120.254:36323
I20260619 18:45:00.449913 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:45:00.455860 9959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:45:00.456063 9960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:45:00.459259 9962 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:45:00.460446 6627 server_base.cc:1034] running on GCE node
I20260619 18:45:00.461248 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:45:00.461442 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:45:00.461606 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894700461592 us; error 0 us; skew 500 ppm
I20260619 18:45:00.462100 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:45:00.465143 6627 webserver.cc:460] Webserver started at http://127.6.120.254:35905/ using document root <none> and password file <none>
I20260619 18:45:00.465600 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:45:00.465794 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:45:00.466053 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:45:00.467116 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestErrorCollector.1781894682485826-6627-0/minicluster-data/master-0-root/instance:
uuid: "92b4bcac2f7946a4a6ac1a81b3b587c1"
format_stamp: "Formatted at 2026-06-19 18:45:00 on dist-test-slave-90mn"
I20260619 18:45:00.471653 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260619 18:45:00.475060 9967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:45:00.475919 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260619 18:45:00.476351 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestErrorCollector.1781894682485826-6627-0/minicluster-data/master-0-root
uuid: "92b4bcac2f7946a4a6ac1a81b3b587c1"
format_stamp: "Formatted at 2026-06-19 18:45:00 on dist-test-slave-90mn"
I20260619 18:45:00.476689 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestErrorCollector.1781894682485826-6627-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestErrorCollector.1781894682485826-6627-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestErrorCollector.1781894682485826-6627-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:45:00.499187 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:45:00.500485 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:45:00.551077 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.254:36323
I20260619 18:45:00.551131 10028 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.254:36323 every 8 connection(s)
I20260619 18:45:00.555686 10029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:45:00.565764 10029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92b4bcac2f7946a4a6ac1a81b3b587c1: Bootstrap starting.
I20260619 18:45:00.569892 10029 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 92b4bcac2f7946a4a6ac1a81b3b587c1: Neither blocks nor log segments found. Creating new log.
I20260619 18:45:00.574288 10029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92b4bcac2f7946a4a6ac1a81b3b587c1: No bootstrap required, opened a new log
I20260619 18:45:00.576735 10029 raft_consensus.cc:348] T 00000000000000000000000000000000 P 92b4bcac2f7946a4a6ac1a81b3b587c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92b4bcac2f7946a4a6ac1a81b3b587c1" member_type: VOTER }
I20260619 18:45:00.577306 10029 raft_consensus.cc:374] T 00000000000000000000000000000000 P 92b4bcac2f7946a4a6ac1a81b3b587c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:45:00.577611 10029 raft_consensus.cc:729] T 00000000000000000000000000000000 P 92b4bcac2f7946a4a6ac1a81b3b587c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92b4bcac2f7946a4a6ac1a81b3b587c1, State: Initialized, Role: FOLLOWER
I20260619 18:45:00.578289 10029 consensus_queue.cc:260] T 00000000000000000000000000000000 P 92b4bcac2f7946a4a6ac1a81b3b587c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92b4bcac2f7946a4a6ac1a81b3b587c1" member_type: VOTER }
I20260619 18:45:00.578860 10029 raft_consensus.cc:388] T 00000000000000000000000000000000 P 92b4bcac2f7946a4a6ac1a81b3b587c1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:45:00.579190 10029 raft_consensus.cc:482] T 00000000000000000000000000000000 P 92b4bcac2f7946a4a6ac1a81b3b587c1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:45:00.579496 10029 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 92b4bcac2f7946a4a6ac1a81b3b587c1 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:45:00.584781 10029 raft_consensus.cc:504] T 00000000000000000000000000000000 P 92b4bcac2f7946a4a6ac1a81b3b587c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92b4bcac2f7946a4a6ac1a81b3b587c1" member_type: VOTER }
I20260619 18:45:00.585321 10029 leader_election.cc:302] T 00000000000000000000000000000000 P 92b4bcac2f7946a4a6ac1a81b3b587c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 92b4bcac2f7946a4a6ac1a81b3b587c1; no voters:
I20260619 18:45:00.586711 10029 leader_election.cc:288] T 00000000000000000000000000000000 P 92b4bcac2f7946a4a6ac1a81b3b587c1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:45:00.587025 10032 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 92b4bcac2f7946a4a6ac1a81b3b587c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:45:00.588631 10032 raft_consensus.cc:686] T 00000000000000000000000000000000 P 92b4bcac2f7946a4a6ac1a81b3b587c1 [term 1 LEADER]: Becoming Leader. State: Replica: 92b4bcac2f7946a4a6ac1a81b3b587c1, State: Running, Role: LEADER
I20260619 18:45:00.589324 10032 consensus_queue.cc:237] T 00000000000000000000000000000000 P 92b4bcac2f7946a4a6ac1a81b3b587c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92b4bcac2f7946a4a6ac1a81b3b587c1" member_type: VOTER }
I20260619 18:45:00.591131 10029 sys_catalog.cc:564] T 00000000000000000000000000000000 P 92b4bcac2f7946a4a6ac1a81b3b587c1 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 18:45:00.592192 10034 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92b4bcac2f7946a4a6ac1a81b3b587c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "92b4bcac2f7946a4a6ac1a81b3b587c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92b4bcac2f7946a4a6ac1a81b3b587c1" member_type: VOTER } }
I20260619 18:45:00.592777 10034 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92b4bcac2f7946a4a6ac1a81b3b587c1 [sys.catalog]: This master's current role is: LEADER
I20260619 18:45:00.597703 10033 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92b4bcac2f7946a4a6ac1a81b3b587c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 92b4bcac2f7946a4a6ac1a81b3b587c1. Latest consensus state: current_term: 1 leader_uuid: "92b4bcac2f7946a4a6ac1a81b3b587c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92b4bcac2f7946a4a6ac1a81b3b587c1" member_type: VOTER } }
I20260619 18:45:00.598325 10033 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92b4bcac2f7946a4a6ac1a81b3b587c1 [sys.catalog]: This master's current role is: LEADER
I20260619 18:45:00.601246 10036 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 18:45:00.606550 10036 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 18:45:00.609249 6627 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260619 18:45:00.616168 10036 catalog_manager.cc:1347] Generated new cluster ID: 154d815898324b3c839ca292ba6ecb9c
I20260619 18:45:00.616477 10036 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 18:45:00.645815 10036 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 18:45:00.648036 10036 catalog_manager.cc:1504] Loading token signing keys...
I20260619 18:45:00.665824 10036 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 92b4bcac2f7946a4a6ac1a81b3b587c1: Generated new TSK 0
I20260619 18:45:00.666589 10036 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 18:45:00.675396 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:45:00.681595 10050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:45:00.683956 10051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:45:00.684809 10053 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:45:00.685348 6627 server_base.cc:1034] running on GCE node
I20260619 18:45:00.686286 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:45:00.686539 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:45:00.686717 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894700686705 us; error 0 us; skew 500 ppm
I20260619 18:45:00.687353 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:45:00.694766 6627 webserver.cc:460] Webserver started at http://127.6.120.193:42497/ using document root <none> and password file <none>
I20260619 18:45:00.695279 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:45:00.695483 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:45:00.695744 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:45:00.696846 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestErrorCollector.1781894682485826-6627-0/minicluster-data/ts-0-root/instance:
uuid: "c98a696ea66e4c229132af69129ab70d"
format_stamp: "Formatted at 2026-06-19 18:45:00 on dist-test-slave-90mn"
I20260619 18:45:00.701745 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260619 18:45:00.705185 10058 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:45:00.706065 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260619 18:45:00.706414 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestErrorCollector.1781894682485826-6627-0/minicluster-data/ts-0-root
uuid: "c98a696ea66e4c229132af69129ab70d"
format_stamp: "Formatted at 2026-06-19 18:45:00 on dist-test-slave-90mn"
I20260619 18:45:00.706768 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestErrorCollector.1781894682485826-6627-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestErrorCollector.1781894682485826-6627-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestErrorCollector.1781894682485826-6627-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:45:00.739410 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:45:00.740700 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:45:00.752537 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:45:00.752822 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 18:45:00.753100 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:45:00.753293 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:45:00.831449 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.193:45243
I20260619 18:45:00.831526 10128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.193:45243 every 8 connection(s)
I20260619 18:45:00.837337 10129 heartbeater.cc:347] Connected to a master server at 127.6.120.254:36323
I20260619 18:45:00.837814 10129 heartbeater.cc:464] Registering TS with master...
I20260619 18:45:00.838495 10129 heartbeater.cc:511] Master 127.6.120.254:36323 requested a full tablet report, sending...
I20260619 18:45:00.840317 9984 ts_manager.cc:194] Registered new tserver with Master: c98a696ea66e4c229132af69129ab70d (127.6.120.193:45243)
I20260619 18:45:00.840457 6627 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.00498227s
I20260619 18:45:00.842208 9984 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44404
I20260619 18:45:00.855319 10129 heartbeater.cc:503] Master 127.6.120.254:36323 was elected leader, sending a full tablet report...
I20260619 18:45:00.867293 9984 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44414:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 18:45:00.903728 10094 tablet_service.cc:1467] Processing CreateTablet for tablet 1a36a9d4d6014005b5dd2b1d4b6395a4 (DEFAULT_TABLE table=client-testtb [id=8fe0be3f445b4172a9d097d5ce5b42ca]), partition=RANGE (key) PARTITION VALUES < 9
I20260619 18:45:00.903972 10093 tablet_service.cc:1467] Processing CreateTablet for tablet e339a38c3f4a4c85a79a1396d0b41145 (DEFAULT_TABLE table=client-testtb [id=8fe0be3f445b4172a9d097d5ce5b42ca]), partition=RANGE (key) PARTITION 9 <= VALUES
I20260619 18:45:00.905061 10094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a36a9d4d6014005b5dd2b1d4b6395a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:45:00.905634 10093 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e339a38c3f4a4c85a79a1396d0b41145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:45:00.920387 10139 tablet_bootstrap.cc:492] T 1a36a9d4d6014005b5dd2b1d4b6395a4 P c98a696ea66e4c229132af69129ab70d: Bootstrap starting.
I20260619 18:45:00.925388 10139 tablet_bootstrap.cc:654] T 1a36a9d4d6014005b5dd2b1d4b6395a4 P c98a696ea66e4c229132af69129ab70d: Neither blocks nor log segments found. Creating new log.
I20260619 18:45:00.930011 10139 tablet_bootstrap.cc:492] T 1a36a9d4d6014005b5dd2b1d4b6395a4 P c98a696ea66e4c229132af69129ab70d: No bootstrap required, opened a new log
I20260619 18:45:00.930415 10139 ts_tablet_manager.cc:1397] T 1a36a9d4d6014005b5dd2b1d4b6395a4 P c98a696ea66e4c229132af69129ab70d: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260619 18:45:00.932248 10139 raft_consensus.cc:348] T 1a36a9d4d6014005b5dd2b1d4b6395a4 P c98a696ea66e4c229132af69129ab70d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c98a696ea66e4c229132af69129ab70d" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45243 } }
I20260619 18:45:00.932700 10139 raft_consensus.cc:374] T 1a36a9d4d6014005b5dd2b1d4b6395a4 P c98a696ea66e4c229132af69129ab70d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:45:00.932929 10139 raft_consensus.cc:729] T 1a36a9d4d6014005b5dd2b1d4b6395a4 P c98a696ea66e4c229132af69129ab70d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98a696ea66e4c229132af69129ab70d, State: Initialized, Role: FOLLOWER
I20260619 18:45:00.933404 10139 consensus_queue.cc:260] T 1a36a9d4d6014005b5dd2b1d4b6395a4 P c98a696ea66e4c229132af69129ab70d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c98a696ea66e4c229132af69129ab70d" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45243 } }
I20260619 18:45:00.933861 10139 raft_consensus.cc:388] T 1a36a9d4d6014005b5dd2b1d4b6395a4 P c98a696ea66e4c229132af69129ab70d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:45:00.934083 10139 raft_consensus.cc:482] T 1a36a9d4d6014005b5dd2b1d4b6395a4 P c98a696ea66e4c229132af69129ab70d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:45:00.934330 10139 raft_consensus.cc:3037] T 1a36a9d4d6014005b5dd2b1d4b6395a4 P c98a696ea66e4c229132af69129ab70d [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:45:00.939720 10139 raft_consensus.cc:504] T 1a36a9d4d6014005b5dd2b1d4b6395a4 P c98a696ea66e4c229132af69129ab70d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c98a696ea66e4c229132af69129ab70d" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45243 } }
I20260619 18:45:00.940442 10139 leader_election.cc:302] T 1a36a9d4d6014005b5dd2b1d4b6395a4 P c98a696ea66e4c229132af69129ab70d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c98a696ea66e4c229132af69129ab70d; no voters:
I20260619 18:45:00.941871 10139 leader_election.cc:288] T 1a36a9d4d6014005b5dd2b1d4b6395a4 P c98a696ea66e4c229132af69129ab70d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:45:00.942194 10141 raft_consensus.cc:2781] T 1a36a9d4d6014005b5dd2b1d4b6395a4 P c98a696ea66e4c229132af69129ab70d [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:45:00.944402 10139 ts_tablet_manager.cc:1428] T 1a36a9d4d6014005b5dd2b1d4b6395a4 P c98a696ea66e4c229132af69129ab70d: Time spent starting tablet: real 0.014s user 0.010s sys 0.006s
I20260619 18:45:00.944590 10141 raft_consensus.cc:686] T 1a36a9d4d6014005b5dd2b1d4b6395a4 P c98a696ea66e4c229132af69129ab70d [term 1 LEADER]: Becoming Leader. State: Replica: c98a696ea66e4c229132af69129ab70d, State: Running, Role: LEADER
I20260619 18:45:00.945309 10139 tablet_bootstrap.cc:492] T e339a38c3f4a4c85a79a1396d0b41145 P c98a696ea66e4c229132af69129ab70d: Bootstrap starting.
I20260619 18:45:00.945292 10141 consensus_queue.cc:237] T 1a36a9d4d6014005b5dd2b1d4b6395a4 P c98a696ea66e4c229132af69129ab70d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c98a696ea66e4c229132af69129ab70d" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45243 } }
I20260619 18:45:00.951314 10139 tablet_bootstrap.cc:654] T e339a38c3f4a4c85a79a1396d0b41145 P c98a696ea66e4c229132af69129ab70d: Neither blocks nor log segments found. Creating new log.
I20260619 18:45:00.953030 9984 catalog_manager.cc:5495] T 1a36a9d4d6014005b5dd2b1d4b6395a4 P c98a696ea66e4c229132af69129ab70d reported cstate change: term changed from 0 to 1, leader changed from <none> to c98a696ea66e4c229132af69129ab70d (127.6.120.193). New cstate: current_term: 1 leader_uuid: "c98a696ea66e4c229132af69129ab70d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c98a696ea66e4c229132af69129ab70d" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45243 } health_report { overall_health: HEALTHY } } }
I20260619 18:45:00.958887 10139 tablet_bootstrap.cc:492] T e339a38c3f4a4c85a79a1396d0b41145 P c98a696ea66e4c229132af69129ab70d: No bootstrap required, opened a new log
I20260619 18:45:00.959286 10139 ts_tablet_manager.cc:1397] T e339a38c3f4a4c85a79a1396d0b41145 P c98a696ea66e4c229132af69129ab70d: Time spent bootstrapping tablet: real 0.014s user 0.010s sys 0.001s
I20260619 18:45:00.961320 10139 raft_consensus.cc:348] T e339a38c3f4a4c85a79a1396d0b41145 P c98a696ea66e4c229132af69129ab70d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c98a696ea66e4c229132af69129ab70d" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45243 } }
I20260619 18:45:00.961869 10139 raft_consensus.cc:374] T e339a38c3f4a4c85a79a1396d0b41145 P c98a696ea66e4c229132af69129ab70d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:45:00.962155 10139 raft_consensus.cc:729] T e339a38c3f4a4c85a79a1396d0b41145 P c98a696ea66e4c229132af69129ab70d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c98a696ea66e4c229132af69129ab70d, State: Initialized, Role: FOLLOWER
I20260619 18:45:00.962738 10139 consensus_queue.cc:260] T e339a38c3f4a4c85a79a1396d0b41145 P c98a696ea66e4c229132af69129ab70d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c98a696ea66e4c229132af69129ab70d" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45243 } }
I20260619 18:45:00.963378 10139 raft_consensus.cc:388] T e339a38c3f4a4c85a79a1396d0b41145 P c98a696ea66e4c229132af69129ab70d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:45:00.963610 10139 raft_consensus.cc:482] T e339a38c3f4a4c85a79a1396d0b41145 P c98a696ea66e4c229132af69129ab70d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:45:00.963871 10139 raft_consensus.cc:3037] T e339a38c3f4a4c85a79a1396d0b41145 P c98a696ea66e4c229132af69129ab70d [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:45:00.969957 10139 raft_consensus.cc:504] T e339a38c3f4a4c85a79a1396d0b41145 P c98a696ea66e4c229132af69129ab70d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c98a696ea66e4c229132af69129ab70d" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45243 } }
I20260619 18:45:00.970569 10139 leader_election.cc:302] T e339a38c3f4a4c85a79a1396d0b41145 P c98a696ea66e4c229132af69129ab70d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c98a696ea66e4c229132af69129ab70d; no voters:
I20260619 18:45:00.971040 10139 leader_election.cc:288] T e339a38c3f4a4c85a79a1396d0b41145 P c98a696ea66e4c229132af69129ab70d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:45:00.971220 10143 raft_consensus.cc:2781] T e339a38c3f4a4c85a79a1396d0b41145 P c98a696ea66e4c229132af69129ab70d [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:45:00.971698 10143 raft_consensus.cc:686] T e339a38c3f4a4c85a79a1396d0b41145 P c98a696ea66e4c229132af69129ab70d [term 1 LEADER]: Becoming Leader. State: Replica: c98a696ea66e4c229132af69129ab70d, State: Running, Role: LEADER
I20260619 18:45:00.972591 10139 ts_tablet_manager.cc:1428] T e339a38c3f4a4c85a79a1396d0b41145 P c98a696ea66e4c229132af69129ab70d: Time spent starting tablet: real 0.013s user 0.015s sys 0.000s
I20260619 18:45:00.972404 10143 consensus_queue.cc:237] T e339a38c3f4a4c85a79a1396d0b41145 P c98a696ea66e4c229132af69129ab70d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c98a696ea66e4c229132af69129ab70d" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45243 } }
I20260619 18:45:00.979012 9984 catalog_manager.cc:5495] T e339a38c3f4a4c85a79a1396d0b41145 P c98a696ea66e4c229132af69129ab70d reported cstate change: term changed from 0 to 1, leader changed from <none> to c98a696ea66e4c229132af69129ab70d (127.6.120.193). New cstate: current_term: 1 leader_uuid: "c98a696ea66e4c229132af69129ab70d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c98a696ea66e4c229132af69129ab70d" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45243 } health_report { overall_health: HEALTHY } } }
I20260619 18:45:01.036260 6627 tablet_server.cc:178] TabletServer@127.6.120.193:0 shutting down...
I20260619 18:45:01.058501 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:45:01.059355 6627 tablet_replica.cc:330] T e339a38c3f4a4c85a79a1396d0b41145 P c98a696ea66e4c229132af69129ab70d: stopping tablet replica
I20260619 18:45:01.059873 6627 raft_consensus.cc:2229] T e339a38c3f4a4c85a79a1396d0b41145 P c98a696ea66e4c229132af69129ab70d [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:45:01.060338 6627 raft_consensus.cc:2258] T e339a38c3f4a4c85a79a1396d0b41145 P c98a696ea66e4c229132af69129ab70d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:45:01.062564 6627 tablet_replica.cc:330] T 1a36a9d4d6014005b5dd2b1d4b6395a4 P c98a696ea66e4c229132af69129ab70d: stopping tablet replica
I20260619 18:45:01.062991 6627 raft_consensus.cc:2229] T 1a36a9d4d6014005b5dd2b1d4b6395a4 P c98a696ea66e4c229132af69129ab70d [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:45:01.063406 6627 raft_consensus.cc:2258] T 1a36a9d4d6014005b5dd2b1d4b6395a4 P c98a696ea66e4c229132af69129ab70d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:45:01.085235 6627 tablet_server.cc:194] TabletServer@127.6.120.193:0 shutdown complete.
I20260619 18:45:01.096838 6627 master.cc:537] Master@127.6.120.254:36323 shutting down...
I20260619 18:45:01.120622 6627 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 92b4bcac2f7946a4a6ac1a81b3b587c1 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:45:01.121127 6627 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 92b4bcac2f7946a4a6ac1a81b3b587c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:45:01.121565 6627 tablet_replica.cc:330] T 00000000000000000000000000000000 P 92b4bcac2f7946a4a6ac1a81b3b587c1: stopping tablet replica
I20260619 18:45:01.131362 6627 master.cc:552] Master@127.6.120.254:36323 shutdown complete.
[ OK ] ClientTest.TestErrorCollector (711 ms)
[ RUN ] ClientTest.TestBlockScannerHijackingAttempts
I20260619 18:45:01.159937 6627 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.120.254:34339
I20260619 18:45:01.161255 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:45:01.166692 10150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:45:01.168649 10151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:45:01.174574 10153 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:45:01.175271 6627 server_base.cc:1034] running on GCE node
I20260619 18:45:01.176373 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:45:01.176553 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:45:01.176723 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894701176695 us; error 0 us; skew 500 ppm
I20260619 18:45:01.177220 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:45:01.179986 6627 webserver.cc:460] Webserver started at http://127.6.120.254:41737/ using document root <none> and password file <none>
I20260619 18:45:01.180485 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:45:01.180672 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:45:01.180919 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:45:01.181933 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBlockScannerHijackingAttempts.1781894682485826-6627-0/minicluster-data/master-0-root/instance:
uuid: "4ded746f4ad749ba8d5b05447352d7d4"
format_stamp: "Formatted at 2026-06-19 18:45:01 on dist-test-slave-90mn"
I20260619 18:45:01.186393 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260619 18:45:01.189733 10158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:45:01.190601 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260619 18:45:01.190903 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBlockScannerHijackingAttempts.1781894682485826-6627-0/minicluster-data/master-0-root
uuid: "4ded746f4ad749ba8d5b05447352d7d4"
format_stamp: "Formatted at 2026-06-19 18:45:01 on dist-test-slave-90mn"
I20260619 18:45:01.191246 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBlockScannerHijackingAttempts.1781894682485826-6627-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBlockScannerHijackingAttempts.1781894682485826-6627-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBlockScannerHijackingAttempts.1781894682485826-6627-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:45:01.211176 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:45:01.212293 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:45:01.263079 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.254:34339
I20260619 18:45:01.263160 10219 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.254:34339 every 8 connection(s)
I20260619 18:45:01.267282 10220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:45:01.281777 10220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4: Bootstrap starting.
I20260619 18:45:01.287290 10220 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4: Neither blocks nor log segments found. Creating new log.
I20260619 18:45:01.295921 10220 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4: No bootstrap required, opened a new log
I20260619 18:45:01.298615 10220 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ded746f4ad749ba8d5b05447352d7d4" member_type: VOTER }
I20260619 18:45:01.299093 10220 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:45:01.299327 10220 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ded746f4ad749ba8d5b05447352d7d4, State: Initialized, Role: FOLLOWER
I20260619 18:45:01.299908 10220 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ded746f4ad749ba8d5b05447352d7d4" member_type: VOTER }
I20260619 18:45:01.300426 10220 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:45:01.300642 10220 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:45:01.300896 10220 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:45:01.305244 10220 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ded746f4ad749ba8d5b05447352d7d4" member_type: VOTER }
I20260619 18:45:01.305745 10220 leader_election.cc:302] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ded746f4ad749ba8d5b05447352d7d4; no voters:
I20260619 18:45:01.306946 10220 leader_election.cc:288] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:45:01.307303 10223 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:45:01.308851 10223 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [term 1 LEADER]: Becoming Leader. State: Replica: 4ded746f4ad749ba8d5b05447352d7d4, State: Running, Role: LEADER
I20260619 18:45:01.309830 10220 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 18:45:01.309593 10223 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ded746f4ad749ba8d5b05447352d7d4" member_type: VOTER }
I20260619 18:45:01.313290 10224 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4ded746f4ad749ba8d5b05447352d7d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ded746f4ad749ba8d5b05447352d7d4" member_type: VOTER } }
I20260619 18:45:01.313810 10224 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [sys.catalog]: This master's current role is: LEADER
I20260619 18:45:01.323474 10225 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ded746f4ad749ba8d5b05447352d7d4. Latest consensus state: current_term: 1 leader_uuid: "4ded746f4ad749ba8d5b05447352d7d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ded746f4ad749ba8d5b05447352d7d4" member_type: VOTER } }
I20260619 18:45:01.323843 10228 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 18:45:01.324050 10225 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [sys.catalog]: This master's current role is: LEADER
I20260619 18:45:01.331672 10228 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 18:45:01.332718 6627 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260619 18:45:01.340925 10228 catalog_manager.cc:1347] Generated new cluster ID: bc233f2ac651408fb0c199f2cb662f2c
I20260619 18:45:01.341202 10228 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 18:45:01.354673 10228 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 18:45:01.356931 10228 catalog_manager.cc:1504] Loading token signing keys...
I20260619 18:45:01.374575 10228 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4: Generated new TSK 0
I20260619 18:45:01.375371 10228 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 18:45:01.399029 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:45:01.405962 10242 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:45:01.407821 10243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:45:01.410243 10245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:45:01.410502 6627 server_base.cc:1034] running on GCE node
I20260619 18:45:01.411566 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:45:01.411774 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:45:01.411968 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894701411942 us; error 0 us; skew 500 ppm
I20260619 18:45:01.412508 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:45:01.415424 6627 webserver.cc:460] Webserver started at http://127.6.120.193:43281/ using document root <none> and password file <none>
I20260619 18:45:01.415863 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:45:01.416046 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:45:01.416355 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:45:01.417425 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBlockScannerHijackingAttempts.1781894682485826-6627-0/minicluster-data/ts-0-root/instance:
uuid: "b7ad8952358d4c929bee0a1004ef9cb0"
format_stamp: "Formatted at 2026-06-19 18:45:01 on dist-test-slave-90mn"
I20260619 18:45:01.421970 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260619 18:45:01.425560 10250 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:45:01.426638 6627 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260619 18:45:01.426964 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBlockScannerHijackingAttempts.1781894682485826-6627-0/minicluster-data/ts-0-root
uuid: "b7ad8952358d4c929bee0a1004ef9cb0"
format_stamp: "Formatted at 2026-06-19 18:45:01 on dist-test-slave-90mn"
I20260619 18:45:01.427249 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBlockScannerHijackingAttempts.1781894682485826-6627-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBlockScannerHijackingAttempts.1781894682485826-6627-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBlockScannerHijackingAttempts.1781894682485826-6627-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:45:01.440362 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:45:01.441313 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:45:01.453651 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:45:01.454161 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.001s user 0.001s sys 0.000s
I20260619 18:45:01.454615 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:45:01.454917 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:45:01.523577 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.193:44811
I20260619 18:45:01.523722 10320 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.193:44811 every 8 connection(s)
I20260619 18:45:01.528895 10321 heartbeater.cc:347] Connected to a master server at 127.6.120.254:34339
I20260619 18:45:01.529302 10321 heartbeater.cc:464] Registering TS with master...
I20260619 18:45:01.529999 10321 heartbeater.cc:511] Master 127.6.120.254:34339 requested a full tablet report, sending...
I20260619 18:45:01.531991 10175 ts_manager.cc:194] Registered new tserver with Master: b7ad8952358d4c929bee0a1004ef9cb0 (127.6.120.193:44811)
I20260619 18:45:01.532207 6627 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.005090072s
I20260619 18:45:01.534093 10175 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43558
I20260619 18:45:01.547294 10321 heartbeater.cc:503] Master 127.6.120.254:34339 was elected leader, sending a full tablet report...
I20260619 18:45:01.557747 10175 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43574:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 18:45:01.605917 10286 tablet_service.cc:1467] Processing CreateTablet for tablet d5bf9960c044429a8702f09b23b891ff (DEFAULT_TABLE table=client-testtb [id=48dc55f936954a6792019ce9f87036c1]), partition=RANGE (key) PARTITION VALUES < 9
I20260619 18:45:01.607177 10286 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5bf9960c044429a8702f09b23b891ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:45:01.606741 10285 tablet_service.cc:1467] Processing CreateTablet for tablet c610a5f6e83d475090ad74dd8af95d07 (DEFAULT_TABLE table=client-testtb [id=48dc55f936954a6792019ce9f87036c1]), partition=RANGE (key) PARTITION 9 <= VALUES
I20260619 18:45:01.608181 10285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c610a5f6e83d475090ad74dd8af95d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:45:01.623396 10331 tablet_bootstrap.cc:492] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0: Bootstrap starting.
I20260619 18:45:01.629578 10331 tablet_bootstrap.cc:654] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0: Neither blocks nor log segments found. Creating new log.
I20260619 18:45:01.634598 10331 tablet_bootstrap.cc:492] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0: No bootstrap required, opened a new log
I20260619 18:45:01.635044 10331 ts_tablet_manager.cc:1397] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.006s
I20260619 18:45:01.637290 10331 raft_consensus.cc:348] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7ad8952358d4c929bee0a1004ef9cb0" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 44811 } }
I20260619 18:45:01.638019 10331 raft_consensus.cc:374] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:45:01.638372 10331 raft_consensus.cc:729] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ad8952358d4c929bee0a1004ef9cb0, State: Initialized, Role: FOLLOWER
I20260619 18:45:01.639001 10331 consensus_queue.cc:260] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7ad8952358d4c929bee0a1004ef9cb0" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 44811 } }
I20260619 18:45:01.639509 10331 raft_consensus.cc:388] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:45:01.639739 10331 raft_consensus.cc:482] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:45:01.640007 10331 raft_consensus.cc:3037] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:45:01.644804 10331 raft_consensus.cc:504] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7ad8952358d4c929bee0a1004ef9cb0" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 44811 } }
I20260619 18:45:01.645500 10331 leader_election.cc:302] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b7ad8952358d4c929bee0a1004ef9cb0; no voters:
I20260619 18:45:01.647177 10331 leader_election.cc:288] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:45:01.647567 10333 raft_consensus.cc:2781] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:45:01.650701 10331 ts_tablet_manager.cc:1428] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0: Time spent starting tablet: real 0.015s user 0.007s sys 0.009s
I20260619 18:45:01.652674 10331 tablet_bootstrap.cc:492] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0: Bootstrap starting.
I20260619 18:45:01.652750 10333 raft_consensus.cc:686] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0 [term 1 LEADER]: Becoming Leader. State: Replica: b7ad8952358d4c929bee0a1004ef9cb0, State: Running, Role: LEADER
I20260619 18:45:01.653497 10333 consensus_queue.cc:237] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7ad8952358d4c929bee0a1004ef9cb0" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 44811 } }
I20260619 18:45:01.658425 10331 tablet_bootstrap.cc:654] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0: Neither blocks nor log segments found. Creating new log.
I20260619 18:45:01.662717 10174 catalog_manager.cc:5495] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7ad8952358d4c929bee0a1004ef9cb0 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "b7ad8952358d4c929bee0a1004ef9cb0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7ad8952358d4c929bee0a1004ef9cb0" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 44811 } health_report { overall_health: HEALTHY } } }
I20260619 18:45:01.674448 10331 tablet_bootstrap.cc:492] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0: No bootstrap required, opened a new log
I20260619 18:45:01.674937 10331 ts_tablet_manager.cc:1397] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0: Time spent bootstrapping tablet: real 0.022s user 0.013s sys 0.005s
I20260619 18:45:01.677484 10331 raft_consensus.cc:348] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7ad8952358d4c929bee0a1004ef9cb0" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 44811 } }
I20260619 18:45:01.678005 10331 raft_consensus.cc:374] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:45:01.678256 10331 raft_consensus.cc:729] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ad8952358d4c929bee0a1004ef9cb0, State: Initialized, Role: FOLLOWER
I20260619 18:45:01.678841 10331 consensus_queue.cc:260] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7ad8952358d4c929bee0a1004ef9cb0" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 44811 } }
I20260619 18:45:01.679446 10331 raft_consensus.cc:388] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:45:01.679687 10331 raft_consensus.cc:482] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:45:01.679953 10331 raft_consensus.cc:3037] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:45:01.685396 10331 raft_consensus.cc:504] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7ad8952358d4c929bee0a1004ef9cb0" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 44811 } }
I20260619 18:45:01.685992 10331 leader_election.cc:302] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b7ad8952358d4c929bee0a1004ef9cb0; no voters:
I20260619 18:45:01.686529 10331 leader_election.cc:288] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:45:01.686687 10333 raft_consensus.cc:2781] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:45:01.687162 10333 raft_consensus.cc:686] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0 [term 1 LEADER]: Becoming Leader. State: Replica: b7ad8952358d4c929bee0a1004ef9cb0, State: Running, Role: LEADER
I20260619 18:45:01.687882 10333 consensus_queue.cc:237] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7ad8952358d4c929bee0a1004ef9cb0" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 44811 } }
I20260619 18:45:01.688282 10331 ts_tablet_manager.cc:1428] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0: Time spent starting tablet: real 0.013s user 0.008s sys 0.008s
I20260619 18:45:01.694199 10174 catalog_manager.cc:5495] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0 reported cstate change: term changed from 0 to 1, leader changed from <none> to b7ad8952358d4c929bee0a1004ef9cb0 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "b7ad8952358d4c929bee0a1004ef9cb0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7ad8952358d4c929bee0a1004ef9cb0" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 44811 } health_report { overall_health: HEALTHY } } }
I20260619 18:45:01.708945 6627 tablet_server.cc:178] TabletServer@127.6.120.193:0 shutting down...
I20260619 18:45:01.741534 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:45:01.742333 6627 tablet_replica.cc:330] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0: stopping tablet replica
I20260619 18:45:01.743024 6627 raft_consensus.cc:2229] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:45:01.743525 6627 raft_consensus.cc:2258] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:45:01.747546 6627 tablet_replica.cc:330] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0: stopping tablet replica
I20260619 18:45:01.748499 6627 raft_consensus.cc:2229] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:45:01.749238 6627 raft_consensus.cc:2258] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:45:01.773979 6627 tablet_server.cc:194] TabletServer@127.6.120.193:0 shutdown complete.
I20260619 18:45:01.785526 6627 master.cc:537] Master@127.6.120.254:34339 shutting down...
I20260619 18:45:01.806582 6627 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:45:01.807050 6627 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:45:01.807411 6627 tablet_replica.cc:330] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4: stopping tablet replica
I20260619 18:45:01.826992 6627 master.cc:552] Master@127.6.120.254:34339 shutdown complete.
I20260619 18:45:01.838028 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:45:01.843030 10340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:45:01.844055 10341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:45:01.845062 6627 server_base.cc:1034] running on GCE node
W20260619 18:45:01.844981 10343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:45:01.846259 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:45:01.846421 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:45:01.846539 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894701846531 us; error 0 us; skew 500 ppm
I20260619 18:45:01.846959 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:45:01.849213 6627 webserver.cc:460] Webserver started at http://127.6.120.254:34941/ using document root <none> and password file <none>
I20260619 18:45:01.849618 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:45:01.849752 6627 fs_manager.cc:362] Using existing metadata directory in first data directory
I20260619 18:45:01.853268 6627 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260619 18:45:01.855871 10348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:45:01.856861 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260619 18:45:01.857137 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBlockScannerHijackingAttempts.1781894682485826-6627-0/minicluster-data/master-0-root
uuid: "4ded746f4ad749ba8d5b05447352d7d4"
format_stamp: "Formatted at 2026-06-19 18:45:01 on dist-test-slave-90mn"
I20260619 18:45:01.857429 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBlockScannerHijackingAttempts.1781894682485826-6627-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBlockScannerHijackingAttempts.1781894682485826-6627-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBlockScannerHijackingAttempts.1781894682485826-6627-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:45:01.883141 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:45:01.884258 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:45:01.926620 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.254:34339
I20260619 18:45:01.926725 10409 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.254:34339 every 8 connection(s)
I20260619 18:45:01.935719 10410 sys_catalog.cc:263] Verifying existing consensus state
I20260619 18:45:01.940300 10410 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4: Bootstrap starting.
I20260619 18:45:01.969058 10410 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=6 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 18:45:01.969933 10410 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4: Bootstrap complete.
I20260619 18:45:01.972079 10410 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ded746f4ad749ba8d5b05447352d7d4" member_type: VOTER }
I20260619 18:45:01.972543 10410 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ded746f4ad749ba8d5b05447352d7d4, State: Initialized, Role: FOLLOWER
I20260619 18:45:01.973093 10410 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ded746f4ad749ba8d5b05447352d7d4" member_type: VOTER }
I20260619 18:45:01.973515 10410 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:45:01.973747 10410 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:45:01.973986 10410 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [term 1 FOLLOWER]: Advancing to term 2
I20260619 18:45:01.978453 10410 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ded746f4ad749ba8d5b05447352d7d4" member_type: VOTER }
I20260619 18:45:01.978993 10410 leader_election.cc:302] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4ded746f4ad749ba8d5b05447352d7d4; no voters:
I20260619 18:45:01.980070 10410 leader_election.cc:288] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260619 18:45:01.980484 10413 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260619 18:45:01.981769 10413 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [term 2 LEADER]: Becoming Leader. State: Replica: 4ded746f4ad749ba8d5b05447352d7d4, State: Running, Role: LEADER
I20260619 18:45:01.982389 10413 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ded746f4ad749ba8d5b05447352d7d4" member_type: VOTER }
I20260619 18:45:01.982949 10410 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 18:45:01.985026 10415 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ded746f4ad749ba8d5b05447352d7d4. Latest consensus state: current_term: 2 leader_uuid: "4ded746f4ad749ba8d5b05447352d7d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ded746f4ad749ba8d5b05447352d7d4" member_type: VOTER } }
I20260619 18:45:01.985736 10415 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [sys.catalog]: This master's current role is: LEADER
I20260619 18:45:01.985008 10414 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "4ded746f4ad749ba8d5b05447352d7d4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4ded746f4ad749ba8d5b05447352d7d4" member_type: VOTER } }
I20260619 18:45:01.986773 10414 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [sys.catalog]: This master's current role is: LEADER
I20260619 18:45:01.988530 10420 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 18:45:01.993510 10420 catalog_manager.cc:669] Loaded metadata for table client-testtb [id=48dc55f936954a6792019ce9f87036c1]
I20260619 18:45:01.998106 10420 tablet_loader.cc:96] loaded metadata for tablet c610a5f6e83d475090ad74dd8af95d07 (table client-testtb [id=48dc55f936954a6792019ce9f87036c1])
I20260619 18:45:01.999224 10420 tablet_loader.cc:96] loaded metadata for tablet d5bf9960c044429a8702f09b23b891ff (table client-testtb [id=48dc55f936954a6792019ce9f87036c1])
I20260619 18:45:02.000351 10420 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 18:45:02.001394 6627 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260619 18:45:02.003345 10420 catalog_manager.cc:1259] Loaded cluster ID: bc233f2ac651408fb0c199f2cb662f2c
I20260619 18:45:02.003624 10420 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 18:45:02.008484 10420 catalog_manager.cc:1504] Loading token signing keys...
I20260619 18:45:02.012835 10420 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4: Loaded TSK: 0
I20260619 18:45:02.013942 10420 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 18:45:02.018882 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:45:02.024473 10430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:45:02.025520 10431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:45:02.026952 10433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:45:02.027881 6627 server_base.cc:1034] running on GCE node
I20260619 18:45:02.028729 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:45:02.028904 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:45:02.029085 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894702029075 us; error 0 us; skew 500 ppm
I20260619 18:45:02.029632 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:45:02.031901 6627 webserver.cc:460] Webserver started at http://127.6.120.193:40517/ using document root <none> and password file <none>
I20260619 18:45:02.032378 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:45:02.032562 6627 fs_manager.cc:362] Using existing metadata directory in first data directory
I20260619 18:45:02.036078 6627 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260619 18:45:02.038761 10438 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:45:02.039676 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260619 18:45:02.039987 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBlockScannerHijackingAttempts.1781894682485826-6627-0/minicluster-data/ts-0-root
uuid: "b7ad8952358d4c929bee0a1004ef9cb0"
format_stamp: "Formatted at 2026-06-19 18:45:01 on dist-test-slave-90mn"
I20260619 18:45:02.040325 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBlockScannerHijackingAttempts.1781894682485826-6627-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBlockScannerHijackingAttempts.1781894682485826-6627-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TestBlockScannerHijackingAttempts.1781894682485826-6627-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:45:02.066354 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:45:02.067312 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:45:02.073781 10448 ts_tablet_manager.cc:542] Loading tablet metadata (0/2 complete)
I20260619 18:45:02.086692 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (2 total tablets, 2 live tablets)
I20260619 18:45:02.087042 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.015s user 0.000s sys 0.003s
I20260619 18:45:02.087380 6627 ts_tablet_manager.cc:594] Registering tablets (0/2 complete)
I20260619 18:45:02.092658 10448 tablet_bootstrap.cc:492] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0: Bootstrap starting.
I20260619 18:45:02.098464 6627 ts_tablet_manager.cc:610] Registered 2 tablets
I20260619 18:45:02.098829 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.011s user 0.012s sys 0.000s
I20260619 18:45:02.109750 10448 tablet_bootstrap.cc:492] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 18:45:02.110499 10448 tablet_bootstrap.cc:492] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0: Bootstrap complete.
I20260619 18:45:02.111153 10448 ts_tablet_manager.cc:1397] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0: Time spent bootstrapping tablet: real 0.019s user 0.010s sys 0.004s
I20260619 18:45:02.113040 10448 raft_consensus.cc:348] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7ad8952358d4c929bee0a1004ef9cb0" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 44811 } }
I20260619 18:45:02.113493 10448 raft_consensus.cc:729] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ad8952358d4c929bee0a1004ef9cb0, State: Initialized, Role: FOLLOWER
I20260619 18:45:02.114037 10448 consensus_queue.cc:260] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7ad8952358d4c929bee0a1004ef9cb0" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 44811 } }
I20260619 18:45:02.114531 10448 raft_consensus.cc:388] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:45:02.114792 10448 raft_consensus.cc:482] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:45:02.115113 10448 raft_consensus.cc:3037] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260619 18:45:02.120076 10448 raft_consensus.cc:504] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7ad8952358d4c929bee0a1004ef9cb0" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 44811 } }
I20260619 18:45:02.120754 10448 leader_election.cc:302] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b7ad8952358d4c929bee0a1004ef9cb0; no voters:
I20260619 18:45:02.122099 10448 leader_election.cc:288] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260619 18:45:02.122546 10472 raft_consensus.cc:2781] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260619 18:45:02.125139 10472 raft_consensus.cc:686] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0 [term 2 LEADER]: Becoming Leader. State: Replica: b7ad8952358d4c929bee0a1004ef9cb0, State: Running, Role: LEADER
I20260619 18:45:02.125558 10448 ts_tablet_manager.cc:1428] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0: Time spent starting tablet: real 0.014s user 0.010s sys 0.006s
I20260619 18:45:02.126430 10448 tablet_bootstrap.cc:492] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0: Bootstrap starting.
I20260619 18:45:02.126117 10472 consensus_queue.cc:237] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7ad8952358d4c929bee0a1004ef9cb0" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 44811 } }
I20260619 18:45:02.142541 10448 tablet_bootstrap.cc:492] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 18:45:02.143296 10448 tablet_bootstrap.cc:492] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0: Bootstrap complete.
I20260619 18:45:02.143827 10448 ts_tablet_manager.cc:1397] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0: Time spent bootstrapping tablet: real 0.018s user 0.013s sys 0.000s
I20260619 18:45:02.145630 10448 raft_consensus.cc:348] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7ad8952358d4c929bee0a1004ef9cb0" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 44811 } }
I20260619 18:45:02.146102 10448 raft_consensus.cc:729] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b7ad8952358d4c929bee0a1004ef9cb0, State: Initialized, Role: FOLLOWER
I20260619 18:45:02.146833 10448 consensus_queue.cc:260] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7ad8952358d4c929bee0a1004ef9cb0" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 44811 } }
I20260619 18:45:02.147388 10448 raft_consensus.cc:388] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:45:02.147610 10448 raft_consensus.cc:482] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:45:02.147894 10448 raft_consensus.cc:3037] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0 [term 1 FOLLOWER]: Advancing to term 2
I20260619 18:45:02.153625 10448 raft_consensus.cc:504] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7ad8952358d4c929bee0a1004ef9cb0" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 44811 } }
I20260619 18:45:02.154227 10448 leader_election.cc:302] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b7ad8952358d4c929bee0a1004ef9cb0; no voters:
I20260619 18:45:02.154717 10448 leader_election.cc:288] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260619 18:45:02.154906 10472 raft_consensus.cc:2781] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0 [term 2 FOLLOWER]: Leader election won for term 2
I20260619 18:45:02.155500 10472 raft_consensus.cc:686] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0 [term 2 LEADER]: Becoming Leader. State: Replica: b7ad8952358d4c929bee0a1004ef9cb0, State: Running, Role: LEADER
I20260619 18:45:02.156553 10448 ts_tablet_manager.cc:1428] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0: Time spent starting tablet: real 0.012s user 0.016s sys 0.000s
I20260619 18:45:02.156363 10472 consensus_queue.cc:237] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7ad8952358d4c929bee0a1004ef9cb0" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 44811 } }
I20260619 18:45:02.160339 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.193:34377
I20260619 18:45:02.160446 10517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.193:34377 every 8 connection(s)
I20260619 18:45:02.165123 10518 heartbeater.cc:347] Connected to a master server at 127.6.120.254:34339
I20260619 18:45:02.165467 10518 heartbeater.cc:464] Registering TS with master...
I20260619 18:45:02.166109 10518 heartbeater.cc:511] Master 127.6.120.254:34339 requested a full tablet report, sending...
I20260619 18:45:02.168929 10365 ts_manager.cc:194] Registered new tserver with Master: b7ad8952358d4c929bee0a1004ef9cb0 (127.6.120.193:34377)
I20260619 18:45:02.169487 6627 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.006077905s
I20260619 18:45:02.170428 10365 catalog_manager.cc:5495] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "b7ad8952358d4c929bee0a1004ef9cb0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7ad8952358d4c929bee0a1004ef9cb0" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 44811 } health_report { overall_health: HEALTHY } } }
I20260619 18:45:02.171399 10365 catalog_manager.cc:5495] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "b7ad8952358d4c929bee0a1004ef9cb0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b7ad8952358d4c929bee0a1004ef9cb0" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 44811 } health_report { overall_health: HEALTHY } } }
I20260619 18:45:02.182962 10365 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43580
I20260619 18:45:02.187829 10518 heartbeater.cc:503] Master 127.6.120.254:34339 was elected leader, sending a full tablet report...
I20260619 18:45:02.688244 6627 client-test.cc:7820] Attempting to extract data from fault-tolerant scan 6769f9b424364854b00656c21975dd7d as bad-guy
I20260619 18:45:02.690027 10465 tablet_service.cc:3069] Scan: Not authorized: User bad-guy doesn't own scanner 6769f9b424364854b00656c21975dd7d: call sequence id=1, remote={username='bad-guy'} at 127.0.0.1:58424
W20260619 18:45:02.691383 6627 client.cc:2227] Scan on tablet server b7ad8952358d4c929bee0a1004ef9cb0 (127.6.120.193:34377) with Scanner { table: client-testtb, tablet: d5bf9960c044429a8702f09b23b891ff, projection: (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:non_null_with_default INT32 NOT NULL,
PRIMARY KEY (key)
), scan_spec: } failed: Remote error: Not authorized: User bad-guy doesn't own scanner 6769f9b424364854b00656c21975dd7d
I20260619 18:45:02.693522 10465 tablet_service.cc:3069] Scan: Not authorized: User bad-guy doesn't own scanner 6769f9b424364854b00656c21975dd7d: call sequence id=2, remote={username='bad-guy'} at 127.0.0.1:58424
W20260619 18:45:02.694527 10535 client.cc:2034] Couldn't close scanner 6769f9b424364854b00656c21975dd7d: Remote error: Not authorized: User bad-guy doesn't own scanner 6769f9b424364854b00656c21975dd7d
I20260619 18:45:02.704870 6627 client-test.cc:7820] Attempting to extract data from non-fault-tolerant scan 1b364e19666841eaa36fe436c50e84a2 as bad-guy
I20260619 18:45:02.706254 10466 tablet_service.cc:3069] Scan: Not authorized: User bad-guy doesn't own scanner 1b364e19666841eaa36fe436c50e84a2: call sequence id=1, remote={username='bad-guy'} at 127.0.0.1:58424
W20260619 18:45:02.707115 6627 client.cc:2227] Scan on tablet server b7ad8952358d4c929bee0a1004ef9cb0 (127.6.120.193:34377) with Scanner { table: client-testtb, tablet: d5bf9960c044429a8702f09b23b891ff, projection: (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
13:non_null_with_default INT32 NOT NULL,
PRIMARY KEY (key)
), scan_spec: } failed: Remote error: Not authorized: User bad-guy doesn't own scanner 1b364e19666841eaa36fe436c50e84a2
I20260619 18:45:02.709321 10466 tablet_service.cc:3069] Scan: Not authorized: User bad-guy doesn't own scanner 1b364e19666841eaa36fe436c50e84a2: call sequence id=2, remote={username='bad-guy'} at 127.0.0.1:58424
W20260619 18:45:02.710143 10535 client.cc:2034] Couldn't close scanner 1b364e19666841eaa36fe436c50e84a2: Remote error: Not authorized: User bad-guy doesn't own scanner 1b364e19666841eaa36fe436c50e84a2
I20260619 18:45:02.756088 6627 tablet_server.cc:178] TabletServer@127.6.120.193:0 shutting down...
I20260619 18:45:02.784325 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:45:02.785229 6627 tablet_replica.cc:330] stopping tablet replica
I20260619 18:45:02.786067 6627 raft_consensus.cc:2229] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0 [term 2 LEADER]: Raft consensus shutting down.
I20260619 18:45:02.787032 6627 raft_consensus.cc:2258] T c610a5f6e83d475090ad74dd8af95d07 P b7ad8952358d4c929bee0a1004ef9cb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260619 18:45:02.792322 6627 tablet_replica.cc:330] stopping tablet replica
I20260619 18:45:02.792847 6627 raft_consensus.cc:2229] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0 [term 2 LEADER]: Raft consensus shutting down.
I20260619 18:45:02.793485 6627 raft_consensus.cc:2258] T d5bf9960c044429a8702f09b23b891ff P b7ad8952358d4c929bee0a1004ef9cb0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260619 18:45:02.805099 6627 tablet_server.cc:194] TabletServer@127.6.120.193:0 shutdown complete.
I20260619 18:45:02.824513 6627 master.cc:537] Master@127.6.120.254:34339 shutting down...
I20260619 18:45:02.851073 6627 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [term 2 LEADER]: Raft consensus shutting down.
I20260619 18:45:02.851888 6627 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 4ded746f4ad749ba8d5b05447352d7d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260619 18:45:02.852312 6627 tablet_replica.cc:330] stopping tablet replica
I20260619 18:45:02.872299 6627 master.cc:552] Master@127.6.120.254:34339 shutdown complete.
[ OK ] ClientTest.TestBlockScannerHijackingAttempts (1745 ms)
[ RUN ] ClientTest.FlushTxnSessionsOnCommit
I20260619 18:45:02.904990 6627 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.120.254:33029
I20260619 18:45:02.906070 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:45:02.912348 10541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:45:02.912586 10540 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:45:02.913261 10543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:45:02.914952 6627 server_base.cc:1034] running on GCE node
I20260619 18:45:02.915732 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:45:02.915935 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:45:02.916183 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894702916065 us; error 0 us; skew 500 ppm
I20260619 18:45:02.916682 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:45:02.919129 6627 webserver.cc:460] Webserver started at http://127.6.120.254:37911/ using document root <none> and password file <none>
I20260619 18:45:02.919624 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:45:02.919781 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:45:02.920053 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:45:02.921372 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.FlushTxnSessionsOnCommit.1781894682485826-6627-0/minicluster-data/master-0-root/instance:
uuid: "df79a535637c468c9cd2b9a9832eb4e2"
format_stamp: "Formatted at 2026-06-19 18:45:02 on dist-test-slave-90mn"
I20260619 18:45:02.925835 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260619 18:45:02.929334 10548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:45:02.930187 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260619 18:45:02.930437 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.FlushTxnSessionsOnCommit.1781894682485826-6627-0/minicluster-data/master-0-root
uuid: "df79a535637c468c9cd2b9a9832eb4e2"
format_stamp: "Formatted at 2026-06-19 18:45:02 on dist-test-slave-90mn"
I20260619 18:45:02.930689 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.FlushTxnSessionsOnCommit.1781894682485826-6627-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.FlushTxnSessionsOnCommit.1781894682485826-6627-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.FlushTxnSessionsOnCommit.1781894682485826-6627-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:45:02.953059 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:45:02.954295 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:45:02.998208 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.254:33029
I20260619 18:45:02.998322 10609 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.254:33029 every 8 connection(s)
I20260619 18:45:03.002545 10610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:45:03.016610 10610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df79a535637c468c9cd2b9a9832eb4e2: Bootstrap starting.
I20260619 18:45:03.021544 10610 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P df79a535637c468c9cd2b9a9832eb4e2: Neither blocks nor log segments found. Creating new log.
I20260619 18:45:03.025918 10610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df79a535637c468c9cd2b9a9832eb4e2: No bootstrap required, opened a new log
I20260619 18:45:03.027979 10610 raft_consensus.cc:348] T 00000000000000000000000000000000 P df79a535637c468c9cd2b9a9832eb4e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df79a535637c468c9cd2b9a9832eb4e2" member_type: VOTER }
I20260619 18:45:03.028530 10610 raft_consensus.cc:374] T 00000000000000000000000000000000 P df79a535637c468c9cd2b9a9832eb4e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:45:03.028775 10610 raft_consensus.cc:729] T 00000000000000000000000000000000 P df79a535637c468c9cd2b9a9832eb4e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df79a535637c468c9cd2b9a9832eb4e2, State: Initialized, Role: FOLLOWER
I20260619 18:45:03.029376 10610 consensus_queue.cc:260] T 00000000000000000000000000000000 P df79a535637c468c9cd2b9a9832eb4e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df79a535637c468c9cd2b9a9832eb4e2" member_type: VOTER }
I20260619 18:45:03.029821 10610 raft_consensus.cc:388] T 00000000000000000000000000000000 P df79a535637c468c9cd2b9a9832eb4e2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:45:03.030053 10610 raft_consensus.cc:482] T 00000000000000000000000000000000 P df79a535637c468c9cd2b9a9832eb4e2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:45:03.030288 10610 raft_consensus.cc:3037] T 00000000000000000000000000000000 P df79a535637c468c9cd2b9a9832eb4e2 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:45:03.035029 10610 raft_consensus.cc:504] T 00000000000000000000000000000000 P df79a535637c468c9cd2b9a9832eb4e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df79a535637c468c9cd2b9a9832eb4e2" member_type: VOTER }
I20260619 18:45:03.035538 10610 leader_election.cc:302] T 00000000000000000000000000000000 P df79a535637c468c9cd2b9a9832eb4e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: df79a535637c468c9cd2b9a9832eb4e2; no voters:
I20260619 18:45:03.036751 10610 leader_election.cc:288] T 00000000000000000000000000000000 P df79a535637c468c9cd2b9a9832eb4e2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:45:03.037211 10613 raft_consensus.cc:2781] T 00000000000000000000000000000000 P df79a535637c468c9cd2b9a9832eb4e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:45:03.038503 10613 raft_consensus.cc:686] T 00000000000000000000000000000000 P df79a535637c468c9cd2b9a9832eb4e2 [term 1 LEADER]: Becoming Leader. State: Replica: df79a535637c468c9cd2b9a9832eb4e2, State: Running, Role: LEADER
I20260619 18:45:03.039156 10613 consensus_queue.cc:237] T 00000000000000000000000000000000 P df79a535637c468c9cd2b9a9832eb4e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df79a535637c468c9cd2b9a9832eb4e2" member_type: VOTER }
I20260619 18:45:03.039582 10610 sys_catalog.cc:564] T 00000000000000000000000000000000 P df79a535637c468c9cd2b9a9832eb4e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 18:45:03.042097 10615 sys_catalog.cc:455] T 00000000000000000000000000000000 P df79a535637c468c9cd2b9a9832eb4e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader df79a535637c468c9cd2b9a9832eb4e2. Latest consensus state: current_term: 1 leader_uuid: "df79a535637c468c9cd2b9a9832eb4e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df79a535637c468c9cd2b9a9832eb4e2" member_type: VOTER } }
I20260619 18:45:03.042033 10614 sys_catalog.cc:455] T 00000000000000000000000000000000 P df79a535637c468c9cd2b9a9832eb4e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "df79a535637c468c9cd2b9a9832eb4e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df79a535637c468c9cd2b9a9832eb4e2" member_type: VOTER } }
I20260619 18:45:03.042752 10615 sys_catalog.cc:458] T 00000000000000000000000000000000 P df79a535637c468c9cd2b9a9832eb4e2 [sys.catalog]: This master's current role is: LEADER
I20260619 18:45:03.042768 10614 sys_catalog.cc:458] T 00000000000000000000000000000000 P df79a535637c468c9cd2b9a9832eb4e2 [sys.catalog]: This master's current role is: LEADER
I20260619 18:45:03.046379 10618 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 18:45:03.051278 10618 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 18:45:03.055338 6627 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260619 18:45:03.060036 10618 catalog_manager.cc:1347] Generated new cluster ID: 362c39c207374434b2972f73e7294891
I20260619 18:45:03.060379 10618 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 18:45:03.080456 10618 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 18:45:03.082120 10618 catalog_manager.cc:1504] Loading token signing keys...
I20260619 18:45:03.099426 10618 catalog_manager.cc:5868] T 00000000000000000000000000000000 P df79a535637c468c9cd2b9a9832eb4e2: Generated new TSK 0
I20260619 18:45:03.100235 10618 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 18:45:03.121867 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:45:03.127995 10631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:45:03.129211 10632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:45:03.132871 6627 server_base.cc:1034] running on GCE node
W20260619 18:45:03.132813 10634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:45:03.134019 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:45:03.134277 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:45:03.134483 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894703134471 us; error 0 us; skew 500 ppm
I20260619 18:45:03.135102 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:45:03.137681 6627 webserver.cc:460] Webserver started at http://127.6.120.193:46791/ using document root <none> and password file <none>
I20260619 18:45:03.138185 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:45:03.138382 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:45:03.138655 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:45:03.139896 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.FlushTxnSessionsOnCommit.1781894682485826-6627-0/minicluster-data/ts-0-root/instance:
uuid: "f48a279fe0f04bc5990869ac190ac8ac"
format_stamp: "Formatted at 2026-06-19 18:45:03 on dist-test-slave-90mn"
I20260619 18:45:03.144840 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260619 18:45:03.148305 10639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:45:03.149108 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260619 18:45:03.149453 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.FlushTxnSessionsOnCommit.1781894682485826-6627-0/minicluster-data/ts-0-root
uuid: "f48a279fe0f04bc5990869ac190ac8ac"
format_stamp: "Formatted at 2026-06-19 18:45:03 on dist-test-slave-90mn"
I20260619 18:45:03.149849 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.FlushTxnSessionsOnCommit.1781894682485826-6627-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.FlushTxnSessionsOnCommit.1781894682485826-6627-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.FlushTxnSessionsOnCommit.1781894682485826-6627-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:45:03.179862 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:45:03.181073 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:45:03.186718 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:45:03.187220 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.001s user 0.001s sys 0.000s
I20260619 18:45:03.187573 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:45:03.187884 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:45:03.241869 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.193:40021
I20260619 18:45:03.241974 10709 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.193:40021 every 8 connection(s)
I20260619 18:45:03.246369 10710 heartbeater.cc:347] Connected to a master server at 127.6.120.254:33029
I20260619 18:45:03.246747 10710 heartbeater.cc:464] Registering TS with master...
I20260619 18:45:03.247390 10710 heartbeater.cc:511] Master 127.6.120.254:33029 requested a full tablet report, sending...
I20260619 18:45:03.249351 10565 ts_manager.cc:194] Registered new tserver with Master: f48a279fe0f04bc5990869ac190ac8ac (127.6.120.193:40021)
I20260619 18:45:03.249842 6627 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.00484959s
I20260619 18:45:03.252460 10565 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49196
I20260619 18:45:03.265942 10710 heartbeater.cc:503] Master 127.6.120.254:33029 was elected leader, sending a full tablet report...
I20260619 18:45:03.274245 10565 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49210:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 18:45:03.313828 10675 tablet_service.cc:1467] Processing CreateTablet for tablet d4c803dfe0fb40c0afe2f25edfaa4c4d (DEFAULT_TABLE table=client-testtb [id=d70b994a67ab464399e8e527cb26f5aa]), partition=RANGE (key) PARTITION VALUES < 9
I20260619 18:45:03.314337 10674 tablet_service.cc:1467] Processing CreateTablet for tablet fdfec8daeaa5447b91b34c797fb4bdee (DEFAULT_TABLE table=client-testtb [id=d70b994a67ab464399e8e527cb26f5aa]), partition=RANGE (key) PARTITION 9 <= VALUES
I20260619 18:45:03.315119 10675 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4c803dfe0fb40c0afe2f25edfaa4c4d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:45:03.315667 10674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fdfec8daeaa5447b91b34c797fb4bdee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:45:03.329794 10720 tablet_bootstrap.cc:492] T d4c803dfe0fb40c0afe2f25edfaa4c4d P f48a279fe0f04bc5990869ac190ac8ac: Bootstrap starting.
I20260619 18:45:03.334472 10720 tablet_bootstrap.cc:654] T d4c803dfe0fb40c0afe2f25edfaa4c4d P f48a279fe0f04bc5990869ac190ac8ac: Neither blocks nor log segments found. Creating new log.
I20260619 18:45:03.339592 10720 tablet_bootstrap.cc:492] T d4c803dfe0fb40c0afe2f25edfaa4c4d P f48a279fe0f04bc5990869ac190ac8ac: No bootstrap required, opened a new log
I20260619 18:45:03.340054 10720 ts_tablet_manager.cc:1397] T d4c803dfe0fb40c0afe2f25edfaa4c4d P f48a279fe0f04bc5990869ac190ac8ac: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.009s
I20260619 18:45:03.342078 10720 raft_consensus.cc:348] T d4c803dfe0fb40c0afe2f25edfaa4c4d P f48a279fe0f04bc5990869ac190ac8ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f48a279fe0f04bc5990869ac190ac8ac" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40021 } }
I20260619 18:45:03.342495 10720 raft_consensus.cc:374] T d4c803dfe0fb40c0afe2f25edfaa4c4d P f48a279fe0f04bc5990869ac190ac8ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:45:03.342738 10720 raft_consensus.cc:729] T d4c803dfe0fb40c0afe2f25edfaa4c4d P f48a279fe0f04bc5990869ac190ac8ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f48a279fe0f04bc5990869ac190ac8ac, State: Initialized, Role: FOLLOWER
I20260619 18:45:03.343240 10720 consensus_queue.cc:260] T d4c803dfe0fb40c0afe2f25edfaa4c4d P f48a279fe0f04bc5990869ac190ac8ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f48a279fe0f04bc5990869ac190ac8ac" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40021 } }
I20260619 18:45:03.343649 10720 raft_consensus.cc:388] T d4c803dfe0fb40c0afe2f25edfaa4c4d P f48a279fe0f04bc5990869ac190ac8ac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:45:03.343943 10720 raft_consensus.cc:482] T d4c803dfe0fb40c0afe2f25edfaa4c4d P f48a279fe0f04bc5990869ac190ac8ac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:45:03.344241 10720 raft_consensus.cc:3037] T d4c803dfe0fb40c0afe2f25edfaa4c4d P f48a279fe0f04bc5990869ac190ac8ac [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:45:03.349880 10720 raft_consensus.cc:504] T d4c803dfe0fb40c0afe2f25edfaa4c4d P f48a279fe0f04bc5990869ac190ac8ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f48a279fe0f04bc5990869ac190ac8ac" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40021 } }
I20260619 18:45:03.350452 10720 leader_election.cc:302] T d4c803dfe0fb40c0afe2f25edfaa4c4d P f48a279fe0f04bc5990869ac190ac8ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f48a279fe0f04bc5990869ac190ac8ac; no voters:
I20260619 18:45:03.351889 10720 leader_election.cc:288] T d4c803dfe0fb40c0afe2f25edfaa4c4d P f48a279fe0f04bc5990869ac190ac8ac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:45:03.352386 10722 raft_consensus.cc:2781] T d4c803dfe0fb40c0afe2f25edfaa4c4d P f48a279fe0f04bc5990869ac190ac8ac [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:45:03.353891 10722 raft_consensus.cc:686] T d4c803dfe0fb40c0afe2f25edfaa4c4d P f48a279fe0f04bc5990869ac190ac8ac [term 1 LEADER]: Becoming Leader. State: Replica: f48a279fe0f04bc5990869ac190ac8ac, State: Running, Role: LEADER
I20260619 18:45:03.354053 10720 ts_tablet_manager.cc:1428] T d4c803dfe0fb40c0afe2f25edfaa4c4d P f48a279fe0f04bc5990869ac190ac8ac: Time spent starting tablet: real 0.014s user 0.012s sys 0.001s
I20260619 18:45:03.354843 10720 tablet_bootstrap.cc:492] T fdfec8daeaa5447b91b34c797fb4bdee P f48a279fe0f04bc5990869ac190ac8ac: Bootstrap starting.
I20260619 18:45:03.354619 10722 consensus_queue.cc:237] T d4c803dfe0fb40c0afe2f25edfaa4c4d P f48a279fe0f04bc5990869ac190ac8ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f48a279fe0f04bc5990869ac190ac8ac" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40021 } }
I20260619 18:45:03.360973 10720 tablet_bootstrap.cc:654] T fdfec8daeaa5447b91b34c797fb4bdee P f48a279fe0f04bc5990869ac190ac8ac: Neither blocks nor log segments found. Creating new log.
I20260619 18:45:03.361032 10564 catalog_manager.cc:5495] T d4c803dfe0fb40c0afe2f25edfaa4c4d P f48a279fe0f04bc5990869ac190ac8ac reported cstate change: term changed from 0 to 1, leader changed from <none> to f48a279fe0f04bc5990869ac190ac8ac (127.6.120.193). New cstate: current_term: 1 leader_uuid: "f48a279fe0f04bc5990869ac190ac8ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f48a279fe0f04bc5990869ac190ac8ac" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40021 } health_report { overall_health: HEALTHY } } }
I20260619 18:45:03.366333 10720 tablet_bootstrap.cc:492] T fdfec8daeaa5447b91b34c797fb4bdee P f48a279fe0f04bc5990869ac190ac8ac: No bootstrap required, opened a new log
I20260619 18:45:03.366765 10720 ts_tablet_manager.cc:1397] T fdfec8daeaa5447b91b34c797fb4bdee P f48a279fe0f04bc5990869ac190ac8ac: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.003s
I20260619 18:45:03.369005 10720 raft_consensus.cc:348] T fdfec8daeaa5447b91b34c797fb4bdee P f48a279fe0f04bc5990869ac190ac8ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f48a279fe0f04bc5990869ac190ac8ac" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40021 } }
I20260619 18:45:03.369455 10720 raft_consensus.cc:374] T fdfec8daeaa5447b91b34c797fb4bdee P f48a279fe0f04bc5990869ac190ac8ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:45:03.369679 10720 raft_consensus.cc:729] T fdfec8daeaa5447b91b34c797fb4bdee P f48a279fe0f04bc5990869ac190ac8ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f48a279fe0f04bc5990869ac190ac8ac, State: Initialized, Role: FOLLOWER
I20260619 18:45:03.370165 10720 consensus_queue.cc:260] T fdfec8daeaa5447b91b34c797fb4bdee P f48a279fe0f04bc5990869ac190ac8ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f48a279fe0f04bc5990869ac190ac8ac" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40021 } }
I20260619 18:45:03.370640 10720 raft_consensus.cc:388] T fdfec8daeaa5447b91b34c797fb4bdee P f48a279fe0f04bc5990869ac190ac8ac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:45:03.370877 10720 raft_consensus.cc:482] T fdfec8daeaa5447b91b34c797fb4bdee P f48a279fe0f04bc5990869ac190ac8ac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:45:03.371143 10720 raft_consensus.cc:3037] T fdfec8daeaa5447b91b34c797fb4bdee P f48a279fe0f04bc5990869ac190ac8ac [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:45:03.377343 10720 raft_consensus.cc:504] T fdfec8daeaa5447b91b34c797fb4bdee P f48a279fe0f04bc5990869ac190ac8ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f48a279fe0f04bc5990869ac190ac8ac" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40021 } }
I20260619 18:45:03.377969 10720 leader_election.cc:302] T fdfec8daeaa5447b91b34c797fb4bdee P f48a279fe0f04bc5990869ac190ac8ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f48a279fe0f04bc5990869ac190ac8ac; no voters:
I20260619 18:45:03.378470 10720 leader_election.cc:288] T fdfec8daeaa5447b91b34c797fb4bdee P f48a279fe0f04bc5990869ac190ac8ac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:45:03.378626 10722 raft_consensus.cc:2781] T fdfec8daeaa5447b91b34c797fb4bdee P f48a279fe0f04bc5990869ac190ac8ac [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:45:03.379122 10722 raft_consensus.cc:686] T fdfec8daeaa5447b91b34c797fb4bdee P f48a279fe0f04bc5990869ac190ac8ac [term 1 LEADER]: Becoming Leader. State: Replica: f48a279fe0f04bc5990869ac190ac8ac, State: Running, Role: LEADER
I20260619 18:45:03.379877 10720 ts_tablet_manager.cc:1428] T fdfec8daeaa5447b91b34c797fb4bdee P f48a279fe0f04bc5990869ac190ac8ac: Time spent starting tablet: real 0.013s user 0.011s sys 0.000s
I20260619 18:45:03.379871 10722 consensus_queue.cc:237] T fdfec8daeaa5447b91b34c797fb4bdee P f48a279fe0f04bc5990869ac190ac8ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f48a279fe0f04bc5990869ac190ac8ac" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40021 } }
I20260619 18:45:03.385288 10564 catalog_manager.cc:5495] T fdfec8daeaa5447b91b34c797fb4bdee P f48a279fe0f04bc5990869ac190ac8ac reported cstate change: term changed from 0 to 1, leader changed from <none> to f48a279fe0f04bc5990869ac190ac8ac (127.6.120.193). New cstate: current_term: 1 leader_uuid: "f48a279fe0f04bc5990869ac190ac8ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f48a279fe0f04bc5990869ac190ac8ac" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40021 } health_report { overall_health: HEALTHY } } }
I20260619 18:45:03.442552 10565 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49220:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
I20260619 18:45:03.463052 10675 tablet_service.cc:1467] Processing CreateTablet for tablet 0cef75f257a4401d9dfddff54dc1a727 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6bd38af91c8e4aeeb3ae9cf744dd80e2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260619 18:45:03.464387 10675 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0cef75f257a4401d9dfddff54dc1a727. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:45:03.476620 10720 tablet_bootstrap.cc:492] T 0cef75f257a4401d9dfddff54dc1a727 P f48a279fe0f04bc5990869ac190ac8ac: Bootstrap starting.
I20260619 18:45:03.482112 10720 tablet_bootstrap.cc:654] T 0cef75f257a4401d9dfddff54dc1a727 P f48a279fe0f04bc5990869ac190ac8ac: Neither blocks nor log segments found. Creating new log.
I20260619 18:45:03.486717 10720 tablet_bootstrap.cc:492] T 0cef75f257a4401d9dfddff54dc1a727 P f48a279fe0f04bc5990869ac190ac8ac: No bootstrap required, opened a new log
I20260619 18:45:03.487152 10720 ts_tablet_manager.cc:1397] T 0cef75f257a4401d9dfddff54dc1a727 P f48a279fe0f04bc5990869ac190ac8ac: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260619 18:45:03.489053 10720 raft_consensus.cc:348] T 0cef75f257a4401d9dfddff54dc1a727 P f48a279fe0f04bc5990869ac190ac8ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f48a279fe0f04bc5990869ac190ac8ac" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40021 } }
I20260619 18:45:03.489460 10720 raft_consensus.cc:374] T 0cef75f257a4401d9dfddff54dc1a727 P f48a279fe0f04bc5990869ac190ac8ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:45:03.489636 10720 raft_consensus.cc:729] T 0cef75f257a4401d9dfddff54dc1a727 P f48a279fe0f04bc5990869ac190ac8ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f48a279fe0f04bc5990869ac190ac8ac, State: Initialized, Role: FOLLOWER
I20260619 18:45:03.490252 10720 consensus_queue.cc:260] T 0cef75f257a4401d9dfddff54dc1a727 P f48a279fe0f04bc5990869ac190ac8ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f48a279fe0f04bc5990869ac190ac8ac" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40021 } }
I20260619 18:45:03.490748 10720 raft_consensus.cc:388] T 0cef75f257a4401d9dfddff54dc1a727 P f48a279fe0f04bc5990869ac190ac8ac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:45:03.491009 10720 raft_consensus.cc:482] T 0cef75f257a4401d9dfddff54dc1a727 P f48a279fe0f04bc5990869ac190ac8ac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:45:03.491339 10720 raft_consensus.cc:3037] T 0cef75f257a4401d9dfddff54dc1a727 P f48a279fe0f04bc5990869ac190ac8ac [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:45:03.496933 10720 raft_consensus.cc:504] T 0cef75f257a4401d9dfddff54dc1a727 P f48a279fe0f04bc5990869ac190ac8ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f48a279fe0f04bc5990869ac190ac8ac" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40021 } }
I20260619 18:45:03.497469 10720 leader_election.cc:302] T 0cef75f257a4401d9dfddff54dc1a727 P f48a279fe0f04bc5990869ac190ac8ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f48a279fe0f04bc5990869ac190ac8ac; no voters:
I20260619 18:45:03.497880 10720 leader_election.cc:288] T 0cef75f257a4401d9dfddff54dc1a727 P f48a279fe0f04bc5990869ac190ac8ac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:45:03.498057 10722 raft_consensus.cc:2781] T 0cef75f257a4401d9dfddff54dc1a727 P f48a279fe0f04bc5990869ac190ac8ac [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:45:03.498548 10722 raft_consensus.cc:686] T 0cef75f257a4401d9dfddff54dc1a727 P f48a279fe0f04bc5990869ac190ac8ac [term 1 LEADER]: Becoming Leader. State: Replica: f48a279fe0f04bc5990869ac190ac8ac, State: Running, Role: LEADER
I20260619 18:45:03.499595 10720 ts_tablet_manager.cc:1428] T 0cef75f257a4401d9dfddff54dc1a727 P f48a279fe0f04bc5990869ac190ac8ac: Time spent starting tablet: real 0.012s user 0.004s sys 0.007s
I20260619 18:45:03.499323 10722 consensus_queue.cc:237] T 0cef75f257a4401d9dfddff54dc1a727 P f48a279fe0f04bc5990869ac190ac8ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f48a279fe0f04bc5990869ac190ac8ac" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40021 } }
I20260619 18:45:03.504222 10723 tablet_replica.cc:439] T 0cef75f257a4401d9dfddff54dc1a727 P f48a279fe0f04bc5990869ac190ac8ac: TxnStatusTablet state changed. Reason: New leader f48a279fe0f04bc5990869ac190ac8ac. Latest consensus state: current_term: 1 leader_uuid: "f48a279fe0f04bc5990869ac190ac8ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f48a279fe0f04bc5990869ac190ac8ac" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40021 } } }
I20260619 18:45:03.504913 10723 tablet_replica.cc:442] T 0cef75f257a4401d9dfddff54dc1a727 P f48a279fe0f04bc5990869ac190ac8ac: This TxnStatusTablet replica's current role is: LEADER
I20260619 18:45:03.506134 10724 tablet_replica.cc:439] T 0cef75f257a4401d9dfddff54dc1a727 P f48a279fe0f04bc5990869ac190ac8ac: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f48a279fe0f04bc5990869ac190ac8ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f48a279fe0f04bc5990869ac190ac8ac" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40021 } } }
I20260619 18:45:03.506533 10736 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260619 18:45:03.506780 10724 tablet_replica.cc:442] T 0cef75f257a4401d9dfddff54dc1a727 P f48a279fe0f04bc5990869ac190ac8ac: This TxnStatusTablet replica's current role is: LEADER
I20260619 18:45:03.506326 10565 catalog_manager.cc:5495] T 0cef75f257a4401d9dfddff54dc1a727 P f48a279fe0f04bc5990869ac190ac8ac reported cstate change: term changed from 0 to 1, leader changed from <none> to f48a279fe0f04bc5990869ac190ac8ac (127.6.120.193). New cstate: current_term: 1 leader_uuid: "f48a279fe0f04bc5990869ac190ac8ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f48a279fe0f04bc5990869ac190ac8ac" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 40021 } health_report { overall_health: HEALTHY } } }
I20260619 18:45:03.507083 10736 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260619 18:45:05.149115 6627 tablet_server.cc:178] TabletServer@127.6.120.193:0 shutting down...
I20260619 18:45:05.185500 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:45:05.186431 6627 tablet_replica.cc:330] T 0cef75f257a4401d9dfddff54dc1a727 P f48a279fe0f04bc5990869ac190ac8ac: stopping tablet replica
I20260619 18:45:05.187172 6627 raft_consensus.cc:2229] T 0cef75f257a4401d9dfddff54dc1a727 P f48a279fe0f04bc5990869ac190ac8ac [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:45:05.187716 6627 raft_consensus.cc:2258] T 0cef75f257a4401d9dfddff54dc1a727 P f48a279fe0f04bc5990869ac190ac8ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:45:05.190294 6627 tablet_replica.cc:330] T fdfec8daeaa5447b91b34c797fb4bdee P f48a279fe0f04bc5990869ac190ac8ac: stopping tablet replica
I20260619 18:45:05.190963 6627 raft_consensus.cc:2229] T fdfec8daeaa5447b91b34c797fb4bdee P f48a279fe0f04bc5990869ac190ac8ac [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:45:05.191455 6627 raft_consensus.cc:2258] T fdfec8daeaa5447b91b34c797fb4bdee P f48a279fe0f04bc5990869ac190ac8ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:45:05.196660 6627 tablet_replica.cc:330] T d4c803dfe0fb40c0afe2f25edfaa4c4d P f48a279fe0f04bc5990869ac190ac8ac: stopping tablet replica
I20260619 18:45:05.197283 6627 raft_consensus.cc:2229] T d4c803dfe0fb40c0afe2f25edfaa4c4d P f48a279fe0f04bc5990869ac190ac8ac [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:45:05.197826 6627 raft_consensus.cc:2258] T d4c803dfe0fb40c0afe2f25edfaa4c4d P f48a279fe0f04bc5990869ac190ac8ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:45:05.222842 6627 tablet_server.cc:194] TabletServer@127.6.120.193:0 shutdown complete.
I20260619 18:45:05.238121 6627 master.cc:537] Master@127.6.120.254:33029 shutting down...
I20260619 18:45:05.264402 6627 raft_consensus.cc:2229] T 00000000000000000000000000000000 P df79a535637c468c9cd2b9a9832eb4e2 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:45:05.264922 6627 raft_consensus.cc:2258] T 00000000000000000000000000000000 P df79a535637c468c9cd2b9a9832eb4e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:45:05.265225 6627 tablet_replica.cc:330] T 00000000000000000000000000000000 P df79a535637c468c9cd2b9a9832eb4e2: stopping tablet replica
I20260619 18:45:05.283041 6627 master.cc:552] Master@127.6.120.254:33029 shutdown complete.
[ OK ] ClientTest.FlushTxnSessionsOnCommit (2409 ms)
[ RUN ] ClientTest.TxnCorruptedToken
I20260619 18:45:05.315188 6627 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.120.254:34011
I20260619 18:45:05.316329 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:45:05.322088 10750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:45:05.323115 10749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:45:05.324666 10752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:45:05.327409 6627 server_base.cc:1034] running on GCE node
I20260619 18:45:05.328770 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:45:05.328959 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:45:05.329166 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894705329128 us; error 0 us; skew 500 ppm
I20260619 18:45:05.329807 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:45:05.332929 6627 webserver.cc:460] Webserver started at http://127.6.120.254:45305/ using document root <none> and password file <none>
I20260619 18:45:05.333459 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:45:05.333639 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:45:05.333896 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:45:05.334991 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TxnCorruptedToken.1781894682485826-6627-0/minicluster-data/master-0-root/instance:
uuid: "9f0b94d3ceb44cfc96e7791d6627a846"
format_stamp: "Formatted at 2026-06-19 18:45:05 on dist-test-slave-90mn"
I20260619 18:45:05.340440 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260619 18:45:05.344152 10757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:45:05.345028 6627 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260619 18:45:05.345346 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TxnCorruptedToken.1781894682485826-6627-0/minicluster-data/master-0-root
uuid: "9f0b94d3ceb44cfc96e7791d6627a846"
format_stamp: "Formatted at 2026-06-19 18:45:05 on dist-test-slave-90mn"
I20260619 18:45:05.345652 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TxnCorruptedToken.1781894682485826-6627-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TxnCorruptedToken.1781894682485826-6627-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TxnCorruptedToken.1781894682485826-6627-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:45:05.364481 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:45:05.365499 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:45:05.417009 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.254:34011
I20260619 18:45:05.417094 10818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.254:34011 every 8 connection(s)
I20260619 18:45:05.421244 10819 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:45:05.436079 10819 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f0b94d3ceb44cfc96e7791d6627a846: Bootstrap starting.
I20260619 18:45:05.441550 10819 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9f0b94d3ceb44cfc96e7791d6627a846: Neither blocks nor log segments found. Creating new log.
I20260619 18:45:05.446470 10819 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f0b94d3ceb44cfc96e7791d6627a846: No bootstrap required, opened a new log
I20260619 18:45:05.449000 10819 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9f0b94d3ceb44cfc96e7791d6627a846 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f0b94d3ceb44cfc96e7791d6627a846" member_type: VOTER }
I20260619 18:45:05.449527 10819 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9f0b94d3ceb44cfc96e7791d6627a846 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:45:05.449816 10819 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9f0b94d3ceb44cfc96e7791d6627a846 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f0b94d3ceb44cfc96e7791d6627a846, State: Initialized, Role: FOLLOWER
I20260619 18:45:05.450457 10819 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9f0b94d3ceb44cfc96e7791d6627a846 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f0b94d3ceb44cfc96e7791d6627a846" member_type: VOTER }
I20260619 18:45:05.451043 10819 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9f0b94d3ceb44cfc96e7791d6627a846 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:45:05.451325 10819 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9f0b94d3ceb44cfc96e7791d6627a846 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:45:05.451632 10819 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9f0b94d3ceb44cfc96e7791d6627a846 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:45:05.543969 10819 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9f0b94d3ceb44cfc96e7791d6627a846 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f0b94d3ceb44cfc96e7791d6627a846" member_type: VOTER }
I20260619 18:45:05.544780 10819 leader_election.cc:302] T 00000000000000000000000000000000 P 9f0b94d3ceb44cfc96e7791d6627a846 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9f0b94d3ceb44cfc96e7791d6627a846; no voters:
I20260619 18:45:05.546353 10819 leader_election.cc:288] T 00000000000000000000000000000000 P 9f0b94d3ceb44cfc96e7791d6627a846 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:45:05.546855 10822 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9f0b94d3ceb44cfc96e7791d6627a846 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:45:05.548689 10822 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9f0b94d3ceb44cfc96e7791d6627a846 [term 1 LEADER]: Becoming Leader. State: Replica: 9f0b94d3ceb44cfc96e7791d6627a846, State: Running, Role: LEADER
I20260619 18:45:05.549407 10822 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9f0b94d3ceb44cfc96e7791d6627a846 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f0b94d3ceb44cfc96e7791d6627a846" member_type: VOTER }
I20260619 18:45:05.549818 10819 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9f0b94d3ceb44cfc96e7791d6627a846 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 18:45:05.553825 10823 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f0b94d3ceb44cfc96e7791d6627a846 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9f0b94d3ceb44cfc96e7791d6627a846" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f0b94d3ceb44cfc96e7791d6627a846" member_type: VOTER } }
I20260619 18:45:05.554634 10823 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f0b94d3ceb44cfc96e7791d6627a846 [sys.catalog]: This master's current role is: LEADER
I20260619 18:45:05.563982 10828 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 18:45:05.564337 10824 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f0b94d3ceb44cfc96e7791d6627a846 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9f0b94d3ceb44cfc96e7791d6627a846. Latest consensus state: current_term: 1 leader_uuid: "9f0b94d3ceb44cfc96e7791d6627a846" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f0b94d3ceb44cfc96e7791d6627a846" member_type: VOTER } }
I20260619 18:45:05.565104 10824 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f0b94d3ceb44cfc96e7791d6627a846 [sys.catalog]: This master's current role is: LEADER
I20260619 18:45:05.570673 10828 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 18:45:05.576439 6627 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260619 18:45:05.581159 10828 catalog_manager.cc:1347] Generated new cluster ID: 3906ee2ac8784181beb9d0200c2a55fd
I20260619 18:45:05.581477 10828 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 18:45:05.603461 10828 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 18:45:05.605225 10828 catalog_manager.cc:1504] Loading token signing keys...
I20260619 18:45:05.620757 10828 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9f0b94d3ceb44cfc96e7791d6627a846: Generated new TSK 0
I20260619 18:45:05.621522 10828 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 18:45:05.643342 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:45:05.651721 10841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:45:05.653249 10842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:45:05.656425 10844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:45:05.656648 6627 server_base.cc:1034] running on GCE node
I20260619 18:45:05.657747 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:45:05.658022 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:45:05.658207 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894705658194 us; error 0 us; skew 500 ppm
I20260619 18:45:05.658833 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:45:05.662585 6627 webserver.cc:460] Webserver started at http://127.6.120.193:41517/ using document root <none> and password file <none>
I20260619 18:45:05.663067 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:45:05.663264 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:45:05.663570 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:45:05.664862 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TxnCorruptedToken.1781894682485826-6627-0/minicluster-data/ts-0-root/instance:
uuid: "9cdd19e65fc24289a343a24be4b37ae6"
format_stamp: "Formatted at 2026-06-19 18:45:05 on dist-test-slave-90mn"
I20260619 18:45:05.670032 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 18:45:05.674175 10849 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:45:05.675155 6627 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 18:45:05.675493 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TxnCorruptedToken.1781894682485826-6627-0/minicluster-data/ts-0-root
uuid: "9cdd19e65fc24289a343a24be4b37ae6"
format_stamp: "Formatted at 2026-06-19 18:45:05 on dist-test-slave-90mn"
I20260619 18:45:05.675840 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TxnCorruptedToken.1781894682485826-6627-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TxnCorruptedToken.1781894682485826-6627-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTest.TxnCorruptedToken.1781894682485826-6627-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:45:05.707197 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:45:05.708606 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:45:05.720834 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:45:05.721204 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260619 18:45:05.721534 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:45:05.721774 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:45:05.806612 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.193:33613
I20260619 18:45:05.806703 10919 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.193:33613 every 8 connection(s)
I20260619 18:45:05.811419 10920 heartbeater.cc:347] Connected to a master server at 127.6.120.254:34011
I20260619 18:45:05.811757 10920 heartbeater.cc:464] Registering TS with master...
I20260619 18:45:05.812521 10920 heartbeater.cc:511] Master 127.6.120.254:34011 requested a full tablet report, sending...
I20260619 18:45:05.814718 10774 ts_manager.cc:194] Registered new tserver with Master: 9cdd19e65fc24289a343a24be4b37ae6 (127.6.120.193:33613)
I20260619 18:45:05.814822 6627 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.004939036s
I20260619 18:45:05.817646 10774 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47060
I20260619 18:45:05.831610 10920 heartbeater.cc:503] Master 127.6.120.254:34011 was elected leader, sending a full tablet report...
I20260619 18:45:05.841080 10774 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47070:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 18:45:05.880354 10885 tablet_service.cc:1467] Processing CreateTablet for tablet 54b1bd8f037941e49c3483818bebbd8d (DEFAULT_TABLE table=client-testtb [id=587e5078fb6445f69f91489336c1075d]), partition=RANGE (key) PARTITION VALUES < 9
I20260619 18:45:05.880852 10884 tablet_service.cc:1467] Processing CreateTablet for tablet 4f245b8141294effa2e07f862b77f3c0 (DEFAULT_TABLE table=client-testtb [id=587e5078fb6445f69f91489336c1075d]), partition=RANGE (key) PARTITION 9 <= VALUES
I20260619 18:45:05.881700 10885 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54b1bd8f037941e49c3483818bebbd8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:45:05.883137 10884 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f245b8141294effa2e07f862b77f3c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:45:05.901549 10930 tablet_bootstrap.cc:492] T 54b1bd8f037941e49c3483818bebbd8d P 9cdd19e65fc24289a343a24be4b37ae6: Bootstrap starting.
I20260619 18:45:05.907328 10930 tablet_bootstrap.cc:654] T 54b1bd8f037941e49c3483818bebbd8d P 9cdd19e65fc24289a343a24be4b37ae6: Neither blocks nor log segments found. Creating new log.
I20260619 18:45:05.912163 10930 tablet_bootstrap.cc:492] T 54b1bd8f037941e49c3483818bebbd8d P 9cdd19e65fc24289a343a24be4b37ae6: No bootstrap required, opened a new log
I20260619 18:45:05.912606 10930 ts_tablet_manager.cc:1397] T 54b1bd8f037941e49c3483818bebbd8d P 9cdd19e65fc24289a343a24be4b37ae6: Time spent bootstrapping tablet: real 0.011s user 0.011s sys 0.000s
I20260619 18:45:05.914950 10930 raft_consensus.cc:348] T 54b1bd8f037941e49c3483818bebbd8d P 9cdd19e65fc24289a343a24be4b37ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cdd19e65fc24289a343a24be4b37ae6" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 33613 } }
I20260619 18:45:05.915637 10930 raft_consensus.cc:374] T 54b1bd8f037941e49c3483818bebbd8d P 9cdd19e65fc24289a343a24be4b37ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:45:05.915961 10930 raft_consensus.cc:729] T 54b1bd8f037941e49c3483818bebbd8d P 9cdd19e65fc24289a343a24be4b37ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cdd19e65fc24289a343a24be4b37ae6, State: Initialized, Role: FOLLOWER
I20260619 18:45:05.916772 10930 consensus_queue.cc:260] T 54b1bd8f037941e49c3483818bebbd8d P 9cdd19e65fc24289a343a24be4b37ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cdd19e65fc24289a343a24be4b37ae6" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 33613 } }
I20260619 18:45:05.917542 10930 raft_consensus.cc:388] T 54b1bd8f037941e49c3483818bebbd8d P 9cdd19e65fc24289a343a24be4b37ae6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:45:05.917845 10930 raft_consensus.cc:482] T 54b1bd8f037941e49c3483818bebbd8d P 9cdd19e65fc24289a343a24be4b37ae6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:45:05.918164 10930 raft_consensus.cc:3037] T 54b1bd8f037941e49c3483818bebbd8d P 9cdd19e65fc24289a343a24be4b37ae6 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:45:05.925343 10930 raft_consensus.cc:504] T 54b1bd8f037941e49c3483818bebbd8d P 9cdd19e65fc24289a343a24be4b37ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cdd19e65fc24289a343a24be4b37ae6" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 33613 } }
I20260619 18:45:05.926100 10930 leader_election.cc:302] T 54b1bd8f037941e49c3483818bebbd8d P 9cdd19e65fc24289a343a24be4b37ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9cdd19e65fc24289a343a24be4b37ae6; no voters:
I20260619 18:45:05.927599 10930 leader_election.cc:288] T 54b1bd8f037941e49c3483818bebbd8d P 9cdd19e65fc24289a343a24be4b37ae6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:45:05.928072 10932 raft_consensus.cc:2781] T 54b1bd8f037941e49c3483818bebbd8d P 9cdd19e65fc24289a343a24be4b37ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:45:05.933979 10930 ts_tablet_manager.cc:1428] T 54b1bd8f037941e49c3483818bebbd8d P 9cdd19e65fc24289a343a24be4b37ae6: Time spent starting tablet: real 0.021s user 0.015s sys 0.006s
I20260619 18:45:05.934773 10932 raft_consensus.cc:686] T 54b1bd8f037941e49c3483818bebbd8d P 9cdd19e65fc24289a343a24be4b37ae6 [term 1 LEADER]: Becoming Leader. State: Replica: 9cdd19e65fc24289a343a24be4b37ae6, State: Running, Role: LEADER
I20260619 18:45:05.935031 10930 tablet_bootstrap.cc:492] T 4f245b8141294effa2e07f862b77f3c0 P 9cdd19e65fc24289a343a24be4b37ae6: Bootstrap starting.
I20260619 18:45:05.935551 10932 consensus_queue.cc:237] T 54b1bd8f037941e49c3483818bebbd8d P 9cdd19e65fc24289a343a24be4b37ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cdd19e65fc24289a343a24be4b37ae6" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 33613 } }
I20260619 18:45:05.941210 10930 tablet_bootstrap.cc:654] T 4f245b8141294effa2e07f862b77f3c0 P 9cdd19e65fc24289a343a24be4b37ae6: Neither blocks nor log segments found. Creating new log.
I20260619 18:45:05.948073 10930 tablet_bootstrap.cc:492] T 4f245b8141294effa2e07f862b77f3c0 P 9cdd19e65fc24289a343a24be4b37ae6: No bootstrap required, opened a new log
I20260619 18:45:05.948685 10930 ts_tablet_manager.cc:1397] T 4f245b8141294effa2e07f862b77f3c0 P 9cdd19e65fc24289a343a24be4b37ae6: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.004s
I20260619 18:45:05.949002 10774 catalog_manager.cc:5495] T 54b1bd8f037941e49c3483818bebbd8d P 9cdd19e65fc24289a343a24be4b37ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cdd19e65fc24289a343a24be4b37ae6 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "9cdd19e65fc24289a343a24be4b37ae6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cdd19e65fc24289a343a24be4b37ae6" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 33613 } health_report { overall_health: HEALTHY } } }
I20260619 18:45:05.951049 10930 raft_consensus.cc:348] T 4f245b8141294effa2e07f862b77f3c0 P 9cdd19e65fc24289a343a24be4b37ae6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cdd19e65fc24289a343a24be4b37ae6" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 33613 } }
I20260619 18:45:05.951612 10930 raft_consensus.cc:374] T 4f245b8141294effa2e07f862b77f3c0 P 9cdd19e65fc24289a343a24be4b37ae6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:45:05.951874 10930 raft_consensus.cc:729] T 4f245b8141294effa2e07f862b77f3c0 P 9cdd19e65fc24289a343a24be4b37ae6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cdd19e65fc24289a343a24be4b37ae6, State: Initialized, Role: FOLLOWER
I20260619 18:45:05.952541 10930 consensus_queue.cc:260] T 4f245b8141294effa2e07f862b77f3c0 P 9cdd19e65fc24289a343a24be4b37ae6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cdd19e65fc24289a343a24be4b37ae6" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 33613 } }
I20260619 18:45:05.953018 10930 raft_consensus.cc:388] T 4f245b8141294effa2e07f862b77f3c0 P 9cdd19e65fc24289a343a24be4b37ae6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:45:05.953264 10930 raft_consensus.cc:482] T 4f245b8141294effa2e07f862b77f3c0 P 9cdd19e65fc24289a343a24be4b37ae6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:45:05.953531 10930 raft_consensus.cc:3037] T 4f245b8141294effa2e07f862b77f3c0 P 9cdd19e65fc24289a343a24be4b37ae6 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:45:05.958635 10930 raft_consensus.cc:504] T 4f245b8141294effa2e07f862b77f3c0 P 9cdd19e65fc24289a343a24be4b37ae6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cdd19e65fc24289a343a24be4b37ae6" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 33613 } }
I20260619 18:45:05.959218 10930 leader_election.cc:302] T 4f245b8141294effa2e07f862b77f3c0 P 9cdd19e65fc24289a343a24be4b37ae6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9cdd19e65fc24289a343a24be4b37ae6; no voters:
I20260619 18:45:05.959916 10932 raft_consensus.cc:2781] T 4f245b8141294effa2e07f862b77f3c0 P 9cdd19e65fc24289a343a24be4b37ae6 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:45:05.960378 10932 raft_consensus.cc:686] T 4f245b8141294effa2e07f862b77f3c0 P 9cdd19e65fc24289a343a24be4b37ae6 [term 1 LEADER]: Becoming Leader. State: Replica: 9cdd19e65fc24289a343a24be4b37ae6, State: Running, Role: LEADER
I20260619 18:45:05.960973 10930 leader_election.cc:288] T 4f245b8141294effa2e07f862b77f3c0 P 9cdd19e65fc24289a343a24be4b37ae6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:45:05.961040 10932 consensus_queue.cc:237] T 4f245b8141294effa2e07f862b77f3c0 P 9cdd19e65fc24289a343a24be4b37ae6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cdd19e65fc24289a343a24be4b37ae6" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 33613 } }
I20260619 18:45:05.963073 10930 ts_tablet_manager.cc:1428] T 4f245b8141294effa2e07f862b77f3c0 P 9cdd19e65fc24289a343a24be4b37ae6: Time spent starting tablet: real 0.014s user 0.001s sys 0.011s
I20260619 18:45:05.968551 10774 catalog_manager.cc:5495] T 4f245b8141294effa2e07f862b77f3c0 P 9cdd19e65fc24289a343a24be4b37ae6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9cdd19e65fc24289a343a24be4b37ae6 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "9cdd19e65fc24289a343a24be4b37ae6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9cdd19e65fc24289a343a24be4b37ae6" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 33613 } health_report { overall_health: HEALTHY } } }
I20260619 18:45:06.006134 6627 tablet_server.cc:178] TabletServer@127.6.120.193:0 shutting down...
I20260619 18:45:06.028898 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:45:06.029685 6627 tablet_replica.cc:330] T 4f245b8141294effa2e07f862b77f3c0 P 9cdd19e65fc24289a343a24be4b37ae6: stopping tablet replica
I20260619 18:45:06.030392 6627 raft_consensus.cc:2229] T 4f245b8141294effa2e07f862b77f3c0 P 9cdd19e65fc24289a343a24be4b37ae6 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:45:06.030818 6627 raft_consensus.cc:2258] T 4f245b8141294effa2e07f862b77f3c0 P 9cdd19e65fc24289a343a24be4b37ae6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:45:06.032997 6627 tablet_replica.cc:330] T 54b1bd8f037941e49c3483818bebbd8d P 9cdd19e65fc24289a343a24be4b37ae6: stopping tablet replica
I20260619 18:45:06.033456 6627 raft_consensus.cc:2229] T 54b1bd8f037941e49c3483818bebbd8d P 9cdd19e65fc24289a343a24be4b37ae6 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:45:06.033845 6627 raft_consensus.cc:2258] T 54b1bd8f037941e49c3483818bebbd8d P 9cdd19e65fc24289a343a24be4b37ae6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:45:06.045430 6627 tablet_server.cc:194] TabletServer@127.6.120.193:0 shutdown complete.
I20260619 18:45:06.055586 6627 master.cc:537] Master@127.6.120.254:34011 shutting down...
I20260619 18:45:06.088618 6627 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 9f0b94d3ceb44cfc96e7791d6627a846 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:45:06.089221 6627 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 9f0b94d3ceb44cfc96e7791d6627a846 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:45:06.090675 6627 tablet_replica.cc:330] T 00000000000000000000000000000000 P 9f0b94d3ceb44cfc96e7791d6627a846: stopping tablet replica
I20260619 18:45:06.112490 6627 master.cc:552] Master@127.6.120.254:34011 shutdown complete.
[ OK ] ClientTest.TxnCorruptedToken (823 ms)
[----------] 20 tests from ClientTest (23487 ms total)
[----------] 1 test from TableKeyRangeTest
[ RUN ] TableKeyRangeTest.TestGetTableKeyRange
I20260619 18:45:06.138703 6627 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.120.254:36501
I20260619 18:45:06.139716 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:45:06.145283 10939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:45:06.146296 10940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:45:06.147749 10942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:45:06.153132 6627 server_base.cc:1034] running on GCE node
I20260619 18:45:06.154186 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:45:06.154362 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:45:06.154532 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894706154520 us; error 0 us; skew 500 ppm
I20260619 18:45:06.155107 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:45:06.157845 6627 webserver.cc:460] Webserver started at http://127.6.120.254:32985/ using document root <none> and password file <none>
I20260619 18:45:06.158311 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:45:06.158517 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:45:06.158778 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:45:06.159825 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.TableKeyRangeTest.TestGetTableKeyRange.1781894682485826-6627-0/minicluster-data/master-0-root/instance:
uuid: "9ac8849341bc4dca9b41f97708342079"
format_stamp: "Formatted at 2026-06-19 18:45:06 on dist-test-slave-90mn"
I20260619 18:45:06.164422 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260619 18:45:06.167897 10947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:45:06.168738 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260619 18:45:06.169023 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.TableKeyRangeTest.TestGetTableKeyRange.1781894682485826-6627-0/minicluster-data/master-0-root
uuid: "9ac8849341bc4dca9b41f97708342079"
format_stamp: "Formatted at 2026-06-19 18:45:06 on dist-test-slave-90mn"
I20260619 18:45:06.169283 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.TableKeyRangeTest.TestGetTableKeyRange.1781894682485826-6627-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.TableKeyRangeTest.TestGetTableKeyRange.1781894682485826-6627-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.TableKeyRangeTest.TestGetTableKeyRange.1781894682485826-6627-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:45:06.194563 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:45:06.195573 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:45:06.254768 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.254:36501
I20260619 18:45:06.254864 11008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.254:36501 every 8 connection(s)
I20260619 18:45:06.259164 11009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:45:06.273694 11009 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ac8849341bc4dca9b41f97708342079: Bootstrap starting.
I20260619 18:45:06.279114 11009 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ac8849341bc4dca9b41f97708342079: Neither blocks nor log segments found. Creating new log.
I20260619 18:45:06.283716 11009 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ac8849341bc4dca9b41f97708342079: No bootstrap required, opened a new log
I20260619 18:45:06.286098 11009 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ac8849341bc4dca9b41f97708342079 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ac8849341bc4dca9b41f97708342079" member_type: VOTER }
I20260619 18:45:06.286602 11009 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9ac8849341bc4dca9b41f97708342079 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:45:06.286870 11009 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ac8849341bc4dca9b41f97708342079 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ac8849341bc4dca9b41f97708342079, State: Initialized, Role: FOLLOWER
I20260619 18:45:06.287487 11009 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ac8849341bc4dca9b41f97708342079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ac8849341bc4dca9b41f97708342079" member_type: VOTER }
I20260619 18:45:06.288079 11009 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9ac8849341bc4dca9b41f97708342079 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:45:06.288390 11009 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ac8849341bc4dca9b41f97708342079 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:45:06.288703 11009 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ac8849341bc4dca9b41f97708342079 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:45:06.295338 11009 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ac8849341bc4dca9b41f97708342079 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ac8849341bc4dca9b41f97708342079" member_type: VOTER }
I20260619 18:45:06.296051 11009 leader_election.cc:302] T 00000000000000000000000000000000 P 9ac8849341bc4dca9b41f97708342079 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ac8849341bc4dca9b41f97708342079; no voters:
I20260619 18:45:06.297374 11009 leader_election.cc:288] T 00000000000000000000000000000000 P 9ac8849341bc4dca9b41f97708342079 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:45:06.297749 11012 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9ac8849341bc4dca9b41f97708342079 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:45:06.299690 11012 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9ac8849341bc4dca9b41f97708342079 [term 1 LEADER]: Becoming Leader. State: Replica: 9ac8849341bc4dca9b41f97708342079, State: Running, Role: LEADER
I20260619 18:45:06.300438 11012 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ac8849341bc4dca9b41f97708342079 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ac8849341bc4dca9b41f97708342079" member_type: VOTER }
I20260619 18:45:06.300639 11009 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ac8849341bc4dca9b41f97708342079 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 18:45:06.303107 11014 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ac8849341bc4dca9b41f97708342079 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ac8849341bc4dca9b41f97708342079. Latest consensus state: current_term: 1 leader_uuid: "9ac8849341bc4dca9b41f97708342079" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ac8849341bc4dca9b41f97708342079" member_type: VOTER } }
I20260619 18:45:06.303738 11014 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ac8849341bc4dca9b41f97708342079 [sys.catalog]: This master's current role is: LEADER
I20260619 18:45:06.304832 11013 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ac8849341bc4dca9b41f97708342079 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9ac8849341bc4dca9b41f97708342079" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ac8849341bc4dca9b41f97708342079" member_type: VOTER } }
I20260619 18:45:06.305377 11013 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ac8849341bc4dca9b41f97708342079 [sys.catalog]: This master's current role is: LEADER
I20260619 18:45:06.315224 11017 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 18:45:06.320633 11017 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 18:45:06.324693 6627 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260619 18:45:06.330653 11017 catalog_manager.cc:1347] Generated new cluster ID: 088a874a2fa54cc69621fd510e5da3a1
I20260619 18:45:06.330955 11017 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 18:45:06.361743 11017 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 18:45:06.363899 11017 catalog_manager.cc:1504] Loading token signing keys...
I20260619 18:45:06.404049 11017 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9ac8849341bc4dca9b41f97708342079: Generated new TSK 0
I20260619 18:45:06.404737 11017 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 18:45:06.471015 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:45:06.477717 11030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:45:06.478848 11031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:45:06.481115 6627 server_base.cc:1034] running on GCE node
W20260619 18:45:06.481858 11034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:45:06.482826 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:45:06.483011 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:45:06.483197 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894706483172 us; error 0 us; skew 500 ppm
I20260619 18:45:06.483731 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:45:06.486563 6627 webserver.cc:460] Webserver started at http://127.6.120.193:36557/ using document root <none> and password file <none>
I20260619 18:45:06.487011 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:45:06.487192 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:45:06.487439 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:45:06.488571 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.TableKeyRangeTest.TestGetTableKeyRange.1781894682485826-6627-0/minicluster-data/ts-0-root/instance:
uuid: "67aa5c51d6d845d49abea1320970e12b"
format_stamp: "Formatted at 2026-06-19 18:45:06 on dist-test-slave-90mn"
I20260619 18:45:06.493180 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260619 18:45:06.496774 11038 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:45:06.497653 6627 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 18:45:06.498008 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.TableKeyRangeTest.TestGetTableKeyRange.1781894682485826-6627-0/minicluster-data/ts-0-root
uuid: "67aa5c51d6d845d49abea1320970e12b"
format_stamp: "Formatted at 2026-06-19 18:45:06 on dist-test-slave-90mn"
I20260619 18:45:06.498368 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.TableKeyRangeTest.TestGetTableKeyRange.1781894682485826-6627-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.TableKeyRangeTest.TestGetTableKeyRange.1781894682485826-6627-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.TableKeyRangeTest.TestGetTableKeyRange.1781894682485826-6627-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:45:06.519106 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:45:06.520452 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:45:06.529647 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:45:06.529942 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 18:45:06.530315 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:45:06.530591 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:45:06.600674 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.193:37901
I20260619 18:45:06.600754 11108 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.193:37901 every 8 connection(s)
I20260619 18:45:06.606225 11109 heartbeater.cc:347] Connected to a master server at 127.6.120.254:36501
I20260619 18:45:06.606753 11109 heartbeater.cc:464] Registering TS with master...
I20260619 18:45:06.607638 11109 heartbeater.cc:511] Master 127.6.120.254:36501 requested a full tablet report, sending...
I20260619 18:45:06.609894 10964 ts_manager.cc:194] Registered new tserver with Master: 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901)
I20260619 18:45:06.610642 6627 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.006140293s
I20260619 18:45:06.612461 10964 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50396
I20260619 18:45:06.626719 11109 heartbeater.cc:503] Master 127.6.120.254:36501 was elected leader, sending a full tablet report...
I20260619 18:45:06.637634 10964 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50412:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 18:45:06.679338 11073 tablet_service.cc:1467] Processing CreateTablet for tablet c679675f7d9c42e9ad71c188c7a6c595 (DEFAULT_TABLE table=client-testtb [id=5b4d4deaefa5413fac5c9f9b476d7af7]), partition=RANGE (key) PARTITION 9 <= VALUES
I20260619 18:45:06.679239 11074 tablet_service.cc:1467] Processing CreateTablet for tablet 77f5f95c233a4022baf5b4992e90172d (DEFAULT_TABLE table=client-testtb [id=5b4d4deaefa5413fac5c9f9b476d7af7]), partition=RANGE (key) PARTITION VALUES < 9
I20260619 18:45:06.680642 11073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c679675f7d9c42e9ad71c188c7a6c595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:45:06.681552 11074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77f5f95c233a4022baf5b4992e90172d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:45:06.696735 11119 tablet_bootstrap.cc:492] T c679675f7d9c42e9ad71c188c7a6c595 P 67aa5c51d6d845d49abea1320970e12b: Bootstrap starting.
I20260619 18:45:06.703498 11119 tablet_bootstrap.cc:654] T c679675f7d9c42e9ad71c188c7a6c595 P 67aa5c51d6d845d49abea1320970e12b: Neither blocks nor log segments found. Creating new log.
I20260619 18:45:06.708083 11119 tablet_bootstrap.cc:492] T c679675f7d9c42e9ad71c188c7a6c595 P 67aa5c51d6d845d49abea1320970e12b: No bootstrap required, opened a new log
I20260619 18:45:06.708554 11119 ts_tablet_manager.cc:1397] T c679675f7d9c42e9ad71c188c7a6c595 P 67aa5c51d6d845d49abea1320970e12b: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.007s
I20260619 18:45:06.710842 11119 raft_consensus.cc:348] T c679675f7d9c42e9ad71c188c7a6c595 P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67aa5c51d6d845d49abea1320970e12b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37901 } }
I20260619 18:45:06.711396 11119 raft_consensus.cc:374] T c679675f7d9c42e9ad71c188c7a6c595 P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:45:06.711687 11119 raft_consensus.cc:729] T c679675f7d9c42e9ad71c188c7a6c595 P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67aa5c51d6d845d49abea1320970e12b, State: Initialized, Role: FOLLOWER
I20260619 18:45:06.712347 11119 consensus_queue.cc:260] T c679675f7d9c42e9ad71c188c7a6c595 P 67aa5c51d6d845d49abea1320970e12b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67aa5c51d6d845d49abea1320970e12b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37901 } }
I20260619 18:45:06.712985 11119 raft_consensus.cc:388] T c679675f7d9c42e9ad71c188c7a6c595 P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:45:06.713258 11119 raft_consensus.cc:482] T c679675f7d9c42e9ad71c188c7a6c595 P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:45:06.713555 11119 raft_consensus.cc:3037] T c679675f7d9c42e9ad71c188c7a6c595 P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:45:06.720069 11119 raft_consensus.cc:504] T c679675f7d9c42e9ad71c188c7a6c595 P 67aa5c51d6d845d49abea1320970e12b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67aa5c51d6d845d49abea1320970e12b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37901 } }
I20260619 18:45:06.720779 11119 leader_election.cc:302] T c679675f7d9c42e9ad71c188c7a6c595 P 67aa5c51d6d845d49abea1320970e12b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 67aa5c51d6d845d49abea1320970e12b; no voters:
I20260619 18:45:06.722121 11119 leader_election.cc:288] T c679675f7d9c42e9ad71c188c7a6c595 P 67aa5c51d6d845d49abea1320970e12b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:45:06.722501 11121 raft_consensus.cc:2781] T c679675f7d9c42e9ad71c188c7a6c595 P 67aa5c51d6d845d49abea1320970e12b [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:45:06.724537 11119 ts_tablet_manager.cc:1428] T c679675f7d9c42e9ad71c188c7a6c595 P 67aa5c51d6d845d49abea1320970e12b: Time spent starting tablet: real 0.016s user 0.009s sys 0.007s
I20260619 18:45:06.725445 11119 tablet_bootstrap.cc:492] T 77f5f95c233a4022baf5b4992e90172d P 67aa5c51d6d845d49abea1320970e12b: Bootstrap starting.
I20260619 18:45:06.725502 11121 raft_consensus.cc:686] T c679675f7d9c42e9ad71c188c7a6c595 P 67aa5c51d6d845d49abea1320970e12b [term 1 LEADER]: Becoming Leader. State: Replica: 67aa5c51d6d845d49abea1320970e12b, State: Running, Role: LEADER
I20260619 18:45:06.726233 11121 consensus_queue.cc:237] T c679675f7d9c42e9ad71c188c7a6c595 P 67aa5c51d6d845d49abea1320970e12b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67aa5c51d6d845d49abea1320970e12b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37901 } }
I20260619 18:45:06.731387 11119 tablet_bootstrap.cc:654] T 77f5f95c233a4022baf5b4992e90172d P 67aa5c51d6d845d49abea1320970e12b: Neither blocks nor log segments found. Creating new log.
I20260619 18:45:06.737149 10964 catalog_manager.cc:5495] T c679675f7d9c42e9ad71c188c7a6c595 P 67aa5c51d6d845d49abea1320970e12b reported cstate change: term changed from 0 to 1, leader changed from <none> to 67aa5c51d6d845d49abea1320970e12b (127.6.120.193). New cstate: current_term: 1 leader_uuid: "67aa5c51d6d845d49abea1320970e12b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67aa5c51d6d845d49abea1320970e12b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37901 } health_report { overall_health: HEALTHY } } }
I20260619 18:45:06.742295 11119 tablet_bootstrap.cc:492] T 77f5f95c233a4022baf5b4992e90172d P 67aa5c51d6d845d49abea1320970e12b: No bootstrap required, opened a new log
I20260619 18:45:06.742777 11119 ts_tablet_manager.cc:1397] T 77f5f95c233a4022baf5b4992e90172d P 67aa5c51d6d845d49abea1320970e12b: Time spent bootstrapping tablet: real 0.017s user 0.010s sys 0.004s
I20260619 18:45:06.745090 11119 raft_consensus.cc:348] T 77f5f95c233a4022baf5b4992e90172d P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67aa5c51d6d845d49abea1320970e12b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37901 } }
I20260619 18:45:06.745644 11119 raft_consensus.cc:374] T 77f5f95c233a4022baf5b4992e90172d P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:45:06.745921 11119 raft_consensus.cc:729] T 77f5f95c233a4022baf5b4992e90172d P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67aa5c51d6d845d49abea1320970e12b, State: Initialized, Role: FOLLOWER
I20260619 18:45:06.746723 11119 consensus_queue.cc:260] T 77f5f95c233a4022baf5b4992e90172d P 67aa5c51d6d845d49abea1320970e12b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67aa5c51d6d845d49abea1320970e12b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37901 } }
I20260619 18:45:06.747426 11119 raft_consensus.cc:388] T 77f5f95c233a4022baf5b4992e90172d P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:45:06.747706 11119 raft_consensus.cc:482] T 77f5f95c233a4022baf5b4992e90172d P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:45:06.748041 11119 raft_consensus.cc:3037] T 77f5f95c233a4022baf5b4992e90172d P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:45:06.754570 11119 raft_consensus.cc:504] T 77f5f95c233a4022baf5b4992e90172d P 67aa5c51d6d845d49abea1320970e12b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67aa5c51d6d845d49abea1320970e12b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37901 } }
I20260619 18:45:06.755283 11119 leader_election.cc:302] T 77f5f95c233a4022baf5b4992e90172d P 67aa5c51d6d845d49abea1320970e12b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 67aa5c51d6d845d49abea1320970e12b; no voters:
I20260619 18:45:06.755875 11119 leader_election.cc:288] T 77f5f95c233a4022baf5b4992e90172d P 67aa5c51d6d845d49abea1320970e12b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:45:06.756170 11123 raft_consensus.cc:2781] T 77f5f95c233a4022baf5b4992e90172d P 67aa5c51d6d845d49abea1320970e12b [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:45:06.757180 11123 raft_consensus.cc:686] T 77f5f95c233a4022baf5b4992e90172d P 67aa5c51d6d845d49abea1320970e12b [term 1 LEADER]: Becoming Leader. State: Replica: 67aa5c51d6d845d49abea1320970e12b, State: Running, Role: LEADER
I20260619 18:45:06.757460 11119 ts_tablet_manager.cc:1428] T 77f5f95c233a4022baf5b4992e90172d P 67aa5c51d6d845d49abea1320970e12b: Time spent starting tablet: real 0.014s user 0.007s sys 0.008s
I20260619 18:45:06.757838 11123 consensus_queue.cc:237] T 77f5f95c233a4022baf5b4992e90172d P 67aa5c51d6d845d49abea1320970e12b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67aa5c51d6d845d49abea1320970e12b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37901 } }
I20260619 18:45:06.763437 10964 catalog_manager.cc:5495] T 77f5f95c233a4022baf5b4992e90172d P 67aa5c51d6d845d49abea1320970e12b reported cstate change: term changed from 0 to 1, leader changed from <none> to 67aa5c51d6d845d49abea1320970e12b (127.6.120.193). New cstate: current_term: 1 leader_uuid: "67aa5c51d6d845d49abea1320970e12b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67aa5c51d6d845d49abea1320970e12b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37901 } health_report { overall_health: HEALTHY } } }
I20260619 18:45:06.795274 10964 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50412:
name: "client-testrange"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\006\001\000\000\000\000\000\007\001\000\372\000\000\000\006\001\000\372\000\000\000\007\001\000\364\001\000\000\006\001\000\364\001\000\000\007\001\000\356\002\000\000\006\001\000\356\002\000\000\007\001\000\350\003\000\000""\006\001\000\000\000\000\000\007\001\000\372\000\000\000\006\001\000\372\000\000\000\007\001\000\364\001\000\000\006\001\000\364\001\000\000\007\001\000\356\002\000\000\006\001\000\356\002\000\000\007\001\000\350\003\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 18:45:06.823151 11074 tablet_service.cc:1467] Processing CreateTablet for tablet 4161914b7a5e40a888261cedc6398a73 (DEFAULT_TABLE table=client-testrange [id=c3ec1fd9ccbf47588ee63f98dce06785]), partition=RANGE (key) PARTITION 0 <= VALUES < 250
I20260619 18:45:06.823704 11073 tablet_service.cc:1467] Processing CreateTablet for tablet 1f02be074be240fa8534ef577aa46f77 (DEFAULT_TABLE table=client-testrange [id=c3ec1fd9ccbf47588ee63f98dce06785]), partition=RANGE (key) PARTITION 250 <= VALUES < 500
I20260619 18:45:06.824375 11074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4161914b7a5e40a888261cedc6398a73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:45:06.824942 11073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f02be074be240fa8534ef577aa46f77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:45:06.827837 11072 tablet_service.cc:1467] Processing CreateTablet for tablet d63b7834d93346288748391962132228 (DEFAULT_TABLE table=client-testrange [id=c3ec1fd9ccbf47588ee63f98dce06785]), partition=RANGE (key) PARTITION 500 <= VALUES < 750
I20260619 18:45:06.829092 11072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d63b7834d93346288748391962132228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:45:06.833096 11071 tablet_service.cc:1467] Processing CreateTablet for tablet ece711fecbcf44beae2a210da7b57926 (DEFAULT_TABLE table=client-testrange [id=c3ec1fd9ccbf47588ee63f98dce06785]), partition=RANGE (key) PARTITION 750 <= VALUES < 1000
I20260619 18:45:06.834312 11071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ece711fecbcf44beae2a210da7b57926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:45:06.844192 11119 tablet_bootstrap.cc:492] T d63b7834d93346288748391962132228 P 67aa5c51d6d845d49abea1320970e12b: Bootstrap starting.
I20260619 18:45:06.850082 11119 tablet_bootstrap.cc:654] T d63b7834d93346288748391962132228 P 67aa5c51d6d845d49abea1320970e12b: Neither blocks nor log segments found. Creating new log.
I20260619 18:45:06.853968 11119 tablet_bootstrap.cc:492] T d63b7834d93346288748391962132228 P 67aa5c51d6d845d49abea1320970e12b: No bootstrap required, opened a new log
I20260619 18:45:06.854418 11119 ts_tablet_manager.cc:1397] T d63b7834d93346288748391962132228 P 67aa5c51d6d845d49abea1320970e12b: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260619 18:45:06.857100 11119 raft_consensus.cc:348] T d63b7834d93346288748391962132228 P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67aa5c51d6d845d49abea1320970e12b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37901 } }
I20260619 18:45:06.857656 11119 raft_consensus.cc:374] T d63b7834d93346288748391962132228 P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:45:06.857931 11119 raft_consensus.cc:729] T d63b7834d93346288748391962132228 P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67aa5c51d6d845d49abea1320970e12b, State: Initialized, Role: FOLLOWER
I20260619 18:45:06.858600 11119 consensus_queue.cc:260] T d63b7834d93346288748391962132228 P 67aa5c51d6d845d49abea1320970e12b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67aa5c51d6d845d49abea1320970e12b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37901 } }
I20260619 18:45:06.859109 11119 raft_consensus.cc:388] T d63b7834d93346288748391962132228 P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:45:06.859355 11119 raft_consensus.cc:482] T d63b7834d93346288748391962132228 P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:45:06.859612 11119 raft_consensus.cc:3037] T d63b7834d93346288748391962132228 P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:45:06.867275 11119 raft_consensus.cc:504] T d63b7834d93346288748391962132228 P 67aa5c51d6d845d49abea1320970e12b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67aa5c51d6d845d49abea1320970e12b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37901 } }
I20260619 18:45:06.868021 11119 leader_election.cc:302] T d63b7834d93346288748391962132228 P 67aa5c51d6d845d49abea1320970e12b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 67aa5c51d6d845d49abea1320970e12b; no voters:
I20260619 18:45:06.868906 11123 raft_consensus.cc:2781] T d63b7834d93346288748391962132228 P 67aa5c51d6d845d49abea1320970e12b [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:45:06.869343 11123 raft_consensus.cc:686] T d63b7834d93346288748391962132228 P 67aa5c51d6d845d49abea1320970e12b [term 1 LEADER]: Becoming Leader. State: Replica: 67aa5c51d6d845d49abea1320970e12b, State: Running, Role: LEADER
I20260619 18:45:06.869645 11119 leader_election.cc:288] T d63b7834d93346288748391962132228 P 67aa5c51d6d845d49abea1320970e12b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:45:06.871420 11119 ts_tablet_manager.cc:1428] T d63b7834d93346288748391962132228 P 67aa5c51d6d845d49abea1320970e12b: Time spent starting tablet: real 0.017s user 0.006s sys 0.010s
I20260619 18:45:06.871125 11123 consensus_queue.cc:237] T d63b7834d93346288748391962132228 P 67aa5c51d6d845d49abea1320970e12b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67aa5c51d6d845d49abea1320970e12b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37901 } }
I20260619 18:45:06.876331 11119 tablet_bootstrap.cc:492] T 4161914b7a5e40a888261cedc6398a73 P 67aa5c51d6d845d49abea1320970e12b: Bootstrap starting.
I20260619 18:45:06.882488 11119 tablet_bootstrap.cc:654] T 4161914b7a5e40a888261cedc6398a73 P 67aa5c51d6d845d49abea1320970e12b: Neither blocks nor log segments found. Creating new log.
I20260619 18:45:06.951637 10953 maintenance_manager.cc:419] P 9ac8849341bc4dca9b41f97708342079: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=1.000000
I20260619 18:45:06.966702 10964 catalog_manager.cc:5495] T d63b7834d93346288748391962132228 P 67aa5c51d6d845d49abea1320970e12b reported cstate change: term changed from 0 to 1, leader changed from <none> to 67aa5c51d6d845d49abea1320970e12b (127.6.120.193). New cstate: current_term: 1 leader_uuid: "67aa5c51d6d845d49abea1320970e12b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67aa5c51d6d845d49abea1320970e12b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37901 } health_report { overall_health: HEALTHY } } }
I20260619 18:45:06.970547 11119 tablet_bootstrap.cc:492] T 4161914b7a5e40a888261cedc6398a73 P 67aa5c51d6d845d49abea1320970e12b: No bootstrap required, opened a new log
I20260619 18:45:06.971122 11119 ts_tablet_manager.cc:1397] T 4161914b7a5e40a888261cedc6398a73 P 67aa5c51d6d845d49abea1320970e12b: Time spent bootstrapping tablet: real 0.099s user 0.010s sys 0.007s
I20260619 18:45:06.974843 11119 raft_consensus.cc:348] T 4161914b7a5e40a888261cedc6398a73 P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67aa5c51d6d845d49abea1320970e12b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37901 } }
I20260619 18:45:06.977005 11119 raft_consensus.cc:374] T 4161914b7a5e40a888261cedc6398a73 P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:45:06.978839 11119 raft_consensus.cc:729] T 4161914b7a5e40a888261cedc6398a73 P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67aa5c51d6d845d49abea1320970e12b, State: Initialized, Role: FOLLOWER
I20260619 18:45:06.979570 11119 consensus_queue.cc:260] T 4161914b7a5e40a888261cedc6398a73 P 67aa5c51d6d845d49abea1320970e12b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67aa5c51d6d845d49abea1320970e12b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37901 } }
I20260619 18:45:06.980108 11119 raft_consensus.cc:388] T 4161914b7a5e40a888261cedc6398a73 P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:45:06.980376 11119 raft_consensus.cc:482] T 4161914b7a5e40a888261cedc6398a73 P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:45:06.980643 11119 raft_consensus.cc:3037] T 4161914b7a5e40a888261cedc6398a73 P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:45:06.989351 11119 raft_consensus.cc:504] T 4161914b7a5e40a888261cedc6398a73 P 67aa5c51d6d845d49abea1320970e12b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67aa5c51d6d845d49abea1320970e12b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37901 } }
I20260619 18:45:06.990681 11119 leader_election.cc:302] T 4161914b7a5e40a888261cedc6398a73 P 67aa5c51d6d845d49abea1320970e12b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 67aa5c51d6d845d49abea1320970e12b; no voters:
I20260619 18:45:06.991508 11123 raft_consensus.cc:2781] T 4161914b7a5e40a888261cedc6398a73 P 67aa5c51d6d845d49abea1320970e12b [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:45:06.991977 11123 raft_consensus.cc:686] T 4161914b7a5e40a888261cedc6398a73 P 67aa5c51d6d845d49abea1320970e12b [term 1 LEADER]: Becoming Leader. State: Replica: 67aa5c51d6d845d49abea1320970e12b, State: Running, Role: LEADER
I20260619 18:45:06.992759 11123 consensus_queue.cc:237] T 4161914b7a5e40a888261cedc6398a73 P 67aa5c51d6d845d49abea1320970e12b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67aa5c51d6d845d49abea1320970e12b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37901 } }
I20260619 18:45:06.997540 11119 leader_election.cc:288] T 4161914b7a5e40a888261cedc6398a73 P 67aa5c51d6d845d49abea1320970e12b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:45:07.002874 11119 ts_tablet_manager.cc:1428] T 4161914b7a5e40a888261cedc6398a73 P 67aa5c51d6d845d49abea1320970e12b: Time spent starting tablet: real 0.031s user 0.013s sys 0.001s
I20260619 18:45:07.003813 11119 tablet_bootstrap.cc:492] T ece711fecbcf44beae2a210da7b57926 P 67aa5c51d6d845d49abea1320970e12b: Bootstrap starting.
I20260619 18:45:07.005000 10964 catalog_manager.cc:5495] T 4161914b7a5e40a888261cedc6398a73 P 67aa5c51d6d845d49abea1320970e12b reported cstate change: term changed from 0 to 1, leader changed from <none> to 67aa5c51d6d845d49abea1320970e12b (127.6.120.193). New cstate: current_term: 1 leader_uuid: "67aa5c51d6d845d49abea1320970e12b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67aa5c51d6d845d49abea1320970e12b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37901 } health_report { overall_health: HEALTHY } } }
I20260619 18:45:07.009760 11119 tablet_bootstrap.cc:654] T ece711fecbcf44beae2a210da7b57926 P 67aa5c51d6d845d49abea1320970e12b: Neither blocks nor log segments found. Creating new log.
I20260619 18:45:07.050107 11119 tablet_bootstrap.cc:492] T ece711fecbcf44beae2a210da7b57926 P 67aa5c51d6d845d49abea1320970e12b: No bootstrap required, opened a new log
I20260619 18:45:07.050523 11119 ts_tablet_manager.cc:1397] T ece711fecbcf44beae2a210da7b57926 P 67aa5c51d6d845d49abea1320970e12b: Time spent bootstrapping tablet: real 0.047s user 0.027s sys 0.015s
I20260619 18:45:07.052438 11119 raft_consensus.cc:348] T ece711fecbcf44beae2a210da7b57926 P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67aa5c51d6d845d49abea1320970e12b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37901 } }
I20260619 18:45:07.052937 11119 raft_consensus.cc:374] T ece711fecbcf44beae2a210da7b57926 P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:45:07.053170 11119 raft_consensus.cc:729] T ece711fecbcf44beae2a210da7b57926 P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67aa5c51d6d845d49abea1320970e12b, State: Initialized, Role: FOLLOWER
I20260619 18:45:07.053750 11119 consensus_queue.cc:260] T ece711fecbcf44beae2a210da7b57926 P 67aa5c51d6d845d49abea1320970e12b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67aa5c51d6d845d49abea1320970e12b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37901 } }
I20260619 18:45:07.054242 11119 raft_consensus.cc:388] T ece711fecbcf44beae2a210da7b57926 P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:45:07.054483 11119 raft_consensus.cc:482] T ece711fecbcf44beae2a210da7b57926 P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:45:07.054749 11119 raft_consensus.cc:3037] T ece711fecbcf44beae2a210da7b57926 P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:45:07.061041 11119 raft_consensus.cc:504] T ece711fecbcf44beae2a210da7b57926 P 67aa5c51d6d845d49abea1320970e12b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67aa5c51d6d845d49abea1320970e12b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37901 } }
I20260619 18:45:07.061740 11119 leader_election.cc:302] T ece711fecbcf44beae2a210da7b57926 P 67aa5c51d6d845d49abea1320970e12b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 67aa5c51d6d845d49abea1320970e12b; no voters:
I20260619 18:45:07.062255 11119 leader_election.cc:288] T ece711fecbcf44beae2a210da7b57926 P 67aa5c51d6d845d49abea1320970e12b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:45:07.062400 11121 raft_consensus.cc:2781] T ece711fecbcf44beae2a210da7b57926 P 67aa5c51d6d845d49abea1320970e12b [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:45:07.062855 11121 raft_consensus.cc:686] T ece711fecbcf44beae2a210da7b57926 P 67aa5c51d6d845d49abea1320970e12b [term 1 LEADER]: Becoming Leader. State: Replica: 67aa5c51d6d845d49abea1320970e12b, State: Running, Role: LEADER
I20260619 18:45:07.063509 11121 consensus_queue.cc:237] T ece711fecbcf44beae2a210da7b57926 P 67aa5c51d6d845d49abea1320970e12b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67aa5c51d6d845d49abea1320970e12b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37901 } }
I20260619 18:45:07.064400 11119 ts_tablet_manager.cc:1428] T ece711fecbcf44beae2a210da7b57926 P 67aa5c51d6d845d49abea1320970e12b: Time spent starting tablet: real 0.014s user 0.014s sys 0.001s
I20260619 18:45:07.065217 11119 tablet_bootstrap.cc:492] T 1f02be074be240fa8534ef577aa46f77 P 67aa5c51d6d845d49abea1320970e12b: Bootstrap starting.
I20260619 18:45:07.071475 11119 tablet_bootstrap.cc:654] T 1f02be074be240fa8534ef577aa46f77 P 67aa5c51d6d845d49abea1320970e12b: Neither blocks nor log segments found. Creating new log.
I20260619 18:45:07.071022 10952 maintenance_manager.cc:643] P 9ac8849341bc4dca9b41f97708342079: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.118s user 0.067s sys 0.041s Metrics: {"bytes_written":8377,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":53553,"dirs.run_cpu_time_us":371,"dirs.run_wall_time_us":854,"drs_written":1,"lbm_read_time_us":309,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3057,"lbm_writes_lt_1ms":31,"peak_mem_usage":0,"reinsert_count":0,"rows_written":11,"thread_start_us":53207,"threads_started":1,"update_count":4}
I20260619 18:45:07.075541 10953 maintenance_manager.cc:419] P 9ac8849341bc4dca9b41f97708342079: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.131427
I20260619 18:45:07.084542 10964 catalog_manager.cc:5495] T ece711fecbcf44beae2a210da7b57926 P 67aa5c51d6d845d49abea1320970e12b reported cstate change: term changed from 0 to 1, leader changed from <none> to 67aa5c51d6d845d49abea1320970e12b (127.6.120.193). New cstate: current_term: 1 leader_uuid: "67aa5c51d6d845d49abea1320970e12b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67aa5c51d6d845d49abea1320970e12b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37901 } health_report { overall_health: HEALTHY } } }
I20260619 18:45:07.086654 11119 tablet_bootstrap.cc:492] T 1f02be074be240fa8534ef577aa46f77 P 67aa5c51d6d845d49abea1320970e12b: No bootstrap required, opened a new log
I20260619 18:45:07.087112 11119 ts_tablet_manager.cc:1397] T 1f02be074be240fa8534ef577aa46f77 P 67aa5c51d6d845d49abea1320970e12b: Time spent bootstrapping tablet: real 0.022s user 0.006s sys 0.012s
I20260619 18:45:07.093369 11119 raft_consensus.cc:348] T 1f02be074be240fa8534ef577aa46f77 P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67aa5c51d6d845d49abea1320970e12b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37901 } }
I20260619 18:45:07.094036 11119 raft_consensus.cc:374] T 1f02be074be240fa8534ef577aa46f77 P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:45:07.094318 11119 raft_consensus.cc:729] T 1f02be074be240fa8534ef577aa46f77 P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67aa5c51d6d845d49abea1320970e12b, State: Initialized, Role: FOLLOWER
I20260619 18:45:07.095062 11119 consensus_queue.cc:260] T 1f02be074be240fa8534ef577aa46f77 P 67aa5c51d6d845d49abea1320970e12b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67aa5c51d6d845d49abea1320970e12b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37901 } }
I20260619 18:45:07.095742 11119 raft_consensus.cc:388] T 1f02be074be240fa8534ef577aa46f77 P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:45:07.096045 11119 raft_consensus.cc:482] T 1f02be074be240fa8534ef577aa46f77 P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:45:07.096395 11119 raft_consensus.cc:3037] T 1f02be074be240fa8534ef577aa46f77 P 67aa5c51d6d845d49abea1320970e12b [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:45:07.103209 11119 raft_consensus.cc:504] T 1f02be074be240fa8534ef577aa46f77 P 67aa5c51d6d845d49abea1320970e12b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67aa5c51d6d845d49abea1320970e12b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37901 } }
I20260619 18:45:07.103921 11119 leader_election.cc:302] T 1f02be074be240fa8534ef577aa46f77 P 67aa5c51d6d845d49abea1320970e12b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 67aa5c51d6d845d49abea1320970e12b; no voters:
I20260619 18:45:07.104686 11121 raft_consensus.cc:2781] T 1f02be074be240fa8534ef577aa46f77 P 67aa5c51d6d845d49abea1320970e12b [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:45:07.105129 11121 raft_consensus.cc:686] T 1f02be074be240fa8534ef577aa46f77 P 67aa5c51d6d845d49abea1320970e12b [term 1 LEADER]: Becoming Leader. State: Replica: 67aa5c51d6d845d49abea1320970e12b, State: Running, Role: LEADER
I20260619 18:45:07.105770 11121 consensus_queue.cc:237] T 1f02be074be240fa8534ef577aa46f77 P 67aa5c51d6d845d49abea1320970e12b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67aa5c51d6d845d49abea1320970e12b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37901 } }
I20260619 18:45:07.107867 11119 leader_election.cc:288] T 1f02be074be240fa8534ef577aa46f77 P 67aa5c51d6d845d49abea1320970e12b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:45:07.109712 11119 ts_tablet_manager.cc:1428] T 1f02be074be240fa8534ef577aa46f77 P 67aa5c51d6d845d49abea1320970e12b: Time spent starting tablet: real 0.022s user 0.015s sys 0.000s
I20260619 18:45:07.113511 10964 catalog_manager.cc:5495] T 1f02be074be240fa8534ef577aa46f77 P 67aa5c51d6d845d49abea1320970e12b reported cstate change: term changed from 0 to 1, leader changed from <none> to 67aa5c51d6d845d49abea1320970e12b (127.6.120.193). New cstate: current_term: 1 leader_uuid: "67aa5c51d6d845d49abea1320970e12b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67aa5c51d6d845d49abea1320970e12b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 37901 } health_report { overall_health: HEALTHY } } }
I20260619 18:45:07.117200 10952 maintenance_manager.cc:643] P 9ac8849341bc4dca9b41f97708342079: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.041s user 0.029s sys 0.008s Metrics: {"cfile_cache_miss":5,"cfile_cache_miss_bytes":2986,"cfile_init":5,"delete_count":0,"delta_blocks_compacted":1,"delta_iterators_relevant":1,"dirs.queue_time_us":720,"dirs.run_cpu_time_us":417,"dirs.run_wall_time_us":1388,"lbm_read_time_us":1889,"lbm_reads_lt_1ms":25,"lbm_write_time_us":999,"lbm_writes_lt_1ms":9,"reinsert_count":0,"thread_start_us":7426,"threads_started":1,"update_count":4}
I20260619 18:45:07.119426 10953 maintenance_manager.cc:419] P 9ac8849341bc4dca9b41f97708342079: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 585 bytes on disk
I20260619 18:45:07.121417 10952 maintenance_manager.cc:643] P 9ac8849341bc4dca9b41f97708342079: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":401,"lbm_reads_lt_1ms":4}
I20260619 18:45:07.122785 10953 maintenance_manager.cc:419] P 9ac8849341bc4dca9b41f97708342079: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=1.000000
I20260619 18:45:07.135777 10952 maintenance_manager.cc:643] P 9ac8849341bc4dca9b41f97708342079: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.012s user 0.011s sys 0.000s Metrics: {"bytes_written":408,"delete_count":0,"lbm_write_time_us":434,"lbm_writes_lt_1ms":4,"reinsert_count":0,"update_count":2}
I20260619 18:45:07.138330 10953 maintenance_manager.cc:419] P 9ac8849341bc4dca9b41f97708342079: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=1.000000
I20260619 18:45:07.149117 10952 maintenance_manager.cc:643] P 9ac8849341bc4dca9b41f97708342079: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.010s user 0.009s sys 0.000s Metrics: {"bytes_written":345,"delete_count":0,"lbm_write_time_us":482,"lbm_writes_lt_1ms":4,"reinsert_count":0,"update_count":1}
I20260619 18:45:07.150440 10953 maintenance_manager.cc:419] P 9ac8849341bc4dca9b41f97708342079: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.224040
I20260619 18:45:07.180470 10952 maintenance_manager.cc:643] P 9ac8849341bc4dca9b41f97708342079: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.029s user 0.029s sys 0.000s Metrics: {"cfile_cache_miss":7,"cfile_cache_miss_bytes":3280,"cfile_init":6,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":249,"lbm_read_time_us":1995,"lbm_reads_lt_1ms":31,"lbm_write_time_us":899,"lbm_writes_lt_1ms":9,"mutex_wait_us":50,"reinsert_count":0,"update_count":3}
I20260619 18:45:07.182555 10953 maintenance_manager.cc:419] P 9ac8849341bc4dca9b41f97708342079: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260619 18:45:07.183295 10952 maintenance_manager.cc:643] P 9ac8849341bc4dca9b41f97708342079: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {}
W20260619 18:45:07.381429 11005 debug-util.cc:398] Leaking SignalData structure 0x7b0800094f60 after lost signal to thread 6630
I20260619 18:45:07.465878 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:07.559494 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.093s user 0.051s sys 0.012s Metrics: {"bytes_written":4653,"cfile_init":1,"dirs.queue_time_us":17481,"dirs.run_cpu_time_us":292,"dirs.run_wall_time_us":3617,"drs_written":1,"lbm_read_time_us":995,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2371,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":24,"thread_start_us":10580,"threads_started":1}
I20260619 18:45:07.568755 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:07.609390 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.040s user 0.029s sys 0.007s Metrics: {"bytes_written":4629,"cfile_init":1,"dirs.queue_time_us":83,"dirs.run_cpu_time_us":288,"dirs.run_wall_time_us":5354,"drs_written":1,"lbm_read_time_us":302,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2576,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":8}
I20260619 18:45:07.613497 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:07.663542 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.049s user 0.032s sys 0.004s Metrics: {"bytes_written":4631,"cfile_init":1,"dirs.queue_time_us":96,"dirs.run_cpu_time_us":260,"dirs.run_wall_time_us":1539,"drs_written":1,"lbm_read_time_us":3702,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":3,"lbm_write_time_us":2661,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":4}
I20260619 18:45:07.674466 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:07.735422 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.060s user 0.036s sys 0.000s Metrics: {"bytes_written":4631,"cfile_init":1,"dirs.queue_time_us":87,"dirs.run_cpu_time_us":275,"dirs.run_wall_time_us":6502,"drs_written":1,"lbm_read_time_us":266,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2568,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":5,"spinlock_wait_cycles":19328}
I20260619 18:45:07.739652 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73): 1041 bytes on disk
I20260619 18:45:07.743556 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.003s user 0.000s sys 0.000s Metrics: {"cfile_init":4,"lbm_read_time_us":1053,"lbm_reads_lt_1ms":16}
I20260619 18:45:07.747146 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:07.804801 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.052s user 0.036s sys 0.000s Metrics: {"bytes_written":4631,"cfile_init":1,"dirs.queue_time_us":88,"dirs.run_cpu_time_us":265,"dirs.run_wall_time_us":1288,"drs_written":1,"lbm_read_time_us":262,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2290,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:07.808848 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73): 214 bytes on disk
I20260619 18:45:07.816599 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.001s user 0.001s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":301,"lbm_reads_lt_1ms":4}
I20260619 18:45:07.820312 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:07.880483 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.059s user 0.037s sys 0.000s Metrics: {"bytes_written":4631,"cfile_init":1,"dirs.queue_time_us":83,"dirs.run_cpu_time_us":282,"dirs.run_wall_time_us":3424,"drs_written":1,"lbm_read_time_us":299,"lbm_reads_lt_1ms":4,"lbm_write_time_us":7167,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"rows_written":6,"spinlock_wait_cycles":11008}
I20260619 18:45:07.885159 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:07.952620 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.061s user 0.036s sys 0.003s Metrics: {"bytes_written":4631,"cfile_init":1,"dirs.queue_time_us":307,"dirs.run_cpu_time_us":267,"dirs.run_wall_time_us":1397,"drs_written":1,"lbm_read_time_us":283,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2509,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":7}
I20260619 18:45:07.957104 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:08.019948 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.062s user 0.039s sys 0.000s Metrics: {"bytes_written":4632,"cfile_init":1,"dirs.queue_time_us":87,"dirs.run_cpu_time_us":269,"dirs.run_wall_time_us":1406,"drs_written":1,"lbm_read_time_us":269,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2432,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":5}
I20260619 18:45:08.024644 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:08.092479 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.062s user 0.041s sys 0.000s Metrics: {"bytes_written":4632,"cfile_init":1,"dirs.queue_time_us":398,"dirs.run_cpu_time_us":303,"dirs.run_wall_time_us":3060,"drs_written":1,"lbm_read_time_us":291,"lbm_reads_lt_1ms":4,"lbm_write_time_us":7208,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:08.097247 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:08.159718 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.062s user 0.038s sys 0.000s Metrics: {"bytes_written":4632,"cfile_init":1,"dirs.queue_time_us":868,"dirs.run_cpu_time_us":242,"dirs.run_wall_time_us":1354,"drs_written":1,"lbm_read_time_us":265,"lbm_reads_lt_1ms":4,"lbm_write_time_us":8690,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:08.164424 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:08.233319 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.063s user 0.033s sys 0.008s Metrics: {"bytes_written":4632,"cfile_init":1,"dirs.queue_time_us":84,"dirs.run_cpu_time_us":248,"dirs.run_wall_time_us":2530,"drs_written":1,"lbm_read_time_us":288,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2327,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:08.238246 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73): 1291 bytes on disk
I20260619 18:45:08.243706 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.005s user 0.001s sys 0.000s Metrics: {"cfile_init":6,"lbm_read_time_us":1432,"lbm_reads_lt_1ms":24}
I20260619 18:45:08.247632 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:08.323216 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.072s user 0.039s sys 0.000s Metrics: {"bytes_written":4632,"cfile_init":1,"dirs.queue_time_us":7217,"dirs.run_cpu_time_us":318,"dirs.run_wall_time_us":1932,"drs_written":1,"lbm_read_time_us":380,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2408,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":7}
I20260619 18:45:08.328150 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73): 223 bytes on disk
I20260619 18:45:08.337967 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.002s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":295,"lbm_reads_lt_1ms":4}
I20260619 18:45:08.344185 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:08.444146 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.099s user 0.035s sys 0.008s Metrics: {"bytes_written":4632,"cfile_init":1,"dirs.queue_time_us":74,"dirs.run_cpu_time_us":259,"dirs.run_wall_time_us":1506,"drs_written":1,"lbm_read_time_us":270,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2181,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":4,"spinlock_wait_cycles":22400}
I20260619 18:45:08.452874 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:08.525597 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.064s user 0.039s sys 0.000s Metrics: {"bytes_written":4632,"cfile_init":1,"dirs.queue_time_us":94,"dirs.run_cpu_time_us":243,"dirs.run_wall_time_us":1414,"drs_written":1,"lbm_read_time_us":256,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2303,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":8}
I20260619 18:45:08.530349 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73): 428 bytes on disk
I20260619 18:45:08.537931 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.003s user 0.001s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":552,"lbm_reads_lt_1ms":8}
I20260619 18:45:08.541911 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:08.603837 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.061s user 0.036s sys 0.003s Metrics: {"bytes_written":4632,"cfile_init":1,"dirs.queue_time_us":83,"dirs.run_cpu_time_us":242,"dirs.run_wall_time_us":1535,"drs_written":1,"lbm_read_time_us":305,"lbm_reads_lt_1ms":4,"lbm_write_time_us":6325,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"rows_written":8}
I20260619 18:45:08.608801 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:08.653772 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.044s user 0.033s sys 0.004s Metrics: {"bytes_written":4632,"cfile_init":1,"dirs.queue_time_us":90,"dirs.run_cpu_time_us":263,"dirs.run_wall_time_us":1623,"drs_written":1,"lbm_read_time_us":275,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2313,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6,"spinlock_wait_cycles":14208}
I20260619 18:45:08.659093 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73): 446 bytes on disk
I20260619 18:45:08.662535 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.002s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":522,"lbm_reads_lt_1ms":8}
I20260619 18:45:08.666819 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:08.714882 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.047s user 0.039s sys 0.000s Metrics: {"bytes_written":4632,"cfile_init":1,"dirs.queue_time_us":80,"dirs.run_cpu_time_us":243,"dirs.run_wall_time_us":1278,"drs_written":1,"lbm_read_time_us":245,"lbm_reads_lt_1ms":4,"lbm_write_time_us":4815,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"rows_written":4}
I20260619 18:45:08.719892 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73): 196 bytes on disk
I20260619 18:45:08.723858 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.003s user 0.001s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":1232,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":3}
I20260619 18:45:08.728471 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:08.774276 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.045s user 0.039s sys 0.000s Metrics: {"bytes_written":4632,"cfile_init":1,"dirs.queue_time_us":76,"dirs.run_cpu_time_us":281,"dirs.run_wall_time_us":1619,"drs_written":1,"lbm_read_time_us":253,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2143,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":4}
I20260619 18:45:08.779460 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73): 196 bytes on disk
I20260619 18:45:08.782460 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.002s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":285,"lbm_reads_lt_1ms":4}
I20260619 18:45:08.786445 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:08.830049 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.043s user 0.040s sys 0.000s Metrics: {"bytes_written":4630,"cfile_init":1,"dirs.queue_time_us":78,"dirs.run_cpu_time_us":243,"dirs.run_wall_time_us":1420,"drs_written":1,"lbm_read_time_us":256,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2109,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":4}
I20260619 18:45:08.835139 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73): 196 bytes on disk
I20260619 18:45:08.838127 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.002s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":282,"lbm_reads_lt_1ms":4}
I20260619 18:45:08.842271 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:08.887344 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.044s user 0.036s sys 0.004s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":106,"dirs.run_cpu_time_us":240,"dirs.run_wall_time_us":1352,"drs_written":1,"lbm_read_time_us":258,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2125,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":4}
I20260619 18:45:08.892745 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73): 196 bytes on disk
I20260619 18:45:08.895761 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.002s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":272,"lbm_reads_lt_1ms":4}
I20260619 18:45:08.900279 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:08.946316 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.045s user 0.042s sys 0.000s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":80,"dirs.run_cpu_time_us":240,"dirs.run_wall_time_us":1440,"drs_written":1,"lbm_read_time_us":248,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2188,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":4}
I20260619 18:45:08.952216 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73): 196 bytes on disk
I20260619 18:45:08.955408 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.002s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":254,"lbm_reads_lt_1ms":4}
I20260619 18:45:08.959590 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:09.005162 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.045s user 0.043s sys 0.000s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":82,"dirs.run_cpu_time_us":284,"dirs.run_wall_time_us":1246,"drs_written":1,"lbm_read_time_us":252,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2306,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":3}
I20260619 18:45:09.010547 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73): 185 bytes on disk
I20260619 18:45:09.014133 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.003s user 0.001s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":353,"lbm_reads_lt_1ms":4}
I20260619 18:45:09.019515 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:09.075582 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.055s user 0.044s sys 0.001s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":1113,"dirs.run_cpu_time_us":285,"dirs.run_wall_time_us":1436,"drs_written":1,"lbm_read_time_us":238,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2315,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":4}
I20260619 18:45:09.081034 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73): 196 bytes on disk
I20260619 18:45:09.084004 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.002s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":275,"lbm_reads_lt_1ms":4}
I20260619 18:45:09.088235 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:09.141604 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.051s user 0.042s sys 0.003s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":83,"dirs.run_cpu_time_us":265,"dirs.run_wall_time_us":1672,"drs_written":1,"lbm_read_time_us":251,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2314,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":5,"spinlock_wait_cycles":21888}
I20260619 18:45:09.146727 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:09.195284 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.048s user 0.044s sys 0.000s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":119,"dirs.run_cpu_time_us":304,"dirs.run_wall_time_us":1332,"drs_written":1,"lbm_read_time_us":248,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2087,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":3}
I20260619 18:45:09.200918 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73): 397 bytes on disk
I20260619 18:45:09.204726 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.003s user 0.003s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":516,"lbm_reads_lt_1ms":8}
I20260619 18:45:09.208546 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:09.256381 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.047s user 0.046s sys 0.000s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":727,"dirs.run_cpu_time_us":225,"dirs.run_wall_time_us":2628,"drs_written":1,"lbm_read_time_us":262,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2196,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":4}
I20260619 18:45:09.261680 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73): 196 bytes on disk
I20260619 18:45:09.265250 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.003s user 0.002s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":306,"lbm_reads_lt_1ms":4}
I20260619 18:45:09.269274 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:09.321712 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.052s user 0.040s sys 0.008s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":85,"dirs.run_cpu_time_us":265,"dirs.run_wall_time_us":12628,"drs_written":1,"lbm_read_time_us":420,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2110,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":4}
I20260619 18:45:09.327236 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73): 196 bytes on disk
I20260619 18:45:09.331243 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.003s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":289,"lbm_reads_lt_1ms":4}
I20260619 18:45:09.335481 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:09.387773 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.051s user 0.047s sys 0.000s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":81,"dirs.run_cpu_time_us":244,"dirs.run_wall_time_us":3262,"drs_written":1,"lbm_read_time_us":269,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2135,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":3}
I20260619 18:45:09.394538 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:09.470665 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.075s user 0.051s sys 0.000s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":2330,"dirs.run_cpu_time_us":275,"dirs.run_wall_time_us":2111,"drs_written":1,"lbm_read_time_us":251,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2928,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":3}
I20260619 18:45:09.479401 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:09.538992 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.059s user 0.052s sys 0.000s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":97,"dirs.run_cpu_time_us":267,"dirs.run_wall_time_us":1526,"drs_written":1,"lbm_read_time_us":283,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2352,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":4,"spinlock_wait_cycles":29568}
I20260619 18:45:09.546202 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73): 566 bytes on disk
I20260619 18:45:09.551120 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.004s user 0.001s sys 0.000s Metrics: {"cfile_init":3,"lbm_read_time_us":691,"lbm_reads_lt_1ms":12}
I20260619 18:45:09.555469 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:09.606786 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.051s user 0.044s sys 0.003s Metrics: {"bytes_written":4631,"cfile_init":1,"dirs.queue_time_us":81,"dirs.run_cpu_time_us":248,"dirs.run_wall_time_us":1319,"drs_written":1,"lbm_read_time_us":255,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2056,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":4}
I20260619 18:45:09.613304 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:09.668601 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.054s user 0.048s sys 0.004s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":97,"dirs.run_cpu_time_us":249,"dirs.run_wall_time_us":5937,"drs_written":1,"lbm_read_time_us":251,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2293,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":4}
I20260619 18:45:09.674337 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:09.728732 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.054s user 0.052s sys 0.000s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":74,"dirs.run_cpu_time_us":238,"dirs.run_wall_time_us":3074,"drs_written":1,"lbm_read_time_us":246,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2043,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":4}
I20260619 18:45:09.734540 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:09.789027 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.054s user 0.049s sys 0.004s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":83,"dirs.run_cpu_time_us":246,"dirs.run_wall_time_us":1187,"drs_written":1,"lbm_read_time_us":239,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2176,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":3}
I20260619 18:45:09.794878 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73): 773 bytes on disk
I20260619 18:45:09.800299 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.005s user 0.005s sys 0.000s Metrics: {"cfile_init":4,"lbm_read_time_us":897,"lbm_reads_lt_1ms":16}
I20260619 18:45:09.804603 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:09.865064 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.060s user 0.054s sys 0.000s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":817,"dirs.run_cpu_time_us":243,"dirs.run_wall_time_us":1804,"drs_written":1,"lbm_read_time_us":257,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2389,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":5}
I20260619 18:45:09.871066 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:09.929073 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.057s user 0.051s sys 0.004s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":82,"dirs.run_cpu_time_us":242,"dirs.run_wall_time_us":2248,"drs_written":1,"lbm_read_time_us":268,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2096,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":4}
I20260619 18:45:09.935058 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:09.997288 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.061s user 0.055s sys 0.000s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":89,"dirs.run_cpu_time_us":249,"dirs.run_wall_time_us":1382,"drs_written":1,"lbm_read_time_us":256,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2173,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":4}
I20260619 18:45:10.003479 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73): 604 bytes on disk
I20260619 18:45:10.008464 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.004s user 0.004s sys 0.000s Metrics: {"cfile_init":3,"lbm_read_time_us":708,"lbm_reads_lt_1ms":12}
I20260619 18:45:10.013604 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:10.077951 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.064s user 0.057s sys 0.000s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":77,"dirs.run_cpu_time_us":244,"dirs.run_wall_time_us":1281,"drs_written":1,"lbm_read_time_us":263,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2211,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:10.084247 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73): 214 bytes on disk
I20260619 18:45:10.088204 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.003s user 0.003s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":257,"lbm_reads_lt_1ms":4}
I20260619 18:45:10.093729 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:10.152740 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.058s user 0.057s sys 0.000s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":73,"dirs.run_cpu_time_us":252,"dirs.run_wall_time_us":1291,"drs_written":1,"lbm_read_time_us":257,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2217,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":5}
I20260619 18:45:10.159101 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73): 212 bytes on disk
I20260619 18:45:10.162988 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.003s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":262,"lbm_reads_lt_1ms":4}
I20260619 18:45:10.167933 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:10.225869 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.057s user 0.055s sys 0.000s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":89,"dirs.run_cpu_time_us":229,"dirs.run_wall_time_us":2280,"drs_written":1,"lbm_read_time_us":238,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2100,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":4,"spinlock_wait_cycles":11008}
I20260619 18:45:10.232364 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:10.292645 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.060s user 0.058s sys 0.000s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":78,"dirs.run_cpu_time_us":239,"dirs.run_wall_time_us":1369,"drs_written":1,"lbm_read_time_us":278,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2103,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":4}
I20260619 18:45:10.300266 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:10.363911 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.063s user 0.055s sys 0.000s Metrics: {"bytes_written":4631,"cfile_init":1,"dirs.queue_time_us":1163,"dirs.run_cpu_time_us":221,"dirs.run_wall_time_us":1792,"drs_written":1,"lbm_read_time_us":248,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2025,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":4}
I20260619 18:45:10.370519 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73): 588 bytes on disk
I20260619 18:45:10.375972 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.005s user 0.001s sys 0.000s Metrics: {"cfile_init":3,"lbm_read_time_us":701,"lbm_reads_lt_1ms":12}
I20260619 18:45:10.381047 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:10.443162 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.061s user 0.057s sys 0.000s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":1345,"dirs.run_cpu_time_us":238,"dirs.run_wall_time_us":2797,"drs_written":1,"lbm_read_time_us":259,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2171,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:10.449714 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73): 214 bytes on disk
I20260619 18:45:10.454375 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.004s user 0.002s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":272,"lbm_reads_lt_1ms":4}
I20260619 18:45:10.459771 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:10.525282 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.065s user 0.060s sys 0.000s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":96,"dirs.run_cpu_time_us":225,"dirs.run_wall_time_us":2085,"drs_written":1,"lbm_read_time_us":257,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2102,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":4}
I20260619 18:45:10.532164 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73): 196 bytes on disk
I20260619 18:45:10.536463 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.003s user 0.003s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":266,"lbm_reads_lt_1ms":4}
I20260619 18:45:10.541620 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:10.606446 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.064s user 0.054s sys 0.008s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":79,"dirs.run_cpu_time_us":259,"dirs.run_wall_time_us":1631,"drs_written":1,"lbm_read_time_us":241,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2077,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":5}
I20260619 18:45:10.613556 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73): 212 bytes on disk
I20260619 18:45:10.619668 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.005s user 0.004s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":324,"lbm_reads_lt_1ms":4}
I20260619 18:45:10.625133 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:10.688980 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.063s user 0.060s sys 0.000s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":75,"dirs.run_cpu_time_us":244,"dirs.run_wall_time_us":1274,"drs_written":1,"lbm_read_time_us":253,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2021,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":5}
I20260619 18:45:10.697022 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73): 212 bytes on disk
I20260619 18:45:10.702368 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.005s user 0.002s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":300,"lbm_reads_lt_1ms":4}
I20260619 18:45:10.707942 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:10.773288 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.064s user 0.062s sys 0.000s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":83,"dirs.run_cpu_time_us":270,"dirs.run_wall_time_us":3669,"drs_written":1,"lbm_read_time_us":275,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2103,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":4}
I20260619 18:45:10.780275 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:10.846969 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.066s user 0.061s sys 0.000s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":83,"dirs.run_cpu_time_us":250,"dirs.run_wall_time_us":1559,"drs_written":1,"lbm_read_time_us":272,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2102,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":4}
I20260619 18:45:10.855175 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:10.890234 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.034s user 0.024s sys 0.004s Metrics: {"bytes_written":4631,"cfile_init":1,"dirs.queue_time_us":75,"dirs.run_cpu_time_us":253,"dirs.run_wall_time_us":1801,"drs_written":1,"lbm_read_time_us":249,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2111,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":2}
I20260619 18:45:10.896925 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73): 392 bytes on disk
I20260619 18:45:10.902895 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.005s user 0.004s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":644,"lbm_reads_lt_1ms":8}
I20260619 18:45:10.908922 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77): 174 bytes on disk
I20260619 18:45:10.910694 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.001s user 0.001s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":312,"lbm_reads_lt_1ms":4}
I20260619 18:45:10.916752 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:10.948580 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.031s user 0.026s sys 0.004s Metrics: {"bytes_written":4629,"cfile_init":1,"dirs.queue_time_us":72,"dirs.run_cpu_time_us":238,"dirs.run_wall_time_us":1348,"drs_written":1,"lbm_read_time_us":249,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2224,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":4}
I20260619 18:45:10.953977 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
W20260619 18:45:10.972353 11043 compilation_manager.cc:203] RowProjector compilation request submit failed: Service unavailable: Thread pool is at capacity (1/1 tasks running, 100/100 tasks queued)
I20260619 18:45:10.984880 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.030s user 0.021s sys 0.008s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":82,"dirs.run_cpu_time_us":286,"dirs.run_wall_time_us":2124,"drs_written":1,"lbm_read_time_us":171,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2074,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":3}
I20260619 18:45:10.989804 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77): 381 bytes on disk
I20260619 18:45:10.992434 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.002s user 0.000s sys 0.001s Metrics: {"cfile_init":2,"lbm_read_time_us":502,"lbm_reads_lt_1ms":8}
I20260619 18:45:10.997478 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:11.029093 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.031s user 0.024s sys 0.005s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":87,"dirs.run_cpu_time_us":311,"dirs.run_wall_time_us":1302,"drs_written":1,"lbm_read_time_us":208,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2052,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":5}
I20260619 18:45:11.035302 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:11.071312 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.035s user 0.028s sys 0.004s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":184,"dirs.run_cpu_time_us":288,"dirs.run_wall_time_us":1267,"drs_written":1,"lbm_read_time_us":243,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2349,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":3}
I20260619 18:45:11.077725 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:11.111275 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.033s user 0.029s sys 0.000s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":111,"dirs.run_cpu_time_us":345,"dirs.run_wall_time_us":1327,"drs_written":1,"lbm_read_time_us":240,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1993,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":4}
I20260619 18:45:11.117345 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:11.148942 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.031s user 0.030s sys 0.000s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":56,"dirs.run_cpu_time_us":308,"dirs.run_wall_time_us":1541,"drs_written":1,"lbm_read_time_us":166,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1859,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":3}
I20260619 18:45:11.154973 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77): 778 bytes on disk
I20260619 18:45:11.158735 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.003s user 0.000s sys 0.000s Metrics: {"cfile_init":4,"lbm_read_time_us":937,"lbm_reads_lt_1ms":16}
I20260619 18:45:11.163973 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:11.201633 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.036s user 0.034s sys 0.000s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":82,"dirs.run_cpu_time_us":336,"dirs.run_wall_time_us":1579,"drs_written":1,"lbm_read_time_us":242,"lbm_reads_lt_1ms":4,"lbm_write_time_us":3107,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"rows_written":5}
I20260619 18:45:11.207711 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:11.246609 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.038s user 0.030s sys 0.004s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":132,"dirs.run_cpu_time_us":286,"dirs.run_wall_time_us":1498,"drs_written":1,"lbm_read_time_us":310,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2247,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":5,"spinlock_wait_cycles":8832}
I20260619 18:45:11.253741 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:11.290537 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.035s user 0.025s sys 0.008s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":101,"dirs.run_cpu_time_us":263,"dirs.run_wall_time_us":1395,"drs_written":1,"lbm_read_time_us":255,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1912,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":5}
I20260619 18:45:11.300243 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77): 636 bytes on disk
I20260619 18:45:11.306084 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.003s user 0.001s sys 0.000s Metrics: {"cfile_init":3,"lbm_read_time_us":716,"lbm_reads_lt_1ms":12}
I20260619 18:45:11.313460 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:11.351881 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.038s user 0.030s sys 0.004s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":120,"dirs.run_cpu_time_us":325,"dirs.run_wall_time_us":1579,"drs_written":1,"lbm_read_time_us":319,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2105,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:11.358433 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77): 214 bytes on disk
I20260619 18:45:11.360826 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.002s user 0.001s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":295,"lbm_reads_lt_1ms":4}
I20260619 18:45:11.366844 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:11.403787 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.036s user 0.032s sys 0.000s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":75,"dirs.run_cpu_time_us":312,"dirs.run_wall_time_us":1455,"drs_written":1,"lbm_read_time_us":237,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1647,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":5,"spinlock_wait_cycles":9984}
I20260619 18:45:11.412648 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77): 212 bytes on disk
I20260619 18:45:11.416304 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.003s user 0.002s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":299,"lbm_reads_lt_1ms":4}
I20260619 18:45:11.421878 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:11.464438 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.041s user 0.036s sys 0.004s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":81,"dirs.run_cpu_time_us":260,"dirs.run_wall_time_us":1382,"drs_written":1,"lbm_read_time_us":248,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2212,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:11.470872 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:11.515218 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.044s user 0.033s sys 0.004s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":93,"dirs.run_cpu_time_us":284,"dirs.run_wall_time_us":1553,"drs_written":1,"lbm_read_time_us":251,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2162,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":5}
I20260619 18:45:11.521836 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77): 426 bytes on disk
I20260619 18:45:11.524554 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.002s user 0.002s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":387,"lbm_reads_lt_1ms":8}
I20260619 18:45:11.530486 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:11.570416 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.039s user 0.030s sys 0.008s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":89,"dirs.run_cpu_time_us":300,"dirs.run_wall_time_us":1703,"drs_written":1,"lbm_read_time_us":203,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1990,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":7}
I20260619 18:45:11.577234 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77): 223 bytes on disk
I20260619 18:45:11.579552 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.002s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":188,"lbm_reads_lt_1ms":4}
I20260619 18:45:11.586249 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:11.630295 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.043s user 0.032s sys 0.004s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":86,"dirs.run_cpu_time_us":251,"dirs.run_wall_time_us":1378,"drs_written":1,"lbm_read_time_us":162,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1974,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:11.638998 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:11.679747 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.040s user 0.023s sys 0.012s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":127,"dirs.run_cpu_time_us":340,"dirs.run_wall_time_us":1639,"drs_written":1,"lbm_read_time_us":271,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1998,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:11.688714 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77): 437 bytes on disk
I20260619 18:45:11.694877 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.005s user 0.001s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":540,"lbm_reads_lt_1ms":8}
I20260619 18:45:11.700146 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:11.742507 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.041s user 0.037s sys 0.000s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":99,"dirs.run_cpu_time_us":287,"dirs.run_wall_time_us":1407,"drs_written":1,"lbm_read_time_us":167,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2124,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":7}
I20260619 18:45:11.750023 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77): 223 bytes on disk
I20260619 18:45:11.753973 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.002s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":211,"lbm_reads_lt_1ms":4}
I20260619 18:45:11.759773 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:11.805225 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.045s user 0.041s sys 0.000s Metrics: {"bytes_written":4631,"cfile_init":1,"dirs.queue_time_us":92,"dirs.run_cpu_time_us":308,"dirs.run_wall_time_us":2745,"drs_written":1,"lbm_read_time_us":255,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2153,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:11.813347 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77): 214 bytes on disk
I20260619 18:45:11.816443 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.002s user 0.002s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":307,"lbm_reads_lt_1ms":4}
I20260619 18:45:11.827389 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:11.870468 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.042s user 0.040s sys 0.000s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":101,"dirs.run_cpu_time_us":278,"dirs.run_wall_time_us":1520,"drs_written":1,"lbm_read_time_us":270,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2061,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":7,"spinlock_wait_cycles":1408}
I20260619 18:45:11.877233 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:11.918480 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.040s user 0.037s sys 0.000s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":86,"dirs.run_cpu_time_us":297,"dirs.run_wall_time_us":1368,"drs_written":1,"lbm_read_time_us":242,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1710,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:11.925936 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:11.966053 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.039s user 0.037s sys 0.000s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":119,"dirs.run_cpu_time_us":250,"dirs.run_wall_time_us":1608,"drs_written":1,"lbm_read_time_us":259,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1962,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":4}
I20260619 18:45:11.975342 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77): 633 bytes on disk
I20260619 18:45:11.979112 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.003s user 0.000s sys 0.000s Metrics: {"cfile_init":3,"lbm_read_time_us":520,"lbm_reads_lt_1ms":12}
I20260619 18:45:11.986847 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:12.029376 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.042s user 0.033s sys 0.008s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":95,"dirs.run_cpu_time_us":269,"dirs.run_wall_time_us":1419,"drs_written":1,"lbm_read_time_us":217,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2005,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":7,"spinlock_wait_cycles":9600}
I20260619 18:45:12.037488 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:12.082613 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.044s user 0.039s sys 0.000s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":87,"dirs.run_cpu_time_us":278,"dirs.run_wall_time_us":2346,"drs_written":1,"lbm_read_time_us":248,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2067,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:12.090859 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77): 437 bytes on disk
I20260619 18:45:12.094022 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.003s user 0.001s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":470,"lbm_reads_lt_1ms":8}
I20260619 18:45:12.102046 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:12.148590 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.045s user 0.043s sys 0.000s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":82,"dirs.run_cpu_time_us":262,"dirs.run_wall_time_us":1580,"drs_written":1,"lbm_read_time_us":165,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2076,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:12.155985 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77): 214 bytes on disk
I20260619 18:45:12.159240 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.003s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":292,"lbm_reads_lt_1ms":4}
I20260619 18:45:12.165934 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:12.216076 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.049s user 0.045s sys 0.000s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":130,"dirs.run_cpu_time_us":290,"dirs.run_wall_time_us":1579,"drs_written":1,"lbm_read_time_us":325,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2025,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":7,"spinlock_wait_cycles":8960}
I20260619 18:45:12.223253 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:12.272225 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.048s user 0.046s sys 0.000s Metrics: {"bytes_written":4639,"cfile_init":1,"dirs.queue_time_us":99,"dirs.run_cpu_time_us":311,"dirs.run_wall_time_us":1320,"drs_written":1,"lbm_read_time_us":254,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1911,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:12.280689 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:12.328856 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.047s user 0.036s sys 0.004s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":80,"dirs.run_cpu_time_us":289,"dirs.run_wall_time_us":1493,"drs_written":1,"lbm_read_time_us":241,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1840,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":5}
I20260619 18:45:12.337858 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77): 649 bytes on disk
I20260619 18:45:12.342970 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.004s user 0.001s sys 0.000s Metrics: {"cfile_init":3,"lbm_read_time_us":742,"lbm_reads_lt_1ms":12}
I20260619 18:45:12.351886 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:12.399890 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.047s user 0.047s sys 0.000s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":95,"dirs.run_cpu_time_us":319,"dirs.run_wall_time_us":1418,"drs_written":1,"lbm_read_time_us":351,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1917,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":7}
I20260619 18:45:12.409878 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:12.464066 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.054s user 0.047s sys 0.000s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":110,"dirs.run_cpu_time_us":245,"dirs.run_wall_time_us":1570,"drs_written":1,"lbm_read_time_us":265,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2036,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":5}
I20260619 18:45:12.472800 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77): 435 bytes on disk
I20260619 18:45:12.476559 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.003s user 0.003s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":512,"lbm_reads_lt_1ms":8}
I20260619 18:45:12.484687 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:12.536780 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.051s user 0.047s sys 0.004s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":153,"dirs.run_cpu_time_us":374,"dirs.run_wall_time_us":2028,"drs_written":1,"lbm_read_time_us":239,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2403,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":8,"spinlock_wait_cycles":3968}
I20260619 18:45:12.545223 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77): 232 bytes on disk
I20260619 18:45:12.548933 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.003s user 0.002s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":251,"lbm_reads_lt_1ms":4}
I20260619 18:45:12.557034 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:12.602869 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.045s user 0.044s sys 0.000s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":94,"dirs.run_cpu_time_us":265,"dirs.run_wall_time_us":1305,"drs_written":1,"lbm_read_time_us":215,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2222,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":7,"spinlock_wait_cycles":10624}
I20260619 18:45:12.609854 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77): 223 bytes on disk
I20260619 18:45:12.613276 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.003s user 0.002s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":267,"lbm_reads_lt_1ms":4}
I20260619 18:45:12.619320 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:12.664765 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.045s user 0.044s sys 0.000s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":85,"dirs.run_cpu_time_us":297,"dirs.run_wall_time_us":1674,"drs_written":1,"lbm_read_time_us":198,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1903,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":8}
I20260619 18:45:12.671998 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:12.720381 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.048s user 0.040s sys 0.008s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":90,"dirs.run_cpu_time_us":290,"dirs.run_wall_time_us":1381,"drs_written":1,"lbm_read_time_us":242,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2002,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:12.727753 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:12.773865 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.046s user 0.043s sys 0.000s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":73,"dirs.run_cpu_time_us":346,"dirs.run_wall_time_us":1893,"drs_written":1,"lbm_read_time_us":209,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1842,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:12.809360 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77): 669 bytes on disk
I20260619 18:45:12.822299 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.011s user 0.005s sys 0.004s Metrics: {"cfile_init":3,"lbm_read_time_us":1382,"lbm_reads_lt_1ms":12}
I20260619 18:45:12.836499 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:12.895256 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.058s user 0.050s sys 0.004s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":234,"dirs.run_cpu_time_us":359,"dirs.run_wall_time_us":1462,"drs_written":1,"lbm_read_time_us":220,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1927,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":8}
I20260619 18:45:12.902734 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77): 232 bytes on disk
I20260619 18:45:12.906503 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.003s user 0.001s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":243,"lbm_reads_lt_1ms":4}
I20260619 18:45:12.912987 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:12.965323 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.052s user 0.050s sys 0.000s Metrics: {"bytes_written":4660,"cfile_init":1,"dirs.queue_time_us":202,"dirs.run_cpu_time_us":299,"dirs.run_wall_time_us":1427,"drs_written":1,"lbm_read_time_us":171,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1690,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":9}
I20260619 18:45:12.973037 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:13.022579 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.049s user 0.046s sys 0.000s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":83,"dirs.run_cpu_time_us":343,"dirs.run_wall_time_us":1576,"drs_written":1,"lbm_read_time_us":224,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1914,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":7}
I20260619 18:45:13.030229 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77): 470 bytes on disk
I20260619 18:45:13.034271 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.003s user 0.001s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":396,"lbm_reads_lt_1ms":8}
I20260619 18:45:13.039564 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:13.093497 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.053s user 0.052s sys 0.000s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":89,"dirs.run_cpu_time_us":261,"dirs.run_wall_time_us":2104,"drs_written":1,"lbm_read_time_us":258,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1944,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":8}
I20260619 18:45:13.101996 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:13.151093 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.048s user 0.041s sys 0.004s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":105,"dirs.run_cpu_time_us":278,"dirs.run_wall_time_us":1551,"drs_written":1,"lbm_read_time_us":240,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2075,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":7,"spinlock_wait_cycles":26496}
I20260619 18:45:13.159881 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77): 455 bytes on disk
I20260619 18:45:13.164700 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.004s user 0.003s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":420,"lbm_reads_lt_1ms":8}
I20260619 18:45:13.171685 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:13.221025 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.049s user 0.048s sys 0.000s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":102,"dirs.run_cpu_time_us":307,"dirs.run_wall_time_us":1418,"drs_written":1,"lbm_read_time_us":155,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1872,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":8,"spinlock_wait_cycles":11648}
I20260619 18:45:13.229365 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77): 232 bytes on disk
I20260619 18:45:13.232648 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.003s user 0.002s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":179,"lbm_reads_lt_1ms":4}
I20260619 18:45:13.239038 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:13.290120 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.050s user 0.048s sys 0.000s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":100,"dirs.run_cpu_time_us":285,"dirs.run_wall_time_us":1566,"drs_written":1,"lbm_read_time_us":166,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2068,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":8}
I20260619 18:45:13.301796 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77): 232 bytes on disk
I20260619 18:45:13.305384 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.003s user 0.002s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":187,"lbm_reads_lt_1ms":4}
I20260619 18:45:13.313410 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(1f02be074be240fa8534ef577aa46f77): perf score=1.000000
I20260619 18:45:13.362177 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.048s user 0.046s sys 0.000s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":76,"dirs.run_cpu_time_us":297,"dirs.run_wall_time_us":1900,"drs_written":1,"lbm_read_time_us":196,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1926,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":1}
I20260619 18:45:13.370137 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77): 163 bytes on disk
I20260619 18:45:13.373553 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(1f02be074be240fa8534ef577aa46f77) complete. Timing: real 0.003s user 0.001s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":252,"lbm_reads_lt_1ms":4}
I20260619 18:45:13.379772 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(4161914b7a5e40a888261cedc6398a73): perf score=1.000000
I20260619 18:45:13.437878 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.057s user 0.047s sys 0.008s Metrics: {"bytes_written":4631,"cfile_init":1,"dirs.queue_time_us":100,"dirs.run_cpu_time_us":260,"dirs.run_wall_time_us":1555,"drs_written":1,"lbm_read_time_us":180,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1761,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":2,"thread_start_us":639,"threads_started":1,"wal-append.queue_time_us":938}
I20260619 18:45:13.446059 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:13.475051 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.028s user 0.025s sys 0.000s Metrics: {"bytes_written":4666,"cfile_init":1,"dirs.queue_time_us":154,"dirs.run_cpu_time_us":320,"dirs.run_wall_time_us":1568,"drs_written":1,"lbm_read_time_us":163,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1648,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":24,"spinlock_wait_cycles":32128}
I20260619 18:45:13.482846 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(d63b7834d93346288748391962132228): 401 bytes on disk
I20260619 18:45:13.484571 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(d63b7834d93346288748391962132228) complete. Timing: real 0.001s user 0.001s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":274,"lbm_reads_lt_1ms":4}
I20260619 18:45:13.490666 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73): 174 bytes on disk
I20260619 18:45:13.495440 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(4161914b7a5e40a888261cedc6398a73) complete. Timing: real 0.004s user 0.001s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":273,"lbm_reads_lt_1ms":4}
I20260619 18:45:13.502104 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:13.527510 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.025s user 0.021s sys 0.000s Metrics: {"bytes_written":4641,"cfile_init":1,"dirs.queue_time_us":85,"dirs.run_cpu_time_us":365,"dirs.run_wall_time_us":1729,"drs_written":1,"lbm_read_time_us":160,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1858,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":7}
I20260619 18:45:13.535197 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:13.562757 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.027s user 0.023s sys 0.000s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":104,"dirs.run_cpu_time_us":294,"dirs.run_wall_time_us":1803,"drs_written":1,"lbm_read_time_us":159,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1746,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":4}
I20260619 18:45:13.570281 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:13.597271 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.026s user 0.017s sys 0.007s Metrics: {"bytes_written":4639,"cfile_init":1,"dirs.queue_time_us":91,"dirs.run_cpu_time_us":297,"dirs.run_wall_time_us":1767,"drs_written":1,"lbm_read_time_us":166,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1700,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":5}
I20260619 18:45:13.605369 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(d63b7834d93346288748391962132228): 631 bytes on disk
I20260619 18:45:13.607534 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(d63b7834d93346288748391962132228) complete. Timing: real 0.002s user 0.000s sys 0.000s Metrics: {"cfile_init":3,"lbm_read_time_us":458,"lbm_reads_lt_1ms":12}
I20260619 18:45:13.614660 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:13.643757 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.028s user 0.021s sys 0.004s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":86,"dirs.run_cpu_time_us":302,"dirs.run_wall_time_us":1341,"drs_written":1,"lbm_read_time_us":252,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1973,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:13.651046 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:13.677932 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.026s user 0.024s sys 0.000s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":83,"dirs.run_cpu_time_us":261,"dirs.run_wall_time_us":1643,"drs_written":1,"lbm_read_time_us":160,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1719,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":4}
I20260619 18:45:13.684924 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:13.715672 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.030s user 0.022s sys 0.004s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":81,"dirs.run_cpu_time_us":289,"dirs.run_wall_time_us":1378,"drs_written":1,"lbm_read_time_us":244,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1720,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":5,"spinlock_wait_cycles":7424}
I20260619 18:45:13.722909 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:13.752064 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.029s user 0.021s sys 0.004s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":123,"dirs.run_cpu_time_us":323,"dirs.run_wall_time_us":1765,"drs_written":1,"lbm_read_time_us":153,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1746,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":4}
I20260619 18:45:13.760066 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(d63b7834d93346288748391962132228): 818 bytes on disk
I20260619 18:45:13.763195 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(d63b7834d93346288748391962132228) complete. Timing: real 0.002s user 0.000s sys 0.000s Metrics: {"cfile_init":4,"lbm_read_time_us":795,"lbm_reads_lt_1ms":16}
I20260619 18:45:13.770198 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:13.800585 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.030s user 0.025s sys 0.004s Metrics: {"bytes_written":4639,"cfile_init":1,"dirs.queue_time_us":101,"dirs.run_cpu_time_us":301,"dirs.run_wall_time_us":1548,"drs_written":1,"lbm_read_time_us":246,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1703,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":7,"spinlock_wait_cycles":22272}
I20260619 18:45:13.808229 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:13.838722 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.030s user 0.023s sys 0.004s Metrics: {"bytes_written":4639,"cfile_init":1,"dirs.queue_time_us":87,"dirs.run_cpu_time_us":329,"dirs.run_wall_time_us":1542,"drs_written":1,"lbm_read_time_us":240,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2143,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":4}
I20260619 18:45:13.846590 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(d63b7834d93346288748391962132228): 419 bytes on disk
I20260619 18:45:13.848685 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(d63b7834d93346288748391962132228) complete. Timing: real 0.002s user 0.001s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":414,"lbm_reads_lt_1ms":8}
I20260619 18:45:13.854874 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:13.888072 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.032s user 0.028s sys 0.000s Metrics: {"bytes_written":4639,"cfile_init":1,"dirs.queue_time_us":117,"dirs.run_cpu_time_us":434,"dirs.run_wall_time_us":1610,"drs_written":1,"lbm_read_time_us":247,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1686,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:13.895385 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:13.930189 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.034s user 0.024s sys 0.008s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":113,"dirs.run_cpu_time_us":322,"dirs.run_wall_time_us":1494,"drs_written":1,"lbm_read_time_us":300,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1912,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":5}
I20260619 18:45:13.938584 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:13.973524 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.034s user 0.031s sys 0.000s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":94,"dirs.run_cpu_time_us":264,"dirs.run_wall_time_us":1587,"drs_written":1,"lbm_read_time_us":252,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1964,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:13.981659 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:14.015945 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.034s user 0.026s sys 0.004s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":93,"dirs.run_cpu_time_us":287,"dirs.run_wall_time_us":1378,"drs_written":1,"lbm_read_time_us":249,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1890,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":5}
I20260619 18:45:14.024389 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:14.059931 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.035s user 0.027s sys 0.004s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":117,"dirs.run_cpu_time_us":296,"dirs.run_wall_time_us":1734,"drs_written":1,"lbm_read_time_us":238,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1854,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6,"spinlock_wait_cycles":3840}
I20260619 18:45:14.070070 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(d63b7834d93346288748391962132228): 1066 bytes on disk
I20260619 18:45:14.074074 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(d63b7834d93346288748391962132228) complete. Timing: real 0.003s user 0.002s sys 0.000s Metrics: {"cfile_init":5,"lbm_read_time_us":870,"lbm_reads_lt_1ms":20}
I20260619 18:45:14.082144 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:14.120066 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.037s user 0.032s sys 0.000s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":80,"dirs.run_cpu_time_us":261,"dirs.run_wall_time_us":1725,"drs_written":1,"lbm_read_time_us":228,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1716,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:14.128707 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(d63b7834d93346288748391962132228): 214 bytes on disk
I20260619 18:45:14.131052 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(d63b7834d93346288748391962132228) complete. Timing: real 0.002s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":260,"lbm_reads_lt_1ms":4}
I20260619 18:45:14.140365 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:14.176924 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.036s user 0.034s sys 0.000s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":93,"dirs.run_cpu_time_us":264,"dirs.run_wall_time_us":1514,"drs_written":1,"lbm_read_time_us":211,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1832,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":7}
I20260619 18:45:14.185525 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(d63b7834d93346288748391962132228): 223 bytes on disk
I20260619 18:45:14.187531 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(d63b7834d93346288748391962132228) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":187,"lbm_reads_lt_1ms":4}
I20260619 18:45:14.195932 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:14.230515 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.034s user 0.024s sys 0.008s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":82,"dirs.run_cpu_time_us":232,"dirs.run_wall_time_us":1561,"drs_written":1,"lbm_read_time_us":189,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1797,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":7}
I20260619 18:45:14.240304 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(d63b7834d93346288748391962132228): 223 bytes on disk
I20260619 18:45:14.242697 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(d63b7834d93346288748391962132228) complete. Timing: real 0.002s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":178,"lbm_reads_lt_1ms":4}
I20260619 18:45:14.250962 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:14.288920 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.037s user 0.033s sys 0.004s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":101,"dirs.run_cpu_time_us":322,"dirs.run_wall_time_us":1467,"drs_written":1,"lbm_read_time_us":243,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1934,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":7}
I20260619 18:45:14.296939 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:14.336833 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.039s user 0.029s sys 0.008s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":89,"dirs.run_cpu_time_us":332,"dirs.run_wall_time_us":1684,"drs_written":1,"lbm_read_time_us":236,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1855,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:14.345700 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(d63b7834d93346288748391962132228): 437 bytes on disk
I20260619 18:45:14.349841 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(d63b7834d93346288748391962132228) complete. Timing: real 0.003s user 0.002s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":470,"lbm_reads_lt_1ms":8}
I20260619 18:45:14.356971 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:14.391633 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.034s user 0.031s sys 0.000s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":75,"dirs.run_cpu_time_us":308,"dirs.run_wall_time_us":1432,"drs_written":1,"lbm_read_time_us":168,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1605,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":7}
I20260619 18:45:14.399642 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:14.437813 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.037s user 0.035s sys 0.000s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":87,"dirs.run_cpu_time_us":311,"dirs.run_wall_time_us":1792,"drs_written":1,"lbm_read_time_us":207,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1934,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:14.450850 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:14.493326 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.041s user 0.039s sys 0.000s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":89,"dirs.run_cpu_time_us":276,"dirs.run_wall_time_us":1754,"drs_written":1,"lbm_read_time_us":238,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2012,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":5}
I20260619 18:45:14.502267 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(d63b7834d93346288748391962132228): 649 bytes on disk
I20260619 18:45:14.506397 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(d63b7834d93346288748391962132228) complete. Timing: real 0.004s user 0.001s sys 0.000s Metrics: {"cfile_init":3,"lbm_read_time_us":777,"lbm_reads_lt_1ms":12}
I20260619 18:45:14.514534 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:14.555253 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.040s user 0.037s sys 0.000s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":91,"dirs.run_cpu_time_us":319,"dirs.run_wall_time_us":1734,"drs_written":1,"lbm_read_time_us":245,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1674,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":8}
I20260619 18:45:14.565492 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:14.608479 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.042s user 0.037s sys 0.004s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":110,"dirs.run_cpu_time_us":297,"dirs.run_wall_time_us":1460,"drs_written":1,"lbm_read_time_us":271,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2133,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:14.619498 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(d63b7834d93346288748391962132228): 446 bytes on disk
I20260619 18:45:14.622493 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(d63b7834d93346288748391962132228) complete. Timing: real 0.002s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":336,"lbm_reads_lt_1ms":8}
I20260619 18:45:14.631621 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:14.675166 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.043s user 0.040s sys 0.000s Metrics: {"bytes_written":4660,"cfile_init":1,"dirs.queue_time_us":92,"dirs.run_cpu_time_us":332,"dirs.run_wall_time_us":1553,"drs_written":1,"lbm_read_time_us":155,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1950,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":9,"spinlock_wait_cycles":5504}
I20260619 18:45:14.683849 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:14.725595 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.041s user 0.039s sys 0.000s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":102,"dirs.run_cpu_time_us":292,"dirs.run_wall_time_us":1327,"drs_written":1,"lbm_read_time_us":238,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1676,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6,"spinlock_wait_cycles":6912}
I20260619 18:45:14.734364 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:14.775763 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.041s user 0.033s sys 0.004s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":75,"dirs.run_cpu_time_us":313,"dirs.run_wall_time_us":1333,"drs_written":1,"lbm_read_time_us":169,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1671,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:14.785105 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(d63b7834d93346288748391962132228): 675 bytes on disk
I20260619 18:45:14.789628 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(d63b7834d93346288748391962132228) complete. Timing: real 0.004s user 0.002s sys 0.000s Metrics: {"cfile_init":3,"lbm_read_time_us":527,"lbm_reads_lt_1ms":12}
I20260619 18:45:14.797782 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:14.842787 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.044s user 0.041s sys 0.000s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":83,"dirs.run_cpu_time_us":328,"dirs.run_wall_time_us":1326,"drs_written":1,"lbm_read_time_us":245,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2000,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":8}
I20260619 18:45:14.850800 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:14.892079 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.041s user 0.033s sys 0.004s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":96,"dirs.run_cpu_time_us":324,"dirs.run_wall_time_us":1403,"drs_written":1,"lbm_read_time_us":179,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1846,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6,"spinlock_wait_cycles":9984}
I20260619 18:45:14.901047 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(d63b7834d93346288748391962132228): 447 bytes on disk
I20260619 18:45:14.904628 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(d63b7834d93346288748391962132228) complete. Timing: real 0.003s user 0.003s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":481,"lbm_reads_lt_1ms":8}
I20260619 18:45:14.913354 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:14.958873 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.045s user 0.038s sys 0.004s Metrics: {"bytes_written":4657,"cfile_init":1,"dirs.queue_time_us":129,"dirs.run_cpu_time_us":312,"dirs.run_wall_time_us":1423,"drs_written":1,"lbm_read_time_us":226,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1887,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":9}
I20260619 18:45:14.968297 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(d63b7834d93346288748391962132228): 247 bytes on disk
I20260619 18:45:14.971581 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(d63b7834d93346288748391962132228) complete. Timing: real 0.003s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":227,"lbm_reads_lt_1ms":4}
I20260619 18:45:14.979702 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:15.027333 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.047s user 0.040s sys 0.004s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":78,"dirs.run_cpu_time_us":330,"dirs.run_wall_time_us":1528,"drs_written":1,"lbm_read_time_us":216,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2024,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":8}
I20260619 18:45:15.037250 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(d63b7834d93346288748391962132228): 232 bytes on disk
I20260619 18:45:15.040560 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(d63b7834d93346288748391962132228) complete. Timing: real 0.003s user 0.002s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":225,"lbm_reads_lt_1ms":4}
I20260619 18:45:15.048758 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:15.093492 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.044s user 0.043s sys 0.000s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":96,"dirs.run_cpu_time_us":296,"dirs.run_wall_time_us":1535,"drs_written":1,"lbm_read_time_us":152,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1549,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":8}
I20260619 18:45:15.103577 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:15.148152 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.044s user 0.040s sys 0.000s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":555,"dirs.run_cpu_time_us":250,"dirs.run_wall_time_us":1164,"drs_written":1,"lbm_read_time_us":243,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2023,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":7}
I20260619 18:45:15.156590 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:15.202682 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.045s user 0.039s sys 0.004s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":114,"dirs.run_cpu_time_us":283,"dirs.run_wall_time_us":1266,"drs_written":1,"lbm_read_time_us":238,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1825,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":7}
I20260619 18:45:15.213158 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(d63b7834d93346288748391962132228): 678 bytes on disk
I20260619 18:45:15.217731 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(d63b7834d93346288748391962132228) complete. Timing: real 0.004s user 0.002s sys 0.000s Metrics: {"cfile_init":3,"lbm_read_time_us":625,"lbm_reads_lt_1ms":12}
I20260619 18:45:15.226049 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:15.271318 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.045s user 0.041s sys 0.000s Metrics: {"bytes_written":4657,"cfile_init":1,"dirs.queue_time_us":77,"dirs.run_cpu_time_us":324,"dirs.run_wall_time_us":1219,"drs_written":1,"lbm_read_time_us":229,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1577,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":9,"spinlock_wait_cycles":4480}
I20260619 18:45:15.281163 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(d63b7834d93346288748391962132228): perf score=1.000000
I20260619 18:45:15.329597 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(d63b7834d93346288748391962132228) complete. Timing: real 0.048s user 0.042s sys 0.004s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":101,"dirs.run_cpu_time_us":254,"dirs.run_wall_time_us":1263,"drs_written":1,"lbm_read_time_us":167,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2221,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":4}
I20260619 18:45:15.338991 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:15.365680 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.026s user 0.024s sys 0.000s Metrics: {"bytes_written":4657,"cfile_init":1,"dirs.queue_time_us":85,"dirs.run_cpu_time_us":272,"dirs.run_wall_time_us":1434,"drs_written":1,"lbm_read_time_us":239,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1825,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":10}
I20260619 18:45:15.375484 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(d63b7834d93346288748391962132228): 443 bytes on disk
I20260619 18:45:15.379217 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(d63b7834d93346288748391962132228) complete. Timing: real 0.003s user 0.000s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":514,"lbm_reads_lt_1ms":8}
I20260619 18:45:15.389138 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:15.415483 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.026s user 0.022s sys 0.000s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":89,"dirs.run_cpu_time_us":280,"dirs.run_wall_time_us":1218,"drs_written":1,"lbm_read_time_us":221,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1727,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":7}
I20260619 18:45:15.424304 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:15.452070 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.027s user 0.019s sys 0.004s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":83,"dirs.run_cpu_time_us":287,"dirs.run_wall_time_us":2181,"drs_written":1,"lbm_read_time_us":201,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1717,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":5}
I20260619 18:45:15.461601 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(ece711fecbcf44beae2a210da7b57926): 692 bytes on disk
I20260619 18:45:15.464188 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.002s user 0.002s sys 0.000s Metrics: {"cfile_init":3,"lbm_read_time_us":565,"lbm_reads_lt_1ms":12}
I20260619 18:45:15.473552 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:15.501099 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.027s user 0.015s sys 0.012s Metrics: {"bytes_written":4641,"cfile_init":1,"dirs.queue_time_us":89,"dirs.run_cpu_time_us":309,"dirs.run_wall_time_us":1332,"drs_written":1,"lbm_read_time_us":233,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1735,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6,"spinlock_wait_cycles":21760}
I20260619 18:45:15.510712 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:15.537528 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.026s user 0.025s sys 0.000s Metrics: {"bytes_written":4639,"cfile_init":1,"dirs.queue_time_us":85,"dirs.run_cpu_time_us":271,"dirs.run_wall_time_us":1360,"drs_written":1,"lbm_read_time_us":154,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1735,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":5}
I20260619 18:45:15.545532 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:15.574092 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.028s user 0.025s sys 0.000s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":97,"dirs.run_cpu_time_us":306,"dirs.run_wall_time_us":1247,"drs_written":1,"lbm_read_time_us":223,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1847,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":5}
I20260619 18:45:15.584486 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:15.614960 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.030s user 0.026s sys 0.000s Metrics: {"bytes_written":4639,"cfile_init":1,"dirs.queue_time_us":95,"dirs.run_cpu_time_us":306,"dirs.run_wall_time_us":1230,"drs_written":1,"lbm_read_time_us":264,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1949,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":5}
I20260619 18:45:15.624728 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:15.653126 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.028s user 0.027s sys 0.000s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":84,"dirs.run_cpu_time_us":305,"dirs.run_wall_time_us":1233,"drs_written":1,"lbm_read_time_us":161,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1683,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:15.661849 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:15.692384 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.030s user 0.030s sys 0.000s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":83,"dirs.run_cpu_time_us":344,"dirs.run_wall_time_us":1321,"drs_written":1,"lbm_read_time_us":231,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1962,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":5}
I20260619 18:45:15.701947 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(ece711fecbcf44beae2a210da7b57926): 1276 bytes on disk
I20260619 18:45:15.706864 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.004s user 0.000s sys 0.001s Metrics: {"cfile_init":6,"lbm_read_time_us":1331,"lbm_reads_lt_1ms":24}
I20260619 18:45:15.715457 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:15.747534 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.031s user 0.028s sys 0.000s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":101,"dirs.run_cpu_time_us":406,"dirs.run_wall_time_us":1597,"drs_written":1,"lbm_read_time_us":218,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1625,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:15.756986 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(ece711fecbcf44beae2a210da7b57926): 214 bytes on disk
I20260619 18:45:15.759184 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":266,"lbm_reads_lt_1ms":4}
I20260619 18:45:15.768383 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:15.800513 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.031s user 0.031s sys 0.000s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":131,"dirs.run_cpu_time_us":322,"dirs.run_wall_time_us":1354,"drs_written":1,"lbm_read_time_us":238,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1803,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":7,"spinlock_wait_cycles":1280}
I20260619 18:45:15.809866 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:15.842813 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.032s user 0.030s sys 0.000s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":102,"dirs.run_cpu_time_us":328,"dirs.run_wall_time_us":1505,"drs_written":1,"lbm_read_time_us":195,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2016,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":4}
I20260619 18:45:15.853709 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:15.887079 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.033s user 0.030s sys 0.000s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":103,"dirs.run_cpu_time_us":307,"dirs.run_wall_time_us":1363,"drs_written":1,"lbm_read_time_us":240,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1732,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:15.897271 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(ece711fecbcf44beae2a210da7b57926): 633 bytes on disk
I20260619 18:45:15.900794 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.003s user 0.002s sys 0.000s Metrics: {"cfile_init":3,"lbm_read_time_us":716,"lbm_reads_lt_1ms":12}
I20260619 18:45:15.909714 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:15.946024 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.036s user 0.033s sys 0.000s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":118,"dirs.run_cpu_time_us":320,"dirs.run_wall_time_us":1273,"drs_written":1,"lbm_read_time_us":238,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2018,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":7}
I20260619 18:45:15.955862 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:15.990020 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.033s user 0.027s sys 0.004s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":77,"dirs.run_cpu_time_us":248,"dirs.run_wall_time_us":1091,"drs_written":1,"lbm_read_time_us":158,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1904,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:16.000911 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:16.034513 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.033s user 0.031s sys 0.000s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":97,"dirs.run_cpu_time_us":286,"dirs.run_wall_time_us":1293,"drs_written":1,"lbm_read_time_us":163,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1782,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:16.044932 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(ece711fecbcf44beae2a210da7b57926): 651 bytes on disk
I20260619 18:45:16.047547 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.002s user 0.000s sys 0.000s Metrics: {"cfile_init":3,"lbm_read_time_us":435,"lbm_reads_lt_1ms":12}
I20260619 18:45:16.056456 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:16.092002 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.035s user 0.030s sys 0.001s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":110,"dirs.run_cpu_time_us":250,"dirs.run_wall_time_us":1179,"drs_written":1,"lbm_read_time_us":181,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1869,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":8}
I20260619 18:45:16.102372 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:16.137377 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.034s user 0.029s sys 0.004s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":86,"dirs.run_cpu_time_us":315,"dirs.run_wall_time_us":1298,"drs_written":1,"lbm_read_time_us":211,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1801,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:16.148234 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:16.189489 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.041s user 0.034s sys 0.004s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":169,"dirs.run_cpu_time_us":304,"dirs.run_wall_time_us":1334,"drs_written":1,"lbm_read_time_us":198,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2204,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":5,"spinlock_wait_cycles":17792}
I20260619 18:45:16.201642 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(ece711fecbcf44beae2a210da7b57926): 658 bytes on disk
I20260619 18:45:16.205037 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.003s user 0.002s sys 0.000s Metrics: {"cfile_init":3,"lbm_read_time_us":597,"lbm_reads_lt_1ms":12}
I20260619 18:45:16.215651 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:16.254477 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.038s user 0.036s sys 0.000s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":95,"dirs.run_cpu_time_us":305,"dirs.run_wall_time_us":1403,"drs_written":1,"lbm_read_time_us":227,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1716,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":7}
I20260619 18:45:16.265687 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:16.305217 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.039s user 0.038s sys 0.000s Metrics: {"bytes_written":4633,"cfile_init":1,"dirs.queue_time_us":109,"dirs.run_cpu_time_us":272,"dirs.run_wall_time_us":1190,"drs_written":1,"lbm_read_time_us":281,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1951,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6,"spinlock_wait_cycles":10496}
I20260619 18:45:16.315759 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(ece711fecbcf44beae2a210da7b57926): 437 bytes on disk
I20260619 18:45:16.320055 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.004s user 0.001s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":529,"lbm_reads_lt_1ms":8}
I20260619 18:45:16.329416 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:16.366927 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.037s user 0.034s sys 0.000s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":80,"dirs.run_cpu_time_us":309,"dirs.run_wall_time_us":1435,"drs_written":1,"lbm_read_time_us":251,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1851,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":8}
I20260619 18:45:16.377754 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:16.417402 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.039s user 0.037s sys 0.000s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":89,"dirs.run_cpu_time_us":243,"dirs.run_wall_time_us":1356,"drs_written":1,"lbm_read_time_us":214,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1871,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":7}
I20260619 18:45:16.430230 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(ece711fecbcf44beae2a210da7b57926): 455 bytes on disk
I20260619 18:45:16.433250 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.002s user 0.001s sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":366,"lbm_reads_lt_1ms":8}
I20260619 18:45:16.442885 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:16.481606 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.038s user 0.029s sys 0.008s Metrics: {"bytes_written":4655,"cfile_init":1,"dirs.queue_time_us":108,"dirs.run_cpu_time_us":289,"dirs.run_wall_time_us":1622,"drs_written":1,"lbm_read_time_us":228,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1866,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":9,"spinlock_wait_cycles":1280}
I20260619 18:45:16.492799 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(ece711fecbcf44beae2a210da7b57926): 247 bytes on disk
I20260619 18:45:16.495628 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.002s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":222,"lbm_reads_lt_1ms":4}
I20260619 18:45:16.505249 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:16.544770 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.039s user 0.037s sys 0.001s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":96,"dirs.run_cpu_time_us":225,"dirs.run_wall_time_us":1166,"drs_written":1,"lbm_read_time_us":241,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1857,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":8}
I20260619 18:45:16.556049 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(ece711fecbcf44beae2a210da7b57926): 232 bytes on disk
I20260619 18:45:16.558697 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.002s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":216,"lbm_reads_lt_1ms":4}
I20260619 18:45:16.568523 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:16.611429 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.042s user 0.039s sys 0.000s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":82,"dirs.run_cpu_time_us":297,"dirs.run_wall_time_us":1439,"drs_written":1,"lbm_read_time_us":153,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1846,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":8}
I20260619 18:45:16.621778 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(ece711fecbcf44beae2a210da7b57926): 232 bytes on disk
I20260619 18:45:16.625167 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.003s user 0.002s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":280,"lbm_reads_lt_1ms":4}
I20260619 18:45:16.637122 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:16.676100 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.038s user 0.034s sys 0.000s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":97,"dirs.run_cpu_time_us":243,"dirs.run_wall_time_us":1255,"drs_written":1,"lbm_read_time_us":160,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1668,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":8}
I20260619 18:45:16.686142 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(ece711fecbcf44beae2a210da7b57926): 232 bytes on disk
I20260619 18:45:16.689438 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.003s user 0.001s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":274,"lbm_reads_lt_1ms":4}
I20260619 18:45:16.699198 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:16.742729 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.043s user 0.036s sys 0.004s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":99,"dirs.run_cpu_time_us":320,"dirs.run_wall_time_us":1531,"drs_written":1,"lbm_read_time_us":237,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1920,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":8,"spinlock_wait_cycles":8960}
I20260619 18:45:16.755141 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:16.798341 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.042s user 0.032s sys 0.008s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":121,"dirs.run_cpu_time_us":322,"dirs.run_wall_time_us":1227,"drs_written":1,"lbm_read_time_us":160,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1761,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":7}
I20260619 18:45:16.810055 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(ece711fecbcf44beae2a210da7b57926): 455 bytes on disk
I20260619 18:45:16.813859 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.003s user 0.000s sys 0.001s Metrics: {"cfile_init":2,"lbm_read_time_us":456,"lbm_reads_lt_1ms":8}
I20260619 18:45:16.825898 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:16.868003 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.041s user 0.034s sys 0.004s Metrics: {"bytes_written":4661,"cfile_init":1,"dirs.queue_time_us":101,"dirs.run_cpu_time_us":248,"dirs.run_wall_time_us":1195,"drs_written":1,"lbm_read_time_us":190,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1921,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":9}
I20260619 18:45:16.879962 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:16.922624 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.042s user 0.039s sys 0.000s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":119,"dirs.run_cpu_time_us":288,"dirs.run_wall_time_us":1343,"drs_written":1,"lbm_read_time_us":187,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1712,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":7}
I20260619 18:45:16.933804 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:16.974786 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.040s user 0.034s sys 0.004s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":122,"dirs.run_cpu_time_us":295,"dirs.run_wall_time_us":1236,"drs_written":1,"lbm_read_time_us":153,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1734,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":7}
I20260619 18:45:16.986244 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(ece711fecbcf44beae2a210da7b57926): 694 bytes on disk
I20260619 18:45:16.990535 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.004s user 0.001s sys 0.000s Metrics: {"cfile_init":3,"lbm_read_time_us":597,"lbm_reads_lt_1ms":12}
I20260619 18:45:17.000157 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:17.043655 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.043s user 0.039s sys 0.000s Metrics: {"bytes_written":4660,"cfile_init":1,"dirs.queue_time_us":88,"dirs.run_cpu_time_us":250,"dirs.run_wall_time_us":1196,"drs_written":1,"lbm_read_time_us":159,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1670,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":9}
I20260619 18:45:17.055598 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:17.099063 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.043s user 0.040s sys 0.000s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":148,"dirs.run_cpu_time_us":242,"dirs.run_wall_time_us":1192,"drs_written":1,"lbm_read_time_us":157,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1760,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":7}
I20260619 18:45:17.111296 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:17.157855 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.046s user 0.044s sys 0.000s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":103,"dirs.run_cpu_time_us":352,"dirs.run_wall_time_us":1216,"drs_written":1,"lbm_read_time_us":172,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2082,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":7}
I20260619 18:45:17.168685 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:17.213356 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.044s user 0.039s sys 0.004s Metrics: {"bytes_written":4637,"cfile_init":1,"dirs.queue_time_us":114,"dirs.run_cpu_time_us":302,"dirs.run_wall_time_us":1263,"drs_written":1,"lbm_read_time_us":157,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1744,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":7,"spinlock_wait_cycles":1408}
I20260619 18:45:17.224428 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling FlushMRSOp(ece711fecbcf44beae2a210da7b57926): perf score=1.000000
I20260619 18:45:17.296661 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: FlushMRSOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.072s user 0.061s sys 0.000s Metrics: {"bytes_written":4635,"cfile_init":1,"dirs.queue_time_us":93,"dirs.run_cpu_time_us":291,"dirs.run_wall_time_us":1232,"drs_written":1,"lbm_read_time_us":263,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1801,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":6}
I20260619 18:45:17.313570 11110 maintenance_manager.cc:419] P 67aa5c51d6d845d49abea1320970e12b: Scheduling UndoDeltaBlockGCOp(ece711fecbcf44beae2a210da7b57926): 1130 bytes on disk
I20260619 18:45:17.320616 11043 maintenance_manager.cc:643] P 67aa5c51d6d845d49abea1320970e12b: UndoDeltaBlockGCOp(ece711fecbcf44beae2a210da7b57926) complete. Timing: real 0.006s user 0.002s sys 0.004s Metrics: {"cfile_init":5,"lbm_read_time_us":1369,"lbm_reads_lt_1ms":20}
W20260619 18:45:18.511422 11230 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 78630.7us
W20260619 18:45:18.661422 11222 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 55618us
W20260619 18:45:19.408161 11239 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 184247us
W20260619 18:45:19.418066 11218 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 76982.5us
W20260619 18:45:19.444839 11219 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 60068.2us
W20260619 18:45:19.639595 11229 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 107371us
W20260619 18:45:19.653409 11256 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 84080.6us
W20260619 18:45:19.749112 11292 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 99421us
W20260619 18:45:19.778993 11281 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 108470us
W20260619 18:45:19.827131 11242 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 68503.9us
W20260619 18:45:19.920334 11216 scanner-internal.cc:458] Time spent opening tablet: real 1.116s user 0.014s sys 0.009s
W20260619 18:45:19.955224 11293 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 88013us
W20260619 18:45:19.959645 11262 meta_cache.cc:1097] Time spent processing table locations response: real 0.083s user 0.001s sys 0.000s
W20260619 18:45:20.042958 11220 scanner-internal.cc:458] Time spent opening tablet: real 1.111s user 0.035s sys 0.031s
W20260619 18:45:20.124656 11362 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 220504us
W20260619 18:45:20.165462 11338 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 104979us
W20260619 18:45:20.170195 11315 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 99626.7us
W20260619 18:45:20.175729 11227 scanner-internal.cc:458] Time spent opening tablet: real 1.356s user 0.009s sys 0.019s
W20260619 18:45:20.174489 11347 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 120889us
W20260619 18:45:20.260349 11240 scanner-internal.cc:458] Time spent opening tablet: real 1.534s user 0.001s sys 0.016s
W20260619 18:45:20.299377 11317 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 127587us
W20260619 18:45:20.368248 11295 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 79871.7us
W20260619 18:45:20.525596 11352 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 138111us
W20260619 18:45:20.550061 11328 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 159404us
W20260619 18:45:20.586117 11282 meta_cache.cc:1097] Time spent processing table locations response: real 0.062s user 0.001s sys 0.000s
W20260619 18:45:20.616356 11214 scanner-internal.cc:458] Time spent opening tablet: real 1.072s user 0.006s sys 0.013s
W20260619 18:45:20.830255 11377 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 196693us
W20260619 18:45:20.905979 11375 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 238383us
W20260619 18:45:20.924163 11231 scanner-internal.cc:458] Time spent opening tablet: real 1.410s user 0.012s sys 0.002s
W20260619 18:45:20.935073 11213 scanner-internal.cc:458] Time spent opening tablet: real 1.395s user 0.010s sys 0.026s
W20260619 18:45:21.163904 11215 scanner-internal.cc:458] Time spent opening tablet: real 1.621s user 0.012s sys 0.006s
W20260619 18:45:21.264218 11381 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 95567us
W20260619 18:45:21.371083 11401 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 48315.4us
W20260619 18:45:21.494724 11259 scanner-internal.cc:458] Time spent opening tablet: real 1.887s user 0.013s sys 0.033s
W20260619 18:45:21.540833 11251 scanner-internal.cc:458] Time spent opening tablet: real 1.753s user 0.008s sys 0.008s
W20260619 18:45:21.835860 11262 scanner-internal.cc:458] Time spent opening tablet: real 1.840s user 0.006s sys 0.023s
W20260619 18:45:21.836805 11413 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 284888us
W20260619 18:45:21.889801 11266 scanner-internal.cc:458] Time spent opening tablet: real 1.741s user 0.025s sys 0.062s
W20260619 18:45:21.937518 11236 scanner-internal.cc:458] Time spent opening tablet: real 1.826s user 0.013s sys 0.007s
W20260619 18:45:21.984824 11225 scanner-internal.cc:458] Time spent opening tablet: real 2.111s user 0.019s sys 0.023s
W20260619 18:45:22.016487 11288 scanner-internal.cc:458] Time spent opening tablet: real 2.015s user 0.013s sys 0.004s
W20260619 18:45:22.406198 11418 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 77235.2us
W20260619 18:45:22.508922 11324 scanner-internal.cc:458] Time spent opening tablet: real 1.696s user 0.008s sys 0.010s
W20260619 18:45:22.552631 11485 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 192218us
W20260619 18:45:22.647311 11282 scanner-internal.cc:458] Time spent opening tablet: real 2.048s user 0.010s sys 0.010s
W20260619 18:45:22.800812 11287 scanner-internal.cc:458] Time spent opening tablet: real 2.027s user 0.021s sys 0.057s
W20260619 18:45:22.863603 11597 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.509s user 0.007s sys 0.019s
W20260619 18:45:22.874351 11597 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.520s user 0.007s sys 0.019s
W20260619 18:45:22.904469 11316 scanner-internal.cc:458] Time spent opening tablet: real 1.993s user 0.004s sys 0.010s
W20260619 18:45:22.928486 11439 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 393459us
W20260619 18:45:22.937202 11477 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 360991us
W20260619 18:45:22.971828 11576 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.569s user 0.014s sys 0.032s
W20260619 18:45:22.981823 11576 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.580s user 0.014s sys 0.033s
W20260619 18:45:23.549893 11463 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 363269us
W20260619 18:45:23.714962 11414 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 841655us
W20260619 18:45:23.722146 11346 scanner-internal.cc:458] Time spent opening tablet: real 2.827s user 0.017s sys 0.019s
W20260619 18:45:23.735863 11449 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 191089us
W20260619 18:45:23.759380 11473 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 127471us
W20260619 18:45:23.787122 11290 scanner-internal.cc:458] Time spent opening tablet: real 2.873s user 0.000s sys 0.014s
W20260619 18:45:23.797034 11433 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 110751us
W20260619 18:45:23.816123 11306 scanner-internal.cc:458] Time spent opening tablet: real 3.148s user 0.009s sys 0.027s
W20260619 18:45:23.821956 11503 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 165854us
W20260619 18:45:23.857808 11361 scanner-internal.cc:458] Time spent opening tablet: real 2.474s user 0.007s sys 0.012s
W20260619 18:45:23.881196 11372 scanner-internal.cc:458] Time spent opening tablet: real 2.417s user 0.014s sys 0.015s
W20260619 18:45:23.918169 11568 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 107061us
W20260619 18:45:24.085172 11415 meta_cache.cc:1097] Time spent processing table locations response: real 0.070s user 0.001s sys 0.001s
W20260619 18:45:24.189896 11566 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 49557.5us
W20260619 18:45:24.221565 11522 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 96587.9us
W20260619 18:45:24.226543 11552 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 52045.9us
W20260619 18:45:24.227418 11608 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 59250us
W20260619 18:45:24.283018 11611 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 44937.6us
W20260619 18:45:24.336788 11384 scanner-internal.cc:458] Time spent opening tablet: real 2.686s user 0.001s sys 0.025s
W20260619 18:45:24.381623 11658 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.568s user 0.001s sys 0.025s
W20260619 18:45:24.401648 11658 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.588s user 0.002s sys 0.026s
W20260619 18:45:24.469803 11395 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.553s user 0.005s sys 0.029s
W20260619 18:45:24.481215 11648 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.615s user 0.015s sys 0.032s
W20260619 18:45:24.503656 11648 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.670s user 0.016s sys 0.032s
W20260619 18:45:24.493315 11392 scanner-internal.cc:458] Time spent opening tablet: real 2.457s user 0.007s sys 0.000s
W20260619 18:45:24.494180 11395 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.611s user 0.005s sys 0.030s
W20260619 18:45:24.521289 11336 scanner-internal.cc:458] Time spent opening tablet: real 3.705s user 0.002s sys 0.014s
W20260619 18:45:24.571691 11637 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.585s user 0.011s sys 0.011s
W20260619 18:45:24.603753 11634 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 55205.3us
W20260619 18:45:24.598212 11637 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.735s user 0.011s sys 0.012s
W20260619 18:45:24.582775 11626 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 92428.5us
W20260619 18:45:24.643128 11400 scanner-internal.cc:458] Time spent opening tablet: real 2.055s user 0.013s sys 0.006s
W20260619 18:45:24.718627 11575 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 130052us
I20260619 18:45:24.724532 11054 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:46806 (request call id 0) took 1100 ms. Trace:
W20260619 18:45:24.812077 11569 meta_cache.cc:1097] Time spent processing table locations response: real 0.057s user 0.000s sys 0.001s
W20260619 18:45:24.824568 11601 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 157670us
W20260619 18:45:24.853011 11465 scanner-internal.cc:458] Time spent opening tablet: real 2.043s user 0.002s sys 0.008s
W20260619 18:45:24.861016 11291 scanner-internal.cc:458] Time spent opening tablet: real 4.049s user 0.002s sys 0.002s
I20260619 18:45:24.740406 11054 rpcz_store.cc:276] 0619 18:45:23.635922 (+ 0us) service_pool.cc:170] Inserting onto call queue
0619 18:45:23.653545 (+ 17623us) service_pool.cc:227] Handling call
0619 18:45:23.658440 (+ 4895us) tablet_service.cc:2780] Created scanner c31fb9ebeeb54bff91b13d5c1ab479b3 for tablet 1f02be074be240fa8534ef577aa46f77, query id is a8a06173d758477db77015a08cb297a4
0619 18:45:23.699690 (+ 41250us) tablet_service.cc:2920] Creating iterator
0619 18:45:23.731115 (+ 31425us) tablet_service.cc:2945] Iterator created
0619 18:45:23.881987 (+150872us) tablet_service.cc:2967] Iterator init: OK
0619 18:45:23.884831 (+ 2844us) tablet_service.cc:3010] has_more: true
0619 18:45:23.897087 (+ 12256us) tablet_service.cc:3027] Continuing scan request
0619 18:45:23.924674 (+ 27587us) tablet_service.cc:3091] Found scanner c31fb9ebeeb54bff91b13d5c1ab479b3 for tablet 1f02be074be240fa8534ef577aa46f77, query id is a8a06173d758477db77015a08cb297a4
0619 18:45:24.268669 (+343995us) spinlock_profiling.cc:243] Waited 9.3 ms on lock 0x7b2400000a28. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383caecf4 00007f1383cacdfb 00007f138a46ec2f 00007f138a47e0ae 00007f138a480729 00007f138a47ffbb 00007f138ab32c7b 00007f138ab330b2 00007f138ac55719 00007f138477dce6
0619 18:45:24.333074 (+ 64405us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b2400000a28. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383caecf4 00007f1383cacdfb 00007f138a46ec2f 00007f138a47e0ae 00007f138a480ade 00007f138a48009b 00007f138ab32c7b 00007f138ab330b2 00007f138ac55719 00007f138477dce6
0619 18:45:24.473964 (+140890us) spinlock_profiling.cc:243] Waited 5.19 ms on lock 0x7b24000007e8. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383caecf4 00007f1383cacdfb 00007f138a46ec2f 00007f138a47e0ae 00007f138a4a2a5a 00007f138a4a2347 00007f138a4a22e0 00007f138a480038 00007f138ab32c7b 00007f138ab330b2
0619 18:45:24.550933 (+ 76969us) tablet_service.cc:3165] Deadline expired - responding early
0619 18:45:24.719919 (+168986us) inbound_call.cc:173] Queueing success response
Metrics: {"cfile_cache_hit":16,"cfile_cache_hit_bytes":516,"rowset_iterators":3,"scanner_bytes_read":246,"spinlock_wait_cycles":98911488}
I20260619 18:45:24.967886 11053 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:46820 (request call id 0) took 1315 ms. Trace:
I20260619 18:45:24.968484 11053 rpcz_store.cc:276] 0619 18:45:23.652716 (+ 0us) service_pool.cc:170] Inserting onto call queue
0619 18:45:23.653520 (+ 804us) service_pool.cc:227] Handling call
0619 18:45:23.658700 (+ 5180us) tablet_service.cc:2780] Created scanner 5512a6fe3806447d81a9f2da72647072 for tablet 1f02be074be240fa8534ef577aa46f77, query id is 4011d7381e954b669cadaa22898ba95b
0619 18:45:23.795624 (+136924us) tablet_service.cc:2920] Creating iterator
0619 18:45:23.795977 (+ 353us) tablet_service.cc:2945] Iterator created
0619 18:45:24.248816 (+452839us) spinlock_profiling.cc:243] Waited 1.45 ms on lock 0x7b2400000f38. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383caecf4 00007f1383cacdfb 00007f138a46ec2f 00007f138a47e0ae 00007f138a480ade 00007f138a481820 00007f138ab32373 00007f138ab31d5f 00007f138ac54b68 00007f138477cf82
0619 18:45:24.294485 (+ 45669us) tablet_service.cc:2967] Iterator init: OK
0619 18:45:24.300658 (+ 6173us) tablet_service.cc:3010] has_more: true
0619 18:45:24.306965 (+ 6307us) tablet_service.cc:3027] Continuing scan request
0619 18:45:24.383401 (+ 76436us) tablet_service.cc:3091] Found scanner 5512a6fe3806447d81a9f2da72647072 for tablet 1f02be074be240fa8534ef577aa46f77, query id is 4011d7381e954b669cadaa22898ba95b
0619 18:45:24.613631 (+230230us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b2400000a28. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383caecf4 00007f1383cacdfb 00007f138a46ec2f 00007f138a47e0ae 00007f138a480ade 00007f138a48009b 00007f138ab32c7b 00007f138ab330b2 00007f138ac55719 00007f138477dce6
0619 18:45:24.965057 (+351426us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b2400000f38. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383caecf4 00007f1383cacdfb 00007f138a46ec2f 00007f138a47e0ae 00007f138a480ade 00007f138a48009b 00007f138ab32c7b 00007f138ab330b2 00007f138ac55719 00007f138477dce6
0619 18:45:24.965968 (+ 911us) tablet_service.cc:3165] Deadline expired - responding early
0619 18:45:24.967817 (+ 1849us) inbound_call.cc:173] Queueing success response
Metrics: {"cfile_cache_hit":18,"cfile_cache_hit_bytes":600,"rowset_iterators":4,"scanner_bytes_read":258,"spinlock_wait_cycles":40168448}
W20260619 18:45:25.051085 11631 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 58809.7us
W20260619 18:45:25.036765 11604 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 174122us
W20260619 18:45:25.161886 11622 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 127877us
W20260619 18:45:25.162972 11380 scanner-internal.cc:458] Time spent opening tablet: real 3.603s user 0.009s sys 0.031s
W20260619 18:45:25.240464 11364 scanner-internal.cc:458] Time spent opening tablet: real 3.710s user 0.003s sys 0.002s
W20260619 18:45:25.259383 11627 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 172076us
I20260619 18:45:25.322975 11052 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:46852 (request call id 0) took 1062 ms. Trace:
I20260619 18:45:25.325389 11052 rpcz_store.cc:276] 0619 18:45:24.260401 (+ 0us) service_pool.cc:170] Inserting onto call queue
0619 18:45:24.260663 (+ 262us) service_pool.cc:227] Handling call
0619 18:45:24.268029 (+ 7366us) tablet_service.cc:2780] Created scanner 0bac8a302e4f4adaa2a0bc314892c2ed for tablet 1f02be074be240fa8534ef577aa46f77, query id is b56e51d872574eb18058857731035021
0619 18:45:24.373344 (+105315us) tablet_service.cc:2920] Creating iterator
0619 18:45:24.373765 (+ 421us) tablet_service.cc:2945] Iterator created
0619 18:45:24.473395 (+ 99630us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b2400000f38. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383caecf4 00007f1383cacdfb 00007f138a46ec2f 00007f138a47e0ae 00007f138a480ade 00007f138a481820 00007f138ab32373 00007f138ab31d5f 00007f138ac54b68 00007f138477cf82
0619 18:45:24.744077 (+270682us) tablet_service.cc:2967] Iterator init: OK
0619 18:45:24.750214 (+ 6137us) tablet_service.cc:3010] has_more: true
0619 18:45:24.763726 (+ 13512us) tablet_service.cc:3027] Continuing scan request
0619 18:45:24.802363 (+ 38637us) tablet_service.cc:3091] Found scanner 0bac8a302e4f4adaa2a0bc314892c2ed for tablet 1f02be074be240fa8534ef577aa46f77, query id is b56e51d872574eb18058857731035021
0619 18:45:25.322900 (+520537us) inbound_call.cc:173] Queueing success response
Metrics: {"cfile_cache_hit":24,"cfile_cache_hit_bytes":807,"cfile_cache_miss":1,"cfile_cache_miss_bytes":20,"lbm_read_time_us":7430,"lbm_reads_1-10_ms":1,"rowset_iterators":4,"scanner_bytes_read":384,"spinlock_wait_cycles":7542016}
W20260619 18:45:25.385982 11409 scanner-internal.cc:458] Time spent opening tablet: real 2.983s user 0.022s sys 0.020s
W20260619 18:45:25.423916 11291 client.cc:2034] Couldn't close scanner f5b338e1ec884ec4a914c32724eebc7d: Aborted: reactor is shutting down (error 108)
W20260619 18:45:25.550103 11403 client.cc:2034] Couldn't close scanner 5512a6fe3806447d81a9f2da72647072: Service unavailable: reactor is shutting down (error 108)
W20260619 18:45:25.552476 11041 connection.cc:441] server connection from 127.0.0.1:46820 torn down before Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:46820 (request call id 2) could send its response
W20260619 18:45:25.606668 11460 scanner-internal.cc:458] Time spent opening tablet: real 2.641s user 0.002s sys 0.002s
W20260619 18:45:25.875154 11669 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 68956.4us
W20260619 18:45:25.871898 11427 scanner-internal.cc:458] Time spent opening tablet: real 2.467s user 0.015s sys 0.055s
W20260619 18:45:25.966377 11648 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 177050us
W20260619 18:45:26.084020 11671 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 274244us
W20260619 18:45:26.226408 11548 scanner-internal.cc:458] Time spent opening tablet: real 2.182s user 0.009s sys 0.017s
W20260619 18:45:26.247184 11701 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 256982us
W20260619 18:45:26.261355 11711 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 288423us
W20260619 18:45:26.298985 11395 scanner-internal.cc:458] Time spent opening tablet: real 2.422s user 0.009s sys 0.030s
W20260619 18:45:26.329614 11685 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 62716.6us
W20260619 18:45:26.426818 11428 scanner-internal.cc:458] Time spent opening tablet: real 2.441s user 0.010s sys 0.012s
W20260619 18:45:26.496230 11569 scanner-internal.cc:458] Time spent opening tablet: real 1.530s user 0.001s sys 0.006s
W20260619 18:45:26.568579 11415 scanner-internal.cc:458] Time spent opening tablet: real 2.190s user 0.002s sys 0.012s
W20260619 18:45:26.579998 11488 scanner-internal.cc:458] Time spent opening tablet: real 1.695s user 0.006s sys 0.001s
W20260619 18:45:26.594476 11437 scanner-internal.cc:458] Time spent opening tablet: real 2.891s user 0.004s sys 0.008s
W20260619 18:45:26.588567 11740 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 172963us
W20260619 18:45:26.650610 11691 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 246232us
W20260619 18:45:26.678915 11480 scanner-internal.cc:458] Time spent opening tablet: real 2.581s user 0.006s sys 0.014s
W20260619 18:45:26.699628 11545 scanner-internal.cc:458] Time spent opening tablet: real 2.294s user 0.011s sys 0.018s
W20260619 18:45:26.748498 11576 scanner-internal.cc:458] Time spent opening tablet: real 2.369s user 0.006s sys 0.017s
W20260619 18:45:26.837152 11542 scanner-internal.cc:458] Time spent opening tablet: real 2.634s user 0.014s sys 0.007s
W20260619 18:45:26.878319 11760 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 68925.6us
W20260619 18:45:27.029757 11511 scanner-internal.cc:458] Time spent opening tablet: real 2.819s user 0.012s sys 0.026s
W20260619 18:45:27.100828 11450 scanner-internal.cc:458] Time spent opening tablet: real 2.908s user 0.014s sys 0.025s
W20260619 18:45:27.117246 11737 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 130965us
W20260619 18:45:27.136673 11619 scanner-internal.cc:458] Time spent opening tablet: real 2.154s user 0.003s sys 0.002s
W20260619 18:45:27.149648 11563 scanner-internal.cc:458] Time spent opening tablet: real 2.364s user 0.008s sys 0.012s
W20260619 18:45:27.178936 11762 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 95625.7us
W20260619 18:45:27.182129 11520 scanner-internal.cc:458] Time spent opening tablet: real 2.577s user 0.009s sys 0.006s
W20260619 18:45:27.208683 11597 scanner-internal.cc:458] Time spent opening tablet: real 1.908s user 0.012s sys 0.018s
W20260619 18:45:27.246526 11607 scanner-internal.cc:458] Time spent opening tablet: real 2.260s user 0.010s sys 0.005s
W20260619 18:45:27.267112 11798 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 57287.9us
W20260619 18:45:27.277845 11603 scanner-internal.cc:458] Time spent opening tablet: real 1.926s user 0.002s sys 0.014s
W20260619 18:45:27.321069 11531 scanner-internal.cc:458] Time spent opening tablet: real 2.099s user 0.007s sys 0.005s
W20260619 18:45:27.323136 11582 scanner-internal.cc:458] Time spent opening tablet: real 1.829s user 0.009s sys 0.003s
W20260619 18:45:27.335973 11847 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 59301.2us
W20260619 18:45:27.469887 11668 scanner-internal.cc:458] Time spent opening tablet: real 1.102s user 0.008s sys 0.008s
W20260619 18:45:27.481560 11658 scanner-internal.cc:458] Time spent opening tablet: real 1.494s user 0.009s sys 0.010s
W20260619 18:45:27.513726 11637 scanner-internal.cc:458] Time spent opening tablet: real 0.986s user 0.004s sys 0.008s
W20260619 18:45:27.515769 11836 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 50408.2us
W20260619 18:45:27.527657 11583 scanner-internal.cc:458] Time spent opening tablet: real 2.347s user 0.011s sys 0.018s
W20260619 18:45:27.574536 11689 scanner-internal.cc:458] Time spent opening tablet: real 1.110s user 0.001s sys 0.009s
W20260619 18:45:27.799464 11887 net_util.cc:504] Time spent look up canonical hostname for localhost 'dist-test-slave-90mn': real 0.204s user 0.003s sys 0.001s
W20260619 18:45:27.831673 11721 scanner-internal.cc:458] Time spent opening tablet: real 0.985s user 0.002s sys 0.011s
W20260619 18:45:27.834471 11621 scanner-internal.cc:458] Time spent opening tablet: real 1.823s user 0.018s sys 0.027s
W20260619 18:45:27.853931 11694 scanner-internal.cc:458] Time spent opening tablet: real 1.487s user 0.008s sys 0.022s
W20260619 18:45:27.857188 11666 scanner-internal.cc:458] Time spent opening tablet: real 0.984s user 0.019s sys 0.024s
W20260619 18:45:27.866133 11736 scanner-internal.cc:458] Time spent opening tablet: real 0.831s user 0.004s sys 0.010s
W20260619 18:45:27.879653 11606 scanner-internal.cc:458] Time spent opening tablet: real 2.297s user 0.005s sys 0.000s
W20260619 18:45:27.894575 11739 scanner-internal.cc:458] Time spent opening tablet: real 0.694s user 0.014s sys 0.007s
W20260619 18:45:27.900902 11888 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 129314us
W20260619 18:45:27.901856 11815 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 390850us
W20260619 18:45:27.902185 11793 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 309059us
W20260619 18:45:27.905746 11901 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 138550us
W20260619 18:45:27.910529 11860 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 52824.2us
W20260619 18:45:27.913394 11893 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 98113.9us
W20260619 18:45:27.915022 11857 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 129090us
W20260619 18:45:27.914260 11846 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 354257us
W20260619 18:45:27.939220 11705 scanner-internal.cc:458] Time spent opening tablet: real 0.774s user 0.005s sys 0.000s
W20260619 18:45:28.091688 11819 scanner-internal.cc:458] Time spent opening tablet: real 0.731s user 0.016s sys 0.014s
W20260619 18:45:28.190094 11715 scanner-internal.cc:458] Time spent opening tablet: real 0.950s user 0.002s sys 0.010s
W20260619 18:45:28.199313 11784 scanner-internal.cc:458] Time spent opening tablet: real 0.761s user 0.005s sys 0.000s
W20260619 18:45:28.259743 11867 scanner-internal.cc:458] Time spent opening tablet: real 0.685s user 0.012s sys 0.019s
W20260619 18:45:28.278664 11761 scanner-internal.cc:458] Time spent opening tablet: real 0.981s user 0.005s sys 0.014s
W20260619 18:45:28.324631 11781 scanner-internal.cc:458] Time spent opening tablet: real 1.029s user 0.011s sys 0.014s
W20260619 18:45:28.607704 11105 debug-util.cc:398] Leaking SignalData structure 0x7b08000b0b80 after lost signal to thread 6630
W20260619 18:45:28.608880 11105 debug-util.cc:398] Leaking SignalData structure 0x7b0800183de0 after lost signal to thread 11008
W20260619 18:45:28.610594 11105 debug-util.cc:398] Leaking SignalData structure 0x7b080010d7e0 after lost signal to thread 11697
W20260619 18:45:28.653107 6632 debug-util.cc:398] Leaking SignalData structure 0x7b080000fa00 after lost signal to thread 11815
W20260619 18:45:29.733194 11982 scanner-internal.cc:458] Time spent opening tablet: real 0.512s user 0.004s sys 0.000s
W20260619 18:45:29.756702 12007 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 172824us
W20260619 18:45:30.156087 12065 sasl_common.cc:323] Time spent creating new SASL kudu client: real 0.268s user 0.001s sys 0.001s
W20260619 18:45:30.302050 12080 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.512s user 0.105s sys 0.169s
W20260619 18:45:30.302412 12080 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.513s user 0.105s sys 0.169s
W20260619 18:45:30.367667 12086 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.569s user 0.013s sys 0.035s
W20260619 18:45:30.368083 12086 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.569s user 0.013s sys 0.036s
W20260619 18:45:30.378135 11985 scanner-internal.cc:458] Time spent opening tablet: real 1.113s user 0.009s sys 0.001s
W20260619 18:45:30.420425 12019 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 167987us
W20260619 18:45:30.390992 12035 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 190800us
W20260619 18:45:30.976421 12076 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.575s user 0.000s sys 0.014s
W20260619 18:45:30.936373 12140 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.517s user 0.020s sys 0.058s
W20260619 18:45:30.949628 12165 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.507s user 0.004s sys 0.011s
W20260619 18:45:30.982240 12076 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.580s user 0.002s sys 0.014s
W20260619 18:45:31.012511 12140 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.593s user 0.020s sys 0.060s
W20260619 18:45:31.001641 12157 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.572s user 0.000s sys 0.017s
W20260619 18:45:30.996708 12148 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.579s user 0.000s sys 0.012s
W20260619 18:45:30.996244 12100 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.600s user 0.012s sys 0.000s
W20260619 18:45:31.022881 12143 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.610s user 0.012s sys 0.005s
W20260619 18:45:31.032335 12165 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.590s user 0.004s sys 0.011s
W20260619 18:45:31.058301 10949 thread.cc:636] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.648s user 0.004s sys 0.016s
W20260619 18:45:31.049266 12079 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.685s user 0.001s sys 0.018s
W20260619 18:45:31.048521 12158 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.617s user 0.004s sys 0.010s
W20260619 18:45:31.120384 12143 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.708s user 0.013s sys 0.005s
W20260619 18:45:31.097157 12149 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.679s user 0.007s sys 0.018s
W20260619 18:45:31.128906 12149 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.711s user 0.007s sys 0.019s
W20260619 18:45:31.049436 12117 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.660s user 0.008s sys 0.011s
W20260619 18:45:31.151432 10948 thread.cc:636] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.772s user 0.020s sys 0.084s
W20260619 18:45:31.098327 12148 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.683s user 0.002s sys 0.012s
W20260619 18:45:31.094311 12100 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.698s user 0.013s sys 0.000s
W20260619 18:45:31.121438 10949 thread.cc:602] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.720s user 0.004s sys 0.019s
W20260619 18:45:31.202910 10948 thread.cc:602] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.824s user 0.024s sys 0.088s
W20260619 18:45:31.093191 12157 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.664s user 0.000s sys 0.018s
W20260619 18:45:31.127245 12079 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.763s user 0.001s sys 0.018s
W20260619 18:45:31.127475 12158 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.696s user 0.004s sys 0.011s
W20260619 18:45:31.190225 12117 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.801s user 0.009s sys 0.011s
W20260619 18:45:31.360792 12135 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.537s user 0.010s sys 0.034s
W20260619 18:45:31.412906 12135 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.596s user 0.010s sys 0.035s
W20260619 18:45:31.432233 11005 debug-util.cc:398] Leaking SignalData structure 0x7b080019d6e0 after lost signal to thread 6630
W20260619 18:45:31.434823 11005 debug-util.cc:398] Leaking SignalData structure 0x7b0800213920 after lost signal to thread 11108
W20260619 18:45:31.435350 11005 debug-util.cc:398] Leaking SignalData structure 0x7b0800213a40 after lost signal to thread 11987
W20260619 18:45:31.435611 11005 debug-util.cc:398] Leaking SignalData structure 0x7b0800213a60 after lost signal to thread 11989
W20260619 18:45:31.435870 11005 debug-util.cc:398] Leaking SignalData structure 0x7b0800213ac0 after lost signal to thread 11995
W20260619 18:45:31.331182 12132 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.555s user 0.000s sys 0.023s
W20260619 18:45:31.361068 12131 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.531s user 0.015s sys 0.035s
W20260619 18:45:31.468029 12132 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.695s user 0.000s sys 0.024s
W20260619 18:45:31.473764 12131 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.655s user 0.015s sys 0.035s
W20260619 18:45:31.495748 12017 meta_cache.cc:1261] Time spent looking up entry by key: real 0.052s user 0.000s sys 0.000s
W20260619 18:45:31.526229 12184 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.513s user 0.018s sys 0.006s
W20260619 18:45:31.507223 12171 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.522s user 0.020s sys 0.029s
W20260619 18:45:31.547240 12184 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.581s user 0.018s sys 0.006s
W20260619 18:45:31.590920 12171 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.646s user 0.020s sys 0.029s
W20260619 18:45:31.594681 12152 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.534s user 0.006s sys 0.009s
W20260619 18:45:31.631309 12180 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.579s user 0.013s sys 0.008s
W20260619 18:45:31.707520 12180 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.718s user 0.013s sys 0.009s
W20260619 18:45:31.609284 12177 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.520s user 0.007s sys 0.011s
W20260619 18:45:31.723129 12172 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.910s user 0.007s sys 0.000s
W20260619 18:45:31.724170 12172 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.912s user 0.008s sys 0.000s
W20260619 18:45:31.699038 12152 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.783s user 0.006s sys 0.010s
W20260619 18:45:31.694199 12170 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.645s user 0.018s sys 0.017s
W20260619 18:45:31.807576 12179 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.511s user 0.008s sys 0.020s
W20260619 18:45:31.827167 12010 meta_cache.cc:1261] Time spent looking up entry by key: real 0.056s user 0.000s sys 0.000s
W20260619 18:45:31.839717 12170 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.866s user 0.019s sys 0.018s
W20260619 18:45:31.931663 12062 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 467084us
W20260619 18:45:31.747262 12106 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 492263us
W20260619 18:45:31.838478 12173 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.611s user 0.008s sys 0.013s
W20260619 18:45:31.967790 12173 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.861s user 0.009s sys 0.014s
W20260619 18:45:32.204253 12068 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 588661us
W20260619 18:45:32.281003 12075 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 361677us
W20260619 18:45:32.304713 12013 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 186090us
W20260619 18:45:32.258628 12161 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.707s user 0.015s sys 0.034s
W20260619 18:45:32.337930 12161 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.015s user 0.015s sys 0.034s
W20260619 18:45:32.357664 12165 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.830s user 0.006s sys 0.041s
W20260619 18:45:32.350315 12148 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.004s user 0.021s sys 0.039s
W20260619 18:45:32.398378 12165 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.881s user 0.006s sys 0.042s
W20260619 18:45:32.416536 12162 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.986s user 0.028s sys 0.028s
W20260619 18:45:32.417032 12162 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.031s user 0.028s sys 0.028s
W20260619 18:45:32.411945 12148 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.089s user 0.021s sys 0.040s
W20260619 18:45:32.393429 12117 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.007s user 0.018s sys 0.042s
W20260619 18:45:32.464747 12117 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.092s user 0.018s sys 0.043s
W20260619 18:45:32.493834 12143 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.020s user 0.012s sys 0.032s
W20260619 18:45:32.496060 12146 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.779s user 0.006s sys 0.044s
W20260619 18:45:32.541975 12043 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 162945us
W20260619 18:45:32.542198 12029 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 139729us
W20260619 18:45:32.543061 12174 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.656s user 0.006s sys 0.038s
W20260619 18:45:32.543486 12174 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.823s user 0.006s sys 0.038s
W20260619 18:45:32.530478 12143 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.065s user 0.012s sys 0.033s
W20260619 18:45:32.553593 12137 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.941s user 0.019s sys 0.029s
W20260619 18:45:32.561924 12137 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.113s user 0.020s sys 0.030s
W20260619 18:45:32.554291 12067 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 175910us
W20260619 18:45:32.544317 12147 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.948s user 0.015s sys 0.026s
W20260619 18:45:32.552021 12146 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.307s user 0.006s sys 0.045s
W20260619 18:45:32.548595 12129 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.598s user 0.011s sys 0.024s
W20260619 18:45:32.568869 12135 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.031s user 0.010s sys 0.021s
W20260619 18:45:32.575932 12135 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.048s user 0.010s sys 0.022s
W20260619 18:45:32.569957 12149 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.028s user 0.006s sys 0.025s
W20260619 18:45:32.577289 12080 meta_cache.cc:1097] Time spent processing table locations response: real 0.053s user 0.001s sys 0.000s
W20260619 18:45:32.634063 12158 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.045s user 0.012s sys 0.039s
W20260619 18:45:32.583422 12132 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.003s user 0.010s sys 0.051s
W20260619 18:45:32.579006 12147 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.472s user 0.016s sys 0.028s
W20260619 18:45:32.626717 12129 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.174s user 0.011s sys 0.026s
W20260619 18:45:32.578974 12149 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.071s user 0.006s sys 0.025s
W20260619 18:45:32.661685 12158 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.087s user 0.012s sys 0.039s
W20260619 18:45:32.744957 12141 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.109s user 0.013s sys 0.062s
W20260619 18:45:32.745430 12141 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.276s user 0.013s sys 0.062s
W20260619 18:45:32.663043 12132 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.147s user 0.011s sys 0.052s
W20260619 18:45:32.756636 12213 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.906s user 0.006s sys 0.050s
W20260619 18:45:32.756922 12047 meta_cache.cc:1097] Time spent processing table locations response: real 0.153s user 0.000s sys 0.000s
W20260619 18:45:32.757076 12213 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 2.195s user 0.006s sys 0.051s
W20260619 18:45:32.699949 12164 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.523s user 0.011s sys 0.040s
W20260619 18:45:32.661657 12140 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.117s user 0.010s sys 0.024s
W20260619 18:45:32.749951 12151 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.014s user 0.006s sys 0.049s
W20260619 18:45:32.789537 12153 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.813s user 0.008s sys 0.037s
W20260619 18:45:32.772863 12140 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.256s user 0.010s sys 0.025s
W20260619 18:45:32.771767 12133 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.778s user 0.001s sys 0.037s
W20260619 18:45:32.784662 12164 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.888s user 0.011s sys 0.041s
W20260619 18:45:32.785015 12127 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.658s user 0.009s sys 0.039s
W20260619 18:45:32.789976 12153 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.945s user 0.009s sys 0.037s
W20260619 18:45:32.788638 12118 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.613s user 0.008s sys 0.035s
W20260619 18:45:32.796176 12124 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.037s user 0.004s sys 0.021s
W20260619 18:45:32.799177 12151 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.348s user 0.006s sys 0.050s
W20260619 18:45:32.796890 12159 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.742s user 0.012s sys 0.018s
W20260619 18:45:32.804418 12133 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.085s user 0.001s sys 0.038s
W20260619 18:45:32.799695 12163 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.708s user 0.004s sys 0.025s
W20260619 18:45:32.819046 12042 meta_cache.cc:1097] Time spent processing table locations response: real 0.117s user 0.000s sys 0.001s
W20260619 18:45:32.811349 12127 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.007s user 0.009s sys 0.041s
W20260619 18:45:32.815771 12118 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.047s user 0.008s sys 0.036s
W20260619 18:45:32.818288 12159 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.078s user 0.013s sys 0.018s
W20260619 18:45:32.817531 12124 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.192s user 0.004s sys 0.022s
W20260619 18:45:32.821635 12163 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.035s user 0.005s sys 0.026s
W20260619 18:45:32.823693 12128 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.953s user 0.005s sys 0.018s
W20260619 18:45:32.838529 12057 meta_cache.cc:1097] Time spent processing table locations response: real 0.052s user 0.000s sys 0.001s
W20260619 18:45:32.838764 12128 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.213s user 0.005s sys 0.019s
W20260619 18:45:32.872255 12160 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.140s user 0.024s sys 0.031s
W20260619 18:45:32.880232 12160 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.164s user 0.024s sys 0.031s
W20260619 18:45:32.864934 12180 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.157s user 0.005s sys 0.014s
W20260619 18:45:32.886107 12131 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.235s user 0.000s sys 0.019s
W20260619 18:45:32.889396 12028 meta_cache.cc:1097] Time spent processing table locations response: real 0.053s user 0.000s sys 0.001s
W20260619 18:45:32.889523 12131 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.262s user 0.001s sys 0.020s
W20260619 18:45:32.892426 12088 meta_cache.cc:1097] Time spent processing table locations response: real 0.054s user 0.001s sys 0.000s
W20260619 18:45:32.888833 12180 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.181s user 0.005s sys 0.014s
W20260619 18:45:32.960143 12145 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.052s user 0.004s sys 0.016s
W20260619 18:45:32.960723 12145 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.111s user 0.005s sys 0.017s
W20260619 18:45:33.034228 12126 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.207s user 0.010s sys 0.014s
W20260619 18:45:33.034814 12126 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.284s user 0.010s sys 0.014s
W20260619 18:45:33.040695 12017 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.142s user 0.016s sys 0.008s
W20260619 18:45:33.043707 12017 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.180s user 0.016s sys 0.008s
W20260619 18:45:33.061812 12166 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.334s user 0.045s sys 0.008s
W20260619 18:45:33.062287 12166 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.406s user 0.045s sys 0.008s
W20260619 18:45:33.064561 12152 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.213s user 0.006s sys 0.015s
W20260619 18:45:33.087117 12152 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.247s user 0.006s sys 0.016s
W20260619 18:45:33.092505 12170 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.881s user 0.008s sys 0.026s
W20260619 18:45:33.092957 12170 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.883s user 0.009s sys 0.026s
W20260619 18:45:33.064352 12172 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.024s user 0.018s sys 0.007s
W20260619 18:45:33.110185 12130 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.712s user 0.004s sys 0.033s
W20260619 18:45:33.110635 12130 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.755s user 0.004s sys 0.033s
W20260619 18:45:33.067646 12154 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.896s user 0.018s sys 0.045s
W20260619 18:45:33.141206 12172 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.102s user 0.019s sys 0.007s
W20260619 18:45:33.077328 12121 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 2.049s user 0.014s sys 0.020s
W20260619 18:45:33.137460 12157 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.549s user 0.021s sys 0.028s
W20260619 18:45:33.205935 12157 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.631s user 0.021s sys 0.028s
W20260619 18:45:33.143564 12010 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.963s user 0.020s sys 0.020s
W20260619 18:45:33.151854 12179 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.941s user 0.002s sys 0.018s
W20260619 18:45:33.151669 12173 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.927s user 0.007s sys 0.014s
W20260619 18:45:33.222338 12179 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.013s user 0.002s sys 0.019s
W20260619 18:45:33.221705 12173 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.002s user 0.007s sys 0.014s
W20260619 18:45:33.230671 12138 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.288s user 0.006s sys 0.020s
W20260619 18:45:33.231148 12138 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.392s user 0.006s sys 0.020s
W20260619 18:45:33.200752 12154 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.240s user 0.019s sys 0.046s
W20260619 18:45:33.215552 12121 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.215s user 0.014s sys 0.021s
W20260619 18:45:33.214459 12010 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.070s user 0.020s sys 0.020s
W20260619 18:45:33.202258 12184 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.394s user 0.000s sys 0.029s
W20260619 18:45:33.271838 12136 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.825s user 0.006s sys 0.033s
W20260619 18:45:33.271951 11039 thread.cc:636] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.880s user 0.026s sys 0.032s
W20260619 18:45:33.272279 12136 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.992s user 0.007s sys 0.033s
W20260619 18:45:33.272370 11039 thread.cc:602] server-negotiator [worker] (thread pool) Time spent starting thread: real 1.064s user 0.027s sys 0.032s
W20260619 18:45:33.269073 12184 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.541s user 0.000s sys 0.029s
W20260619 18:45:33.321586 12139 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.352s user 0.029s sys 0.058s
W20260619 18:45:33.344274 12009 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.967s user 0.009s sys 0.036s
W20260619 18:45:33.344708 12009 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.096s user 0.009s sys 0.037s
W20260619 18:45:33.351235 12134 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.119s user 0.012s sys 0.022s
W20260619 18:45:33.351639 12134 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.399s user 0.013s sys 0.023s
W20260619 18:45:33.334007 12119 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.123s user 0.013s sys 0.012s
W20260619 18:45:33.336494 12156 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 2.115s user 0.023s sys 0.042s
W20260619 18:45:33.349917 12139 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.698s user 0.029s sys 0.060s
W20260619 18:45:33.361481 12119 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.497s user 0.014s sys 0.012s
W20260619 18:45:33.358950 12183 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 2.072s user 0.009s sys 0.017s
W20260619 18:45:33.363240 12156 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.461s user 0.023s sys 0.043s
W20260619 18:45:33.371765 12155 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.511s user 0.012s sys 0.018s
W20260619 18:45:33.372216 12155 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.715s user 0.012s sys 0.019s
W20260619 18:45:33.374577 12183 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.400s user 0.009s sys 0.018s
W20260619 18:45:33.450270 12058 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:30.379322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35508 (local address 127.6.120.254:36501)
0619 18:45:30.456540 (+ 77218us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:30.456574 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:32.553679 (+2097105us) server_negotiation.cc:407] Connection header received
0619 18:45:32.564906 (+ 11227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:32.568195 (+ 3289us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:32.639179 (+ 70984us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:32.700669 (+ 61490us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:32.799640 (+ 98971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:32.885447 (+ 85807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:33.366076 (+480629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:33.438048 (+ 71972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:33.447711 (+ 9663us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35508: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":75133,"server-negotiator.queue_time_us":76674,"thread_start_us":442895,"threads_started":1}
W20260619 18:45:33.453817 12091 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:30.397445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35510 (local address 127.6.120.254:36501)
0619 18:45:30.459200 (+ 61755us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:30.459240 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:32.227585 (+1768345us) server_negotiation.cc:407] Connection header received
0619 18:45:32.286612 (+ 59027us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:32.286659 (+ 47us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:32.287024 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:32.287214 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:32.821179 (+533965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:32.878003 (+ 56824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:33.360848 (+482845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:33.438119 (+ 77271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:33.451348 (+ 13229us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35510: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":54583,"server-negotiator.queue_time_us":61214,"thread_start_us":805227,"threads_started":1}
W20260619 18:45:33.461267 12194 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:30.395788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35510)
0619 18:45:32.224667 (+1828879us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:32.225657 (+ 990us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:32.254208 (+ 28551us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:32.313238 (+ 59030us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:32.321398 (+ 8160us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:32.384550 (+ 63152us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:32.813135 (+428585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:32.816474 (+ 3339us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:32.900250 (+ 83776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:32.913338 (+ 13088us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:33.348751 (+435413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:33.353931 (+ 5180us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:33.458746 (+104815us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1665840,"mutex_wait_us":99774,"thread_start_us":806640,"threads_started":1}
W20260619 18:45:33.472575 12185 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:30.363467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35508)
0619 18:45:32.553427 (+2189960us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:32.553497 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:32.553919 (+ 422us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:32.743759 (+189840us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:32.747629 (+ 3870us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:32.782370 (+ 34741us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:32.789147 (+ 6777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:32.789231 (+ 84us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:32.914890 (+125659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:32.922286 (+ 7396us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:33.355978 (+433692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:33.357884 (+ 1906us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:33.461020 (+103136us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":2180298,"mutex_wait_us":80945,"thread_start_us":871803,"threads_started":1}
W20260619 18:45:33.509755 12143 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.877s user 0.004s sys 0.032s
W20260619 18:45:33.510233 12143 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.877s user 0.004s sys 0.032s
W20260619 18:45:33.520509 12118 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.694s user 0.008s sys 0.024s
W20260619 18:45:33.520871 12118 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.695s user 0.008s sys 0.024s
W20260619 18:45:33.522643 12137 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.891s user 0.004s sys 0.032s
W20260619 18:45:33.522989 12137 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.893s user 0.004s sys 0.032s
W20260619 18:45:33.528455 12165 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.124s user 0.014s sys 0.023s
W20260619 18:45:33.528837 12165 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.124s user 0.014s sys 0.023s
W20260619 18:45:33.529731 12163 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.691s user 0.002s sys 0.023s
W20260619 18:45:33.530048 12163 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.691s user 0.002s sys 0.023s
W20260619 18:45:33.530550 12147 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.759s user 0.009s sys 0.016s
W20260619 18:45:33.530815 12147 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.772s user 0.009s sys 0.016s
W20260619 18:45:33.531739 12146 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.746s user 0.012s sys 0.013s
W20260619 18:45:33.532181 12146 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.746s user 0.012s sys 0.013s
W20260619 18:45:33.522246 12177 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.342s user 0.025s sys 0.031s
W20260619 18:45:33.532653 12177 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.412s user 0.026s sys 0.032s
W20260619 18:45:33.520169 12161 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.159s user 0.012s sys 0.032s
W20260619 18:45:33.534049 12161 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.191s user 0.012s sys 0.033s
W20260619 18:45:33.535784 12132 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.790s user 0.011s sys 0.015s
W20260619 18:45:33.536177 12132 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.790s user 0.011s sys 0.015s
W20260619 18:45:33.539305 12148 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.115s user 0.014s sys 0.023s
W20260619 18:45:33.539597 12148 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.115s user 0.014s sys 0.023s
W20260619 18:45:33.540611 12135 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.964s user 0.022s sys 0.006s
W20260619 18:45:33.540957 12135 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.964s user 0.022s sys 0.006s
W20260619 18:45:33.544701 12117 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.024s user 0.011s sys 0.016s
W20260619 18:45:33.545044 12117 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.030s user 0.011s sys 0.016s
W20260619 18:45:33.546056 12141 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.800s user 0.004s sys 0.026s
W20260619 18:45:33.546376 12141 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.800s user 0.004s sys 0.026s
W20260619 18:45:33.548177 12127 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.679s user 0.014s sys 0.010s
W20260619 18:45:33.548460 12127 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.690s user 0.014s sys 0.010s
W20260619 18:45:33.549446 12167 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 2.297s user 0.019s sys 0.023s
W20260619 18:45:33.549737 12167 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.297s user 0.019s sys 0.023s
W20260619 18:45:33.550976 12169 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.490s user 0.011s sys 0.019s
W20260619 18:45:33.551332 12169 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.510s user 0.011s sys 0.019s
W20260619 18:45:33.562985 12164 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.740s user 0.009s sys 0.044s
W20260619 18:45:33.563475 12164 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.743s user 0.009s sys 0.044s
W20260619 18:45:33.564560 12133 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.736s user 0.012s sys 0.022s
W20260619 18:45:33.564952 12133 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.738s user 0.012s sys 0.023s
W20260619 18:45:33.565212 12158 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.744s user 0.015s sys 0.038s
W20260619 18:45:33.565582 12158 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.744s user 0.015s sys 0.038s
W20260619 18:45:33.608618 12151 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.740s user 0.011s sys 0.023s
W20260619 18:45:33.610369 12151 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.785s user 0.011s sys 0.024s
W20260619 18:45:33.661921 12171 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.574s user 0.009s sys 0.019s
W20260619 18:45:33.670063 12149 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.847s user 0.016s sys 0.024s
W20260619 18:45:33.686270 12149 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.864s user 0.016s sys 0.024s
W20260619 18:45:33.670980 12153 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.801s user 0.004s sys 0.020s
W20260619 18:45:33.685729 12171 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.622s user 0.010s sys 0.019s
W20260619 18:45:33.714979 12318 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:30.561508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35524)
0619 18:45:33.111187 (+2549679us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:33.144408 (+ 33221us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:33.233899 (+ 89491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:33.313695 (+ 79796us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:33.314968 (+ 1273us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:33.334424 (+ 19456us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:33.454788 (+120364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:33.454897 (+ 109us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:33.463485 (+ 8588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:33.463541 (+ 56us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:33.480207 (+ 16666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:33.480391 (+ 184us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:33.487979 (+ 7588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:33.488031 (+ 52us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:33.488746 (+ 715us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:33.501265 (+ 12519us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:33.501305 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:33.501400 (+ 95us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:33.501593 (+ 193us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:33.636096 (+134503us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":2372412,"mutex_wait_us":43392,"thread_start_us":2195679,"threads_started":1}
W20260619 18:45:33.819379 12081 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:30.949511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35524 (local address 127.6.120.254:36501)
0619 18:45:31.271799 (+322288us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:31.284142 (+ 12343us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:33.163785 (+1879643us) server_negotiation.cc:407] Connection header received
0619 18:45:33.271847 (+108062us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:33.271887 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:33.272174 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:33.272364 (+ 190us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:33.455420 (+183056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:33.457586 (+ 2166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:33.480780 (+ 23194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:33.482111 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:33.482549 (+ 438us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:33.502082 (+ 19533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 18:45:33.502131 (+ 49us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 18:45:33.502218 (+ 87us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 18:45:33.502307 (+ 89us) server_negotiation.cc:922] calling sasl_server_start()
0619 18:45:33.502424 (+ 117us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 18:45:33.502493 (+ 69us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 18:45:33.502686 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0619 18:45:33.619901 (+117215us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35524: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"mutex_wait_us":1957,"server-negotiator.queue_time_us":9041}
W20260619 18:45:33.673682 12088 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.777s user 0.009s sys 0.016s
W20260619 18:45:33.821969 12088 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.925s user 0.009s sys 0.016s
W20260619 18:45:33.707146 12153 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.844s user 0.004s sys 0.020s
W20260619 18:45:33.868949 11039 thread.cc:636] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.511s user 0.003s sys 0.001s
W20260619 18:45:33.869580 11039 thread.cc:602] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.517s user 0.004s sys 0.001s
W20260619 18:45:34.558554 12042 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.571s user 0.006s sys 0.029s
W20260619 18:45:34.458704 12160 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.577s user 0.021s sys 0.023s
W20260619 18:45:34.559564 12003 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.566s user 0.010s sys 0.025s
W20260619 18:45:34.557179 12080 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.510s user 0.017s sys 0.023s
W20260619 18:45:34.563421 12180 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.541s user 0.024s sys 0.037s
W20260619 18:45:34.590438 12042 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.636s user 0.006s sys 0.030s
W20260619 18:45:34.610363 12160 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.729s user 0.022s sys 0.023s
W20260619 18:45:34.669072 12080 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.719s user 0.018s sys 0.024s
W20260619 18:45:34.644415 12180 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.677s user 0.024s sys 0.037s
W20260619 18:45:34.670773 12186 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 2.186s user 0.046s sys 0.049s
W20260619 18:45:34.587870 12003 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.629s user 0.010s sys 0.026s
W20260619 18:45:34.755846 12134 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.401s user 0.003s sys 0.020s
W20260619 18:45:34.756364 12134 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.402s user 0.004s sys 0.020s
W20260619 18:45:34.753432 12186 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.504s user 0.046s sys 0.051s
W20260619 18:45:34.750658 12028 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.622s user 0.021s sys 0.034s
W20260619 18:45:34.789847 12057 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.557s user 0.012s sys 0.034s
W20260619 18:45:34.810335 12145 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.616s user 0.009s sys 0.024s
W20260619 18:45:34.848502 12166 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.547s user 0.008s sys 0.060s
W20260619 18:45:34.850343 12170 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.540s user 0.011s sys 0.027s
W20260619 18:45:34.850175 12028 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.951s user 0.022s sys 0.035s
W20260619 18:45:34.854377 12057 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.902s user 0.014s sys 0.035s
W20260619 18:45:34.904588 12145 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.943s user 0.010s sys 0.027s
W20260619 18:45:34.887960 12157 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.465s user 0.018s sys 0.019s
W20260619 18:45:34.910315 12166 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.847s user 0.008s sys 0.061s
W20260619 18:45:34.883767 12195 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.548s user 0.017s sys 0.046s
W20260619 18:45:34.892331 12140 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.823s user 0.018s sys 0.019s
W20260619 18:45:34.906208 12170 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.813s user 0.014s sys 0.027s
W20260619 18:45:34.883932 12193 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.525s user 0.005s sys 0.033s
W20260619 18:45:34.932521 12138 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.346s user 0.018s sys 0.019s
W20260619 18:45:34.910715 12198 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.546s user 0.019s sys 0.050s
W20260619 18:45:34.992736 12157 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.786s user 0.018s sys 0.020s
W20260619 18:45:34.961148 12119 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.346s user 0.009s sys 0.025s
W20260619 18:45:34.991197 12121 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.359s user 0.005s sys 0.028s
W20260619 18:45:34.934113 12238 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.541s user 0.013s sys 0.025s
W20260619 18:45:35.002457 12140 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.147s user 0.018s sys 0.023s
W20260619 18:45:34.965898 12033 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.846s user 0.016s sys 0.046s
W20260619 18:45:35.022523 12025 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.377s user 0.010s sys 0.018s
W20260619 18:45:35.012668 12138 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.667s user 0.018s sys 0.019s
W20260619 18:45:35.005851 12130 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.374s user 0.014s sys 0.023s
W20260619 18:45:34.997684 12200 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.383s user 0.012s sys 0.025s
W20260619 18:45:35.047919 12119 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.677s user 0.009s sys 0.026s
W20260619 18:45:35.022300 12195 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.983s user 0.017s sys 0.047s
W20260619 18:45:35.049094 12193 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 2.011s user 0.005s sys 0.035s
W20260619 18:45:35.051898 12025 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.609s user 0.010s sys 0.018s
W20260619 18:45:35.019531 12174 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 2.214s user 0.002s sys 0.023s
W20260619 18:45:35.048585 12041 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.214s user 0.012s sys 0.013s
W20260619 18:45:35.061365 12121 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.695s user 0.005s sys 0.029s
W20260619 18:45:35.061777 12198 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.964s user 0.020s sys 0.051s
W20260619 18:45:35.054103 12073 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.240s user 0.010s sys 0.028s
W20260619 18:45:35.116367 12127 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.567s user 0.007s sys 0.034s
W20260619 18:45:35.117086 10949 thread.cc:636] server-negotiator [worker] (thread pool) Time spent creating pthread: real 1.777s user 0.016s sys 0.025s
W20260619 18:45:35.095829 12130 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.739s user 0.014s sys 0.024s
W20260619 18:45:35.102479 12200 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.820s user 0.014s sys 0.031s
W20260619 18:45:35.090657 12118 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.294s user 0.023s sys 0.049s
W20260619 18:45:35.095489 12204 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.224s user 0.029s sys 0.045s
W20260619 18:45:35.104727 12033 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 2.267s user 0.017s sys 0.047s
W20260619 18:45:35.100800 12171 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.193s user 0.020s sys 0.013s
W20260619 18:45:35.113543 12238 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 2.007s user 0.013s sys 0.026s
W20260619 18:45:35.761968 10949 thread.cc:602] server-negotiator [worker] (thread pool) Time spent starting thread: real 2.422s user 0.016s sys 0.049s
W20260619 18:45:35.762763 12118 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.217s user 0.025s sys 0.084s
W20260619 18:45:35.114450 12183 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.420s user 0.017s sys 0.053s
W20260619 18:45:35.105720 10951 thread.cc:636] server-negotiator [worker] (thread pool) Time spent creating pthread: real 1.684s user 0.002s sys 0.022s
W20260619 18:45:35.112357 12047 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.793s user 0.011s sys 0.015s
W20260619 18:45:35.393980 12165 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.733s user 0.017s sys 0.023s
W20260619 18:45:35.114722 12156 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.411s user 0.004s sys 0.021s
W20260619 18:45:35.302366 12177 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.429s user 0.015s sys 0.014s
W20260619 18:45:35.234436 12041 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.722s user 0.012s sys 0.015s
W20260619 18:45:35.232875 12127 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.684s user 0.007s sys 0.035s
W20260619 18:45:35.764158 12171 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.938s user 0.025s sys 0.022s
W20260619 18:45:35.795981 12204 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 2.268s user 0.055s sys 0.087s
W20260619 18:45:35.118664 12174 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.575s user 0.002s sys 0.024s
W20260619 18:45:35.762204 11991 scanner-internal.cc:458] Time spent opening tablet: real 4.977s user 0.006s sys 0.007s
W20260619 18:45:35.784673 12183 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.351s user 0.036s sys 0.101s
W20260619 18:45:35.265019 12073 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.754s user 0.010s sys 0.029s
W20260619 18:45:35.343016 12155 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.626s user 0.003s sys 0.028s
W20260619 18:45:35.124569 12192 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.565s user 0.028s sys 0.045s
W20260619 18:45:35.436870 12229 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.483s user 0.032s sys 0.041s
W20260619 18:45:35.279433 12158 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.335s user 0.014s sys 0.014s
W20260619 18:45:35.217003 12218 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.948s user 0.015s sys 0.055s
W20260619 18:45:35.283202 12148 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.417s user 0.016s sys 0.015s
W20260619 18:45:35.832149 12186 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.708s user 0.010s sys 0.027s
W20260619 18:45:35.341995 12230 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.213s user 0.009s sys 0.017s
W20260619 18:45:35.302253 12222 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.373s user 0.020s sys 0.054s
W20260619 18:45:35.831310 12047 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 2.787s user 0.026s sys 0.030s
W20260619 18:45:35.600427 12246 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.413s user 0.015s sys 0.056s
W20260619 18:45:35.331197 12164 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.431s user 0.000s sys 0.029s
W20260619 18:45:35.752463 12167 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.775s user 0.044s sys 0.072s
W20260619 18:45:35.234831 12104 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 2.151s user 0.015s sys 0.028s
W20260619 18:45:35.511941 10950 thread.cc:636] server-negotiator [worker] (thread pool) Time spent creating pthread: real 1.904s user 0.018s sys 0.013s
W20260619 18:45:35.832728 12156 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.395s user 0.013s sys 0.038s
W20260619 18:45:35.845453 12177 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.300s user 0.021s sys 0.025s
W20260619 18:45:35.858469 12165 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.329s user 0.022s sys 0.031s
W20260619 18:45:35.718518 12184 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.975s user 0.024s sys 0.074s
W20260619 18:45:35.529547 12153 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.469s user 0.014s sys 0.047s
W20260619 18:45:35.725283 12241 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.415s user 0.025s sys 0.008s
W20260619 18:45:35.442431 12237 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.559s user 0.018s sys 0.046s
W20260619 18:45:35.481313 12203 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.504s user 0.009s sys 0.024s
W20260619 18:45:35.853650 10951 thread.cc:602] server-negotiator [worker] (thread pool) Time spent starting thread: real 2.774s user 0.016s sys 0.036s
W20260619 18:45:35.886585 12155 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.513s user 0.007s sys 0.043s
W20260619 18:45:35.899582 12158 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.291s user 0.018s sys 0.029s
W20260619 18:45:35.911530 12186 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.797s user 0.018s sys 0.031s
W20260619 18:45:35.454788 12143 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.540s user 0.034s sys 0.056s
W20260619 18:45:35.914443 12229 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 2.377s user 0.040s sys 0.052s
W20260619 18:45:35.469234 12235 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.641s user 0.011s sys 0.016s
W20260619 18:45:35.978242 12164 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.414s user 0.005s sys 0.043s
W20260619 18:45:35.588428 12242 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.377s user 0.017s sys 0.013s
W20260619 18:45:35.647433 12205 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.451s user 0.003s sys 0.031s
W20260619 18:45:35.529389 12147 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.866s user 0.025s sys 0.036s
W20260619 18:45:35.986035 12246 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 2.344s user 0.016s sys 0.061s
W20260619 18:45:35.679797 12215 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.578s user 0.018s sys 0.019s
W20260619 18:45:35.931703 12148 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.392s user 0.017s sys 0.032s
W20260619 18:45:35.930521 12218 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 2.033s user 0.024s sys 0.068s
W20260619 18:45:35.887383 12233 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.842s user 0.006s sys 0.051s
W20260619 18:45:35.974807 12153 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.138s user 0.021s sys 0.050s
W20260619 18:45:35.937070 12117 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.956s user 0.019s sys 0.038s
W20260619 18:45:35.996724 12167 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.447s user 0.046s sys 0.073s
W20260619 18:45:36.002592 10950 thread.cc:602] server-negotiator [worker] (thread pool) Time spent starting thread: real 2.858s user 0.019s sys 0.017s
W20260619 18:45:35.986560 12184 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.666s user 0.030s sys 0.075s
W20260619 18:45:35.928337 12154 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 2.159s user 0.019s sys 0.036s
W20260619 18:45:35.996399 12230 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 2.284s user 0.012s sys 0.032s
W20260619 18:45:35.975272 12192 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 2.693s user 0.032s sys 0.071s
W20260619 18:45:36.040587 12242 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 2.323s user 0.021s sys 0.014s
W20260619 18:45:35.937543 12133 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.936s user 0.003s sys 0.053s
W20260619 18:45:36.031499 12104 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 3.065s user 0.018s sys 0.048s
W20260619 18:45:35.998766 12201 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.821s user 0.016s sys 0.025s
W20260619 18:45:36.027976 12222 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 2.495s user 0.020s sys 0.074s
W20260619 18:45:36.054423 12241 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 2.344s user 0.026s sys 0.012s
W20260619 18:45:35.967325 12220 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.853s user 0.025s sys 0.087s
W20260619 18:45:36.034643 12357 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 2.117s user 0.015s sys 0.031s
W20260619 18:45:36.006973 12207 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 2.016s user 0.028s sys 0.027s
W20260619 18:45:36.053910 12237 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 2.677s user 0.022s sys 0.049s
W20260619 18:45:36.139914 12133 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.574s user 0.003s sys 0.056s
W20260619 18:45:36.067576 12143 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.556s user 0.035s sys 0.061s
W20260619 18:45:36.094376 12117 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.549s user 0.020s sys 0.038s
W20260619 18:45:36.130017 12154 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.808s user 0.020s sys 0.038s
W20260619 18:45:36.287498 12201 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 2.711s user 0.019s sys 0.025s
W20260619 18:45:36.062463 12203 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 2.518s user 0.011s sys 0.028s
W20260619 18:45:36.076035 12030 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 2.103s user 0.020s sys 0.036s
W20260619 18:45:36.159905 12061 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.178s user 0.022s sys 0.043s
W20260619 18:45:36.140303 12235 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 2.781s user 0.011s sys 0.020s
W20260619 18:45:36.191455 12205 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 2.543s user 0.003s sys 0.035s
W20260619 18:45:36.191215 12233 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 2.637s user 0.006s sys 0.056s
W20260619 18:45:36.187088 12215 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 2.652s user 0.018s sys 0.025s
W20260619 18:45:36.095561 12147 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.564s user 0.027s sys 0.044s
W20260619 18:45:36.593513 12357 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 3.226s user 0.016s sys 0.051s
W20260619 18:45:36.593303 12207 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 3.124s user 0.029s sys 0.042s
W20260619 18:45:36.628201 12468 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.793366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33720 (local address 127.6.120.193:37901)
0619 18:45:33.893939 (+100573us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:33.893999 (+ 60us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:35.533017 (+1639018us) server_negotiation.cc:407] Connection header received
0619 18:45:35.533753 (+ 736us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:35.533799 (+ 46us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:35.534405 (+ 606us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:35.534677 (+ 272us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:36.600250 (+1065573us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33720: BlockingRecv error: recv got EOF from 127.0.0.1:33720 (error 108)
Metrics: {"server-negotiator.queue_time_us":99832}
W20260619 18:45:36.615150 12220 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 3.000s user 0.030s sys 0.103s
W20260619 18:45:36.624349 12061 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 2.328s user 0.025s sys 0.056s
W20260619 18:45:36.628957 12030 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 3.212s user 0.030s sys 0.041s
W20260619 18:45:36.712265 12182 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.064060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35548 (local address 127.6.120.254:36501)
0619 18:45:33.327222 (+263162us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:33.329275 (+ 2053us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:36.625419 (+3296144us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35548: received 0 of 7 requested bytes
Metrics: {"server-negotiator.queue_time_us":41729,"thread_start_us":2919683,"threads_started":1}
W20260619 18:45:36.708437 12413 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.016685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35708 (local address 127.6.120.254:36501)
0619 18:45:36.027403 (+ 10718us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:36.027443 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:36.691894 (+664451us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35708: BlockingRecv error: recv got EOF from 127.0.0.1:35708 (error 108)
Metrics: {"server-negotiator.queue_time_us":10164}
W20260619 18:45:36.782795 12087 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.106937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35574 (local address 127.6.120.254:36501)
0619 18:45:33.463139 (+356202us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:33.463180 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:36.671474 (+3208294us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35574: received 0 of 7 requested bytes
Metrics: {"server-negotiator.queue_time_us":328098}
W20260619 18:45:36.788905 12093 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.813s user 0.004s sys 0.054s
W20260619 18:45:36.980033 12187 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:32.928034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35544 (local address 127.6.120.254:36501)
0619 18:45:32.955074 (+ 27040us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:32.955112 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:35.696278 (+2741166us) server_negotiation.cc:407] Connection header received
0619 18:45:35.696508 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:35.696547 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:35.740254 (+ 43707us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:35.740588 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:35.758481 (+ 17893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:35.760882 (+ 2401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:36.504305 (+743423us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35544: received 0 of 4 requested bytes
Metrics: {"server-negotiator.queue_time_us":3883}
W20260619 18:45:36.980921 12093 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.019s user 0.006s sys 0.061s
W20260619 18:45:37.440176 10950 thread.cc:636] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.839s user 0.000s sys 0.014s
W20260619 18:45:37.392805 12228 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.361s user 0.034s sys 0.071s
W20260619 18:45:37.220911 12167 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.670s user 0.005s sys 0.021s
W20260619 18:45:38.158366 10950 thread.cc:602] server-negotiator [worker] (thread pool) Time spent starting thread: real 1.573s user 0.000s sys 0.044s
W20260619 18:45:37.492035 12156 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.960s user 0.005s sys 0.010s
W20260619 18:45:37.366031 12183 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.338s user 0.016s sys 0.017s
W20260619 18:45:37.731685 12174 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.218s user 0.025s sys 0.021s
W20260619 18:45:37.384634 12186 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.057s user 0.015s sys 0.029s
W20260619 18:45:37.706331 12154 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.012s user 0.010s sys 0.030s
W20260619 18:45:37.427894 10949 thread.cc:636] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.844s user 0.009s sys 0.026s
W20260619 18:45:37.650867 12447 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.536934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35670)
0619 18:45:36.540512 (+3003578us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:36.540886 (+ 374us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":3002809,"thread_start_us":2498513,"threads_started":1}
W20260619 18:45:38.154140 12228 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 2.357s user 0.060s sys 0.111s
W20260619 18:45:37.834342 11040 thread.cc:636] server-negotiator [worker] (thread pool) Time spent creating pthread: real 1.047s user 0.003s sys 0.027s
W20260619 18:45:38.384131 11040 thread.cc:602] server-negotiator [worker] (thread pool) Time spent starting thread: real 1.931s user 0.009s sys 0.037s
W20260619 18:45:37.325631 11042 thread.cc:636] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.648s user 0.019s sys 0.005s
W20260619 18:45:37.310618 11041 thread.cc:636] server-negotiator [worker] (thread pool) Time spent creating pthread: real 1.570s user 0.023s sys 0.032s
W20260619 18:45:37.791316 12357 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.166s user 0.019s sys 0.021s
W20260619 18:45:37.650561 12014 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.144735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35586 (local address 127.6.120.254:36501)
0619 18:45:33.437603 (+292868us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:33.437633 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:36.014485 (+2576852us) server_negotiation.cc:407] Connection header received
0619 18:45:36.014787 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:36.014828 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:36.015171 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:36.015435 (+ 264us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:36.041145 (+ 25710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:36.043446 (+ 2301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:36.047374 (+ 3928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:36.048959 (+ 1585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:36.049417 (+ 458us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:36.549116 (+499699us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35586: received 0 of 4 requested bytes
Metrics: {"server-negotiator.queue_time_us":292460,"thread_start_us":2922323,"threads_started":1}
W20260619 18:45:38.279945 12167 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.729s user 0.048s sys 0.090s
W20260619 18:45:37.731838 10951 thread.cc:636] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.938s user 0.012s sys 0.044s
W20260619 18:45:38.296049 12156 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.765s user 0.037s sys 0.019s
W20260619 18:45:37.758334 12225 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.789s user 0.006s sys 0.006s
W20260619 18:45:37.544934 12045 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.744s user 0.011s sys 0.000s
W20260619 18:45:37.595758 12110 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.443s user 0.005s sys 0.017s
W20260619 18:45:38.306304 12183 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.265s user 0.052s sys 0.047s
W20260619 18:45:37.791720 12052 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.641s user 0.005s sys 0.016s
W20260619 18:45:37.838497 12120 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.592s user 0.005s sys 0.017s
W20260619 18:45:38.087352 12074 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.829s user 0.004s sys 0.016s
W20260619 18:45:38.363845 12154 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.677s user 0.026s sys 0.054s
W20260619 18:45:38.367762 12174 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.869s user 0.028s sys 0.032s
W20260619 18:45:38.368664 10949 thread.cc:602] server-negotiator [worker] (thread pool) Time spent starting thread: real 1.785s user 0.020s sys 0.043s
W20260619 18:45:37.484544 12046 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.832s user 0.000s sys 0.014s
W20260619 18:45:37.849921 12211 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.026s user 0.001s sys 0.015s
W20260619 18:45:38.396940 11041 thread.cc:602] server-negotiator [worker] (thread pool) Time spent starting thread: real 2.736s user 0.036s sys 0.066s
W20260619 18:45:37.805377 12239 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.852s user 0.007s sys 0.008s
W20260619 18:45:37.526310 12227 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.743s user 0.006s sys 0.007s
W20260619 18:45:38.363642 12186 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.037s user 0.047s sys 0.059s
W20260619 18:45:38.087502 12234 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.943s user 0.026s sys 0.033s
W20260619 18:45:38.493038 12363 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.352862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33718 (local address 127.6.120.193:37901)
0619 18:45:33.646330 (+293468us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:33.646362 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:36.938482 (+3292120us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:33718: received 0 of 7 requested bytes
Metrics: {"server-negotiator.queue_time_us":293049,"thread_start_us":516816,"threads_started":1}
W20260619 18:45:38.493145 12412 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.103903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35590)
0619 18:45:37.686372 (+4582469us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:37.686591 (+ 219us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":4581872,"thread_start_us":2657739,"threads_started":1}
W20260619 18:45:38.432894 11042 thread.cc:602] server-negotiator [worker] (thread pool) Time spent starting thread: real 1.882s user 0.032s sys 0.039s
W20260619 18:45:38.475338 12225 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.906s user 0.008s sys 0.025s
W20260619 18:45:38.457376 10951 thread.cc:602] server-negotiator [worker] (thread pool) Time spent starting thread: real 1.663s user 0.014s sys 0.053s
W20260619 18:45:38.496661 12120 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.719s user 0.018s sys 0.024s
W20260619 18:45:38.458982 12357 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.833s user 0.025s sys 0.039s
W20260619 18:45:38.494895 12052 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.703s user 0.010s sys 0.031s
W20260619 18:45:38.476071 12110 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 2.419s user 0.015s sys 0.024s
W20260619 18:45:38.509852 12046 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.900s user 0.009s sys 0.029s
W20260619 18:45:38.499500 12045 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 2.047s user 0.022s sys 0.014s
W20260619 18:45:38.495586 12074 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.556s user 0.012s sys 0.027s
W20260619 18:45:38.510466 12211 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.979s user 0.023s sys 0.015s
W20260619 18:45:39.013481 12460 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.636246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35726)
0619 18:45:36.773077 (+3136831us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:36.773445 (+ 368us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":2855266,"thread_start_us":2410176,"threads_started":1}
W20260619 18:45:38.539418 12227 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 2.047s user 0.016s sys 0.022s
W20260619 18:45:38.538259 12239 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.847s user 0.019s sys 0.013s
W20260619 18:45:38.551391 12087 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.017573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35752 (local address 127.6.120.254:36501)
0619 18:45:36.783832 (+766259us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:36.783870 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:36.783944 (+ 74us) server_negotiation.cc:407] Connection header received
0619 18:45:36.964705 (+180761us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35752: BlockingRecv error: recv got EOF from 127.0.0.1:35752 (error 108)
Metrics: {"server-negotiator.queue_time_us":765772}
W20260619 18:45:38.566255 12466 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.017158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35740 (local address 127.6.120.254:36501)
0619 18:45:36.774796 (+757638us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:36.776885 (+ 2089us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:37.874165 (+1097280us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35740: BlockingRecv error: recv got EOF from 127.0.0.1:35740 (error 108)
Metrics: {"server-negotiator.queue_time_us":591352}
W20260619 18:45:38.962718 12221 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.858s user 0.041s sys 0.067s
W20260619 18:45:38.574914 12081 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.782362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35736 (local address 127.6.120.254:36501)
0619 18:45:33.821320 (+ 38958us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:33.821362 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:36.938951 (+3117589us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35736: received 0 of 7 requested bytes
Metrics: {"server-negotiator.queue_time_us":38370}
W20260619 18:45:38.798593 12411 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.793169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35590 (local address 127.6.120.254:36501)
0619 18:45:37.691704 (+898535us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:37.705530 (+ 13826us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:37.819816 (+114286us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35590: BlockingRecv error: recv got EOF from 127.0.0.1:35590 (error 108)
Metrics: {"server-negotiator.queue_time_us":576286}
W20260619 18:45:38.551241 12234 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.763s user 0.030s sys 0.041s
W20260619 18:45:39.043355 12231 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.951s user 0.045s sys 0.084s
W20260619 18:45:39.043951 12231 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.952s user 0.045s sys 0.085s
W20260619 18:45:39.046674 10950 thread.cc:636] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.644s user 0.001s sys 0.000s
W20260619 18:45:39.047035 10950 thread.cc:602] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.652s user 0.001s sys 0.001s
W20260619 18:45:39.086194 12440 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.512542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:33724)
0619 18:45:37.733896 (+4221354us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:37.819953 (+ 86057us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":3883276,"thread_start_us":2304034,"threads_started":1}
W20260619 18:45:39.086475 11040 thread.cc:636] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.631s user 0.001s sys 0.010s
W20260619 18:45:39.086862 11040 thread.cc:602] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.637s user 0.001s sys 0.010s
W20260619 18:45:39.045015 12217 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.641s user 0.000s sys 0.002s
W20260619 18:45:39.129222 12477 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:35.796272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35766)
0619 18:45:37.968014 (+2171742us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:37.968076 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:37.968508 (+ 432us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:38.869748 (+901240us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":2171039,"thread_start_us":2587441,"threads_started":1}
W20260619 18:45:39.130265 12488 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:35.898185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33750 (local address 127.6.120.193:37901)
0619 18:45:37.877154 (+1978969us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:37.936952 (+ 59798us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:38.951551 (+1014599us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:33750: received 0 of 7 requested bytes
Metrics: {"server-negotiator.queue_time_us":1794203,"thread_start_us":240581,"threads_started":1}
W20260619 18:45:39.130779 12417 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.195224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35574)
0619 18:45:37.757403 (+4562179us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:37.819772 (+ 62369us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":4226698,"thread_start_us":2866000,"threads_started":1}
W20260619 18:45:39.131626 12463 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.712464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35740)
0619 18:45:37.791773 (+4079309us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:37.843965 (+ 52192us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":3726195,"thread_start_us":2378332,"threads_started":1}
W20260619 18:45:39.133167 12434 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.411251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:33718)
0619 18:45:38.003401 (+4592150us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:38.157812 (+154411us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":4287481,"thread_start_us":3248027,"threads_started":1}
W20260619 18:45:39.133225 12448 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.538502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35686)
0619 18:45:38.629300 (+5090798us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:38.886615 (+257315us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":4602490,"thread_start_us":3062069,"threads_started":1}
W20260619 18:45:39.144562 12471 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.896913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35762)
0619 18:45:37.838196 (+3941283us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:37.842766 (+ 4570us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":3745259,"thread_start_us":2171052,"threads_started":1}
W20260619 18:45:38.641204 12229 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 163113us
W20260619 18:45:39.033665 12238 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 287511us
W20260619 18:45:39.185760 12479 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:35.726785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:33734)
0619 18:45:39.000676 (+3273891us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.001004 (+ 328us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":2959261,"thread_start_us":1078908,"threads_started":1}
W20260619 18:45:39.186697 12437 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.469394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35618)
0619 18:45:37.806201 (+4336807us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:37.806521 (+ 320us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":4336080,"thread_start_us":3152855,"threads_started":1}
I20260619 18:45:39.186599 12057 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:39.187441 12057 scanner-internal.cc:458] Time spent opening tablet: real 6.236s user 0.015s sys 0.037s
W20260619 18:45:39.187659 12446 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.534917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35662)
0619 18:45:37.967823 (+4432906us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:37.968282 (+ 459us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":4299690,"thread_start_us":3091426,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: Timeout exceeded waiting to connect
W20260619 18:45:39.189235 12461 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.648257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35734)
0619 18:45:36.705840 (+3057583us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:36.882240 (+176400us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":2901999,"thread_start_us":2977880,"threads_started":1}
W20260619 18:45:39.190084 12438 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.510339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:33720)
0619 18:45:35.532628 (+2022289us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:35.532739 (+ 111us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:35.533408 (+ 669us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:35.620789 (+ 87381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:35.647212 (+ 26423us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:35.679584 (+ 32372us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:36.512914 (+833330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:36.525882 (+ 12968us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:36.618143 (+ 92261us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":2021418,"mutex_wait_us":784,"thread_start_us":2362717,"threads_started":1}
W20260619 18:45:39.168941 12217 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.767s user 0.000s sys 0.003s
W20260619 18:45:39.180317 12182 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.585395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35606 (local address 127.6.120.254:36501)
0619 18:45:36.972714 (+387319us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:36.972756 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:36.972836 (+ 80us) server_negotiation.cc:407] Connection header received
0619 18:45:36.973026 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:36.973059 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:36.973438 (+ 379us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:36.973687 (+ 249us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:38.386560 (+1412873us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35606: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"mutex_wait_us":1143836,"server-negotiator.queue_time_us":386768,"thread_start_us":1703062,"threads_started":1}
W20260619 18:45:39.208143 12490 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.793598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35594 (local address 127.6.120.254:36501)
0619 18:45:38.217732 (+1424134us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:38.264277 (+ 46545us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:38.449398 (+185121us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35594: BlockingRecv error: recv got EOF from 127.0.0.1:35594 (error 108)
Metrics: {"server-negotiator.queue_time_us":1025711,"thread_start_us":2208255,"threads_started":1}
W20260619 18:45:39.210258 12490 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.176005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35618 (local address 127.6.120.254:36501)
0619 18:45:39.209098 (+ 33093us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.209136 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.209510 (+ 374us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35618: BlockingRecv error: recv got EOF from 127.0.0.1:35618 (error 108)
Metrics: {"server-negotiator.queue_time_us":28904}
W20260619 18:45:39.211318 12187 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.569385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35564 (local address 127.6.120.254:36501)
0619 18:45:36.982061 (+412676us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:36.982098 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.053301 (+2071203us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35564: BlockingRecv error: recv got EOF from 127.0.0.1:35564 (error 108)
Metrics: {"mutex_wait_us":28815,"server-negotiator.queue_time_us":395558,"thread_start_us":172313,"threads_started":1}
W20260619 18:45:39.097761 12221 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.085s user 0.042s sys 0.068s
I20260619 18:45:39.191186 12051 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:39.283208 12051 scanner-internal.cc:458] Time spent opening tablet: real 6.792s user 0.001s sys 0.013s
I20260619 18:45:39.283692 12017 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:39.284320 12017 scanner-internal.cc:458] Time spent opening tablet: real 7.924s user 0.023s sys 0.010s
I20260619 18:45:39.284940 12010 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:39.285490 12010 scanner-internal.cc:458] Time spent opening tablet: real 7.657s user 0.025s sys 0.022s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: Timeout exceeded waiting to connect
W20260619 18:45:39.287926 12182 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.272434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35686 (local address 127.6.120.254:36501)
0619 18:45:39.284288 (+ 11854us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.284323 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.284628 (+ 305us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35686: BlockingRecv error: recv got EOF from 127.0.0.1:35686 (error 108)
Metrics: {"server-negotiator.queue_time_us":8767}
W20260619 18:45:39.270323 12468 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:35.660991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33734 (local address 127.6.120.193:37901)
0619 18:45:36.674982 (+1013991us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:36.675018 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:38.638012 (+1962994us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:33734: received 0 of 7 requested bytes
Metrics: {"server-negotiator.queue_time_us":1005059,"thread_start_us":2833422,"threads_started":1}
W20260619 18:45:39.297076 12091 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.781716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35636 (local address 127.6.120.254:36501)
0619 18:45:33.817782 (+ 36066us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:33.817843 (+ 61us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:36.939342 (+3121499us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35636: received 0 of 7 requested bytes
Metrics: {"server-negotiator.queue_time_us":35179}
W20260619 18:45:39.270752 12218 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 64288.4us
W20260619 18:45:39.339164 12247 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.184s user 0.046s sys 0.084s
W20260619 18:45:39.356555 12247 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.216s user 0.046s sys 0.085s
W20260619 18:45:39.271514 12246 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 109573us
W20260619 18:45:39.344868 12318 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.719498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35756)
0619 18:45:33.725141 (+ 5643us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:33.725213 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:33.725568 (+ 355us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:37.596428 (+3870860us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":4971}
W20260619 18:45:39.359006 12014 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.294571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35624 (local address 127.6.120.254:36501)
0619 18:45:38.952621 (+658050us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:38.959425 (+ 6804us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:38.963266 (+ 3841us) server_negotiation.cc:407] Connection header received
0619 18:45:38.986991 (+ 23725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:38.988330 (+ 1339us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:38.995126 (+ 6796us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.025837 (+ 30711us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35624: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"server-negotiator.queue_time_us":244856}
W20260619 18:45:39.381538 12462 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.709704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35736)
0619 18:45:38.367167 (+4657463us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:38.470610 (+103443us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":4176878,"thread_start_us":2846593,"threads_started":1}
W20260619 18:45:39.358718 12058 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.339525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35600 (local address 127.6.120.254:36501)
0619 18:45:33.476980 (+137455us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:33.477021 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:36.937915 (+3460894us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35600: received 0 of 7 requested bytes
Metrics: {"server-negotiator.queue_time_us":136825,"thread_start_us":2423432,"threads_started":1}
W20260619 18:45:39.369830 12194 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.466306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35606)
0619 18:45:33.507704 (+ 41398us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:33.507755 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:33.508866 (+ 1111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:37.013495 (+3504629us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":40810,"mutex_wait_us":40350}
W20260619 18:45:39.394832 12419 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.196264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35564)
0619 18:45:38.996490 (+5800226us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.053159 (+ 56669us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":5366142,"thread_start_us":2489625,"threads_started":1}
W20260619 18:45:39.370215 12185 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.479109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35624)
0619 18:45:33.618713 (+139604us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:33.618779 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:33.619094 (+ 315us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:36.937265 (+3318171us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":124563,"mutex_wait_us":27484}
W20260619 18:45:39.370437 12459 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.614459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35710)
0619 18:45:37.849275 (+4234816us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:37.849559 (+ 284us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":4228432,"thread_start_us":3049455,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: Timeout exceeded waiting to connect
W20260619 18:45:39.397658 12464 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.717346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35752)
0619 18:45:36.685560 (+2968214us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:36.706112 (+ 20552us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:36.813222 (+107110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:36.939681 (+126459us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":2735241,"thread_start_us":2382119,"threads_started":1}
W20260619 18:45:39.410394 12483 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.451931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35772)
0619 18:45:38.050024 (+1598093us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:38.073000 (+ 22976us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:38.238802 (+165802us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.384754 (+1145952us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1397803,"thread_start_us":2533207,"threads_started":1}
W20260619 18:45:39.406973 12431 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.327428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35594)
0619 18:45:37.642122 (+4314694us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:37.778597 (+136475us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":4033257,"thread_start_us":3266686,"threads_started":1}
W20260619 18:45:39.408180 12455 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.554002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35708)
0619 18:45:36.669302 (+3115300us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:36.716591 (+ 47289us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":3045969,"thread_start_us":3067466,"threads_started":1}
W20260619 18:45:39.415349 12405 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.037823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35548)
0619 18:45:37.863258 (+4825435us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:37.863611 (+ 353us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":4719390,"thread_start_us":2067397,"threads_started":1}
W20260619 18:45:39.402034 10949 thread.cc:602] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.516s user 0.011s sys 0.021s
W20260619 18:45:39.470528 12208 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 477806us
W20260619 18:45:39.458822 12432 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.359333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35600)
0619 18:45:37.686209 (+4326876us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:37.686547 (+ 338us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":4083920,"thread_start_us":3175946,"threads_started":1}
W20260619 18:45:39.471601 12502 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.416311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35734 (local address 127.6.120.254:36501)
0619 18:45:39.470370 (+ 54059us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.470416 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.470783 (+ 367us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35734: BlockingRecv error: recv got EOF from 127.0.0.1:35734 (error 108)
Metrics: {"mutex_wait_us":41213,"server-negotiator.queue_time_us":44850}
W20260619 18:45:39.504981 12480 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.345048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33764 (local address 127.6.120.193:37901)
0619 18:45:37.838224 (+1493176us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:37.838270 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.325235 (+1486965us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:33764: received 0 of 7 requested bytes
Metrics: {"server-negotiator.queue_time_us":1360955,"thread_start_us":1957060,"threads_started":1}
W20260619 18:45:39.499315 12467 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.794023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33724 (local address 127.6.120.193:37901)
0619 18:45:35.047611 (+1253588us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:35.049864 (+ 2253us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:36.804697 (+1754833us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:33724: received 0 of 7 requested bytes
Metrics: {"server-negotiator.queue_time_us":964061,"thread_start_us":90497,"threads_started":1}
W20260619 18:45:39.509124 12441 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.527404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35636)
0619 18:45:39.481878 (+5954474us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.482197 (+ 319us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":5925604,"thread_start_us":2297528,"threads_started":1}
W20260619 18:45:39.472131 12241 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 49592.1us
W20260619 18:45:39.509807 12406 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:32.936589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35544)
0619 18:45:35.695325 (+2758736us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:35.695423 (+ 98us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:35.695860 (+ 437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:35.741401 (+ 45541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:35.741444 (+ 43us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:35.741641 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:35.757577 (+ 15936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:35.757807 (+ 230us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:35.816551 (+ 58744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:35.846259 (+ 29708us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:36.711066 (+864807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:36.711161 (+ 95us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:36.717635 (+ 6474us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":2732871,"thread_start_us":2082700,"threads_started":1}
W20260619 18:45:39.531778 12492 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.438047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35770)
0619 18:45:37.857344 (+1419297us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:37.857409 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:37.857769 (+ 360us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.270902 (+1413133us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1394725,"thread_start_us":2445540,"threads_started":1}
W20260619 18:45:39.512003 12081 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.386264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35662 (local address 127.6.120.254:36501)
0619 18:45:39.329820 (+943556us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.339166 (+ 9346us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.388967 (+ 49801us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35662: BlockingRecv error: recv got EOF from 127.0.0.1:35662 (error 108)
Metrics: {"server-negotiator.queue_time_us":758817,"thread_start_us":651831,"threads_started":1}
W20260619 18:45:39.516942 12450 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.543717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35702)
0619 18:45:36.935758 (+3392041us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:36.936235 (+ 477us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":3230064,"thread_start_us":3071708,"threads_started":1}
W20260619 18:45:39.479961 12200 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 46077.3us
W20260619 18:45:39.497325 12220 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 44144.6us
W20260619 18:45:39.509493 12235 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 47978us
W20260619 18:45:39.573907 12410 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.097213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35586)
0619 18:45:35.961138 (+2863925us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:35.961219 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:35.986108 (+ 24889us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:36.026738 (+ 40630us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:36.026786 (+ 48us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:36.026991 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:36.040608 (+ 13617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:36.040702 (+ 94us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:36.043858 (+ 3156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:36.043905 (+ 47us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:36.046899 (+ 2994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:36.046977 (+ 78us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:36.101034 (+ 54057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:36.161112 (+ 60078us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:36.528646 (+367534us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:36.678454 (+149808us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:36.681083 (+ 2629us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:36.685253 (+ 4170us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:36.778947 (+ 93694us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:37.765651 (+986704us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":2748713,"mutex_wait_us":7003,"thread_start_us":2022206,"threads_started":1}
W20260619 18:45:39.591481 12468 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.642938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33740 (local address 127.6.120.193:37901)
0619 18:45:39.437672 (+794734us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.451490 (+ 13818us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.481095 (+ 29605us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33740: BlockingRecv error: recv got EOF from 127.0.0.1:33740 (error 108)
Metrics: {"mutex_wait_us":18233,"server-negotiator.queue_time_us":674122}
W20260619 18:45:39.542094 12193 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 50766.4us
W20260619 18:45:39.610466 12444 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:33.532437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35648)
0619 18:45:39.501662 (+5969225us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.501900 (+ 238us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":5968654,"thread_start_us":3024236,"threads_started":1}
W20260619 18:45:39.613075 12500 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.872s user 0.005s sys 0.009s
W20260619 18:45:39.612466 12091 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.364153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35726 (local address 127.6.120.254:36501)
0619 18:45:39.468886 (+104733us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.472833 (+ 3947us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.507525 (+ 34692us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35726: BlockingRecv error: recv got EOF from 127.0.0.1:35726 (error 108)
Metrics: {"server-negotiator.queue_time_us":4075}
W20260619 18:45:39.621295 12087 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.326053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35648 (local address 127.6.120.254:36501)
0619 18:45:39.318205 (+992152us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.320125 (+ 1920us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.521177 (+201052us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35648: BlockingRecv error: recv got EOF from 127.0.0.1:35648 (error 108)
Metrics: {"server-negotiator.queue_time_us":780180}
W20260619 18:45:39.622009 12500 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.984s user 0.006s sys 0.009s
W20260619 18:45:39.631399 12486 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:35.833150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:33740)
0619 18:45:39.450517 (+3617367us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.454296 (+ 3779us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":3528224,"thread_start_us":2973905,"threads_started":1}
W20260619 18:45:39.642561 12484 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:35.961537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:33750)
0619 18:45:39.516166 (+3554629us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.516468 (+ 302us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":3396176,"thread_start_us":2590336,"threads_started":1}
W20260619 18:45:39.635221 12216 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.557s user 0.001s sys 0.014s
W20260619 18:45:39.669255 12493 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.519078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:33764)
0619 18:45:39.453717 (+2934639us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.472216 (+ 18499us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":2722658,"thread_start_us":2397781,"threads_started":1}
W20260619 18:45:39.665231 12216 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.673s user 0.001s sys 0.016s
I20260619 18:45:39.650955 12088 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
I20260619 18:45:39.665343 12033 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:39.688051 12088 scanner-internal.cc:458] Time spent opening tablet: real 6.792s user 0.013s sys 0.016s
I20260619 18:45:39.673534 12028 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:39.695266 12413 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.550680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35786 (local address 127.6.120.254:36501)
0619 18:45:36.974390 (+423710us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:36.974428 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.620361 (+2645933us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35786: BlockingRecv error: recv got EOF from 127.0.0.1:35786 (error 108)
Metrics: {"server-negotiator.queue_time_us":335587,"thread_start_us":1886343,"threads_started":1}
W20260619 18:45:39.705519 12028 scanner-internal.cc:458] Time spent opening tablet: real 6.807s user 0.026s sys 0.035s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: Timeout exceeded waiting to connect
W20260619 18:45:39.699154 12033 scanner-internal.cc:458] Time spent opening tablet: real 6.860s user 0.027s sys 0.067s
W20260619 18:45:39.713254 12506 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.550148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33768 (local address 127.6.120.193:37901)
0619 18:45:37.863726 (+1313578us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:37.863766 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:37.866554 (+ 2788us) server_negotiation.cc:407] Connection header received
0619 18:45:37.964008 (+ 97454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:37.970734 (+ 6726us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:38.098416 (+127682us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:38.142685 (+ 44269us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:38.993281 (+850596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:39.204260 (+210979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:39.604271 (+400011us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:33768: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":149,"server-negotiator.queue_time_us":1312996,"thread_start_us":2000063,"threads_started":1}
W20260619 18:45:39.708407 12081 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.572362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35702 (local address 127.6.120.254:36501)
0619 18:45:39.631619 (+ 59257us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.633915 (+ 2296us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.649835 (+ 15920us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35702: BlockingRecv error: recv got EOF from 127.0.0.1:35702 (error 108)
Metrics: {"server-negotiator.queue_time_us":479}
W20260619 18:45:39.714691 12485 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.530761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35786)
0619 18:45:39.594432 (+3063671us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.620424 (+ 25992us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: Timeout exceeded waiting to connect
Metrics: {"client-negotiator.queue_time_us":2892921,"thread_start_us":2484311,"threads_started":1}
W20260619 18:45:39.735399 12516 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.580614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35762 (local address 127.6.120.254:36501)
0619 18:45:39.660191 (+ 79577us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.663281 (+ 3090us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.684181 (+ 20900us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35762: BlockingRecv error: recv got EOF from 127.0.0.1:35762 (error 108)
Metrics: {"mutex_wait_us":4477,"server-negotiator.queue_time_us":8570}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: Timeout exceeded waiting to connect
W20260619 18:45:39.744802 12491 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.529393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35670 (local address 127.6.120.254:36501)
0619 18:45:39.631328 (+101935us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.633812 (+ 2484us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.667920 (+ 34108us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35670: BlockingRecv error: recv got EOF from 127.0.0.1:35670 (error 108)
Metrics: {"server-negotiator.queue_time_us":3568}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: Timeout exceeded waiting to connect
W20260619 18:45:39.746776 12501 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.787927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35800)
0619 18:45:39.693855 (+2905928us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.696579 (+ 2724us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.716605 (+ 20026us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.745421 (+ 28816us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":2830943,"thread_start_us":2244176,"threads_started":1}
W20260619 18:45:39.751505 12182 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.586815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35710 (local address 127.6.120.254:36501)
0619 18:45:39.665720 (+ 78905us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.668260 (+ 2540us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.685807 (+ 17547us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35710: BlockingRecv error: recv got EOF from 127.0.0.1:35710 (error 108)
Metrics: {"mutex_wait_us":11461,"server-negotiator.queue_time_us":26736}
W20260619 18:45:39.796761 12503 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.652118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:33768)
0619 18:45:37.857625 (+1205507us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:37.857679 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:37.865288 (+ 7609us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:38.157787 (+292499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:38.233320 (+ 75533us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:38.233408 (+ 88us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:38.971853 (+738445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:38.986758 (+ 14905us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:39.247365 (+260607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:39.255057 (+ 7692us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:39.710612 (+455555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:39.716940 (+ 6328us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:39.789387 (+ 72447us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1196373,"mutex_wait_us":69001,"thread_start_us":1855335,"threads_started":1}
W20260619 18:45:39.798700 12087 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.629581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35766 (local address 127.6.120.254:36501)
0619 18:45:39.695733 (+ 66152us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.697908 (+ 2175us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.698335 (+ 427us) server_negotiation.cc:407] Connection header received
0619 18:45:39.705213 (+ 6878us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.709533 (+ 4320us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.736981 (+ 27448us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.756422 (+ 19441us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35766: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":365,"server-negotiator.queue_time_us":7818}
W20260619 18:45:39.808470 12535 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.635451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35770 (local address 127.6.120.254:36501)
0619 18:45:39.713265 (+ 77814us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.713311 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.713360 (+ 49us) server_negotiation.cc:407] Connection header received
0619 18:45:39.713917 (+ 557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.716027 (+ 2110us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.739637 (+ 23610us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.789836 (+ 50199us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35770: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":5070,"server-negotiator.queue_time_us":65134}
I20260619 18:45:39.810118 12104 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:39.828605 12104 scanner-internal.cc:458] Time spent opening tablet: real 6.863s user 0.019s sys 0.050s
W20260619 18:45:39.829490 12187 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.614522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35756 (local address 127.6.120.254:36501)
0619 18:45:39.675560 (+ 61038us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.679431 (+ 3871us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.684699 (+ 5268us) server_negotiation.cc:407] Connection header received
0619 18:45:39.692439 (+ 7740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.695177 (+ 2738us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.714203 (+ 19026us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.740719 (+ 26516us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35756: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":7351,"server-negotiator.queue_time_us":9514}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:39.833868 12535 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.819843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35804 (local address 127.6.120.254:36501)
0619 18:45:39.829970 (+ 10127us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.830001 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.830080 (+ 79us) server_negotiation.cc:407] Connection header received
0619 18:45:39.830244 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.830281 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.830568 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.831038 (+ 470us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35804: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"server-negotiator.queue_time_us":75}
W20260619 18:45:39.834435 12182 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.746474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35800 (local address 127.6.120.254:36501)
0619 18:45:39.831011 (+ 84537us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.831047 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.831097 (+ 50us) server_negotiation.cc:407] Connection header received
0619 18:45:39.831447 (+ 350us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35800: BlockingRecv error: recv got EOF from 127.0.0.1:35800 (error 108)
Metrics: {"mutex_wait_us":37003,"server-negotiator.queue_time_us":47923}
W20260619 18:45:39.835176 12495 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.690819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35804)
0619 18:45:39.145167 (+2454348us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.162064 (+ 16897us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.207258 (+ 45194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.748843 (+541585us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":2296220,"thread_start_us":2334060,"threads_started":1}
W20260619 18:45:39.835853 12363 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.777107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33786 (local address 127.6.120.193:37901)
0619 18:45:38.990363 (+2213256us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:38.990981 (+ 618us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.598973 (+607992us) server_negotiation.cc:407] Connection header received
0619 18:45:39.638461 (+ 39488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.644063 (+ 5602us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.674117 (+ 30054us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.685688 (+ 11571us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:39.743670 (+ 57982us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:33786: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":32078,"server-negotiator.queue_time_us":1906901}
W20260619 18:45:39.890991 12070 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.496s user 0.009s sys 0.022s
W20260619 18:45:39.905033 12070 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.527s user 0.009s sys 0.022s
W20260619 18:45:40.109390 12091 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.621986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35772 (local address 127.6.120.254:36501)
0619 18:45:39.878639 (+256653us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b1800194680. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f138cce98b1 00007f138ccf6661 00007f1383e56638 00007f1383e59b11 00007f1383e59ac9 00007f1383e59a59 00007f1383e59a21 00007f1383e58d1d 00007f138d0ae204 00007f138d0ae039 00007f1383e38dc6
0619 18:45:39.883422 (+ 4783us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.884969 (+ 1547us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.886326 (+ 1357us) server_negotiation.cc:407] Connection header received
0619 18:45:39.892050 (+ 5724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.893543 (+ 1493us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.923961 (+ 30418us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.023830 (+ 99869us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35772: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":152,"server-negotiator.queue_time_us":5973,"spinlock_wait_cycles":5479296,"thread_start_us":59028,"threads_started":1}
W20260619 18:45:40.132328 12488 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.443224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33772 (local address 127.6.120.193:37901)
0619 18:45:39.131389 (+688165us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.131433 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.131535 (+ 102us) server_negotiation.cc:407] Connection header received
0619 18:45:39.131761 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.131814 (+ 53us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.135396 (+ 3582us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.141791 (+ 6395us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:39.142539 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:39.483122 (+340583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:39.919947 (+436825us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33772: BlockingRecv error: recv got EOF from 127.0.0.1:33772 (error 108)
Metrics: {"mutex_wait_us":10867,"server-negotiator.queue_time_us":687588,"thread_start_us":656314,"threads_started":1}
W20260619 18:45:40.214905 12498 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.772264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:33772)
0619 18:45:38.359751 (+1587487us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:38.359821 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:38.360288 (+ 467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.136297 (+776009us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:39.136346 (+ 49us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:39.136420 (+ 74us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:39.137634 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:39.137700 (+ 66us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:39.511667 (+373967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:39.517528 (+ 5861us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:39.877440 (+359912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:39.877496 (+ 56us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:39.887326 (+ 9830us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1092545,"mutex_wait_us":127805,"thread_start_us":2229538,"threads_started":1}
I20260619 18:45:40.220055 12025 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:40.238343 12025 scanner-internal.cc:458] Time spent opening tablet: real 6.796s user 0.011s sys 0.027s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:40.466950 12465 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.574s user 0.002s sys 0.003s
W20260619 18:45:40.476364 12465 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.588s user 0.002s sys 0.003s
W20260619 18:45:40.488689 12191 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.690s user 0.000s sys 0.023s
W20260619 18:45:40.489111 12191 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.691s user 0.000s sys 0.024s
W20260619 18:45:40.497902 12369 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.882s user 0.005s sys 0.016s
W20260619 18:45:40.506929 12369 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.902s user 0.006s sys 0.016s
W20260619 18:45:40.526320 12505 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:36.779117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:33786)
0619 18:45:39.592188 (+2813071us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.594396 (+ 2208us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.628062 (+ 33666us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.687128 (+ 59066us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:39.689792 (+ 2664us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:39.694514 (+ 4722us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:40.218891 (+524377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.218966 (+ 75us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.519458 (+300492us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":2590028,"mutex_wait_us":704583,"thread_start_us":2075410,"threads_started":1}
I20260619 18:45:40.527040 12042 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:40.527542 12042 scanner-internal.cc:458] Time spent opening tablet: real 7.574s user 0.008s sys 0.030s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:40.538990 12507 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:37.596121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49746)
0619 18:45:38.990174 (+1394053us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:38.990828 (+ 654us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:38.998771 (+ 7943us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.453093 (+454322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:39.454805 (+ 1712us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:39.482545 (+ 27740us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:39.721384 (+238839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:39.721439 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:39.861351 (+139912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:39.862241 (+ 890us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:40.067130 (+204889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.067230 (+ 100us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.535764 (+468534us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":955316,"mutex_wait_us":117022,"thread_start_us":183115,"threads_started":1}
W20260619 18:45:40.648671 12411 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.699661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49746 (local address 127.6.120.254:36501)
0619 18:45:39.360098 (+660437us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.363553 (+ 3455us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.375595 (+ 12042us) server_negotiation.cc:407] Connection header received
0619 18:45:39.396457 (+ 20862us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.399081 (+ 2624us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.420396 (+ 21315us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.451664 (+ 31268us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:39.721733 (+270069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:39.847714 (+125981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:40.067957 (+220243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.530865 (+462908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:40.644697 (+113832us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:40.645777 (+ 1080us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49746: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"mutex_wait_us":611859,"server-negotiator.queue_time_us":447022,"thread_start_us":579375,"threads_started":1}
W20260619 18:45:40.683095 12243 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.872s user 0.028s sys 0.030s
W20260619 18:45:40.683600 12243 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.881s user 0.028s sys 0.031s
W20260619 18:45:40.838356 12513 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:37.958707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49748)
0619 18:45:39.482222 (+1523515us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.482277 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.521228 (+ 38951us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.666419 (+145191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:39.670235 (+ 3816us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:39.683876 (+ 13641us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.191790 (+507914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.191861 (+ 71us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.836676 (+644815us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 1179 requested bytes
Metrics: {"client-negotiator.queue_time_us":1390909,"mutex_wait_us":306781,"thread_start_us":952027,"threads_started":1}
W20260619 18:45:40.841147 12502 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.509948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49748 (local address 127.6.120.254:36501)
0619 18:45:39.615918 (+105970us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.617931 (+ 2013us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.619878 (+ 1947us) server_negotiation.cc:407] Connection header received
0619 18:45:39.624717 (+ 4839us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.627665 (+ 2948us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.647750 (+ 20085us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.663556 (+ 15806us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.192189 (+528633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.790916 (+598727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:40.839628 (+ 48712us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49748: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"mutex_wait_us":261572,"server-negotiator.queue_time_us":197}
W20260619 18:45:40.939337 12544 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.845268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49778 (local address 127.6.120.254:36501)
0619 18:45:39.862247 (+ 16979us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.862278 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.862338 (+ 60us) server_negotiation.cc:407] Connection header received
0619 18:45:39.862499 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.862528 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.862838 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.865127 (+ 2289us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.527294 (+662167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.917395 (+390101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:40.936803 (+ 19408us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49778: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":739723,"server-negotiator.queue_time_us":680}
W20260619 18:45:40.942979 12512 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:37.962981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49762)
0619 18:45:39.495952 (+1532971us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.499652 (+ 3700us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.549062 (+ 49410us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.631932 (+ 82870us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:39.634281 (+ 2349us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:39.650008 (+ 15727us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:39.834140 (+184132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:39.834200 (+ 60us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.854710 (+1020510us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1368122,"mutex_wait_us":113466,"thread_start_us":1201927,"threads_started":1}
W20260619 18:45:40.954587 12511 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:37.874284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38296 (local address 127.6.120.193:37901)
0619 18:45:39.297269 (+1422985us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.318096 (+ 20827us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.423126 (+105030us) server_negotiation.cc:407] Connection header received
0619 18:45:39.501174 (+ 78048us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.501213 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.501576 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.501805 (+ 229us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:39.872988 (+371183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.778160 (+905172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:40.906246 (+128086us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:38296: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":859650,"server-negotiator.queue_time_us":1140612,"thread_start_us":60554,"threads_started":1}
W20260619 18:45:40.953424 12497 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:37.799563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49762 (local address 127.6.120.254:36501)
0619 18:45:37.857519 (+ 57956us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:37.857556 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.503608 (+1646052us) server_negotiation.cc:407] Connection header received
0619 18:45:39.594506 (+ 90898us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.597188 (+ 2682us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.622148 (+ 24960us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.630304 (+ 8156us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.159772 (+529468us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.335944 (+176172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.789414 (+453470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:40.825748 (+ 36334us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:49762: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":535701,"server-negotiator.queue_time_us":57424,"spinlock_wait_cycles":9446656}
W20260619 18:45:40.962359 12509 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:37.843046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49786)
0619 18:45:38.442243 (+599197us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:38.442323 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:38.556081 (+113758us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.119972 (+1563891us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.131427 (+ 11455us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.158271 (+ 26844us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.688180 (+529909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.688277 (+ 97us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.917421 (+229144us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":589262,"mutex_wait_us":541636,"thread_start_us":136379,"threads_started":1}
W20260619 18:45:40.998942 12523 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.613278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49800 (local address 127.6.120.254:36501)
0619 18:45:39.697829 (+ 84551us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.698262 (+ 433us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.700733 (+ 2471us) server_negotiation.cc:407] Connection header received
0619 18:45:39.716376 (+ 15643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.717651 (+ 1275us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.748508 (+ 30857us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.750992 (+ 2484us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.275794 (+524802us) spinlock_profiling.cc:243] Waited 5.34 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.531422 (+255628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.819124 (+287702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:40.975375 (+156251us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49800: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"mutex_wait_us":375843,"server-negotiator.queue_time_us":10685,"spinlock_wait_cycles":12281728}
W20260619 18:45:41.016986 12517 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.042911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49810)
0619 18:45:39.456403 (+1413492us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.458487 (+ 2084us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.502807 (+ 44320us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.784452 (+281645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:39.786617 (+ 2165us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:39.809084 (+ 22467us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.544675 (+735591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.544737 (+ 62us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.916631 (+371894us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1224494,"mutex_wait_us":209465,"thread_start_us":806111,"threads_started":1}
W20260619 18:45:41.078693 12508 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:37.805590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49778)
0619 18:45:39.345803 (+1540213us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.353807 (+ 8004us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.397915 (+ 44108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.864303 (+466388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:39.868283 (+ 3980us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:39.868434 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.520628 (+652194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.521847 (+ 1219us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.888981 (+367134us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1290883,"mutex_wait_us":526016,"thread_start_us":200813,"threads_started":1}
W20260619 18:45:41.088033 12553 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.135090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:38304)
0619 18:45:39.873674 (+1738584us) spinlock_profiling.cc:243] Waited 8.08 ms on lock 0x7b4400023f4c. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383d68a95 00007f1383d694b2 00007f138a346511 00007f138a341e1a 00007f1383e385fe 00007f138cc63a39 00007f1383e558bb 00007f1383e53cbf 00007f1383e55e22 00007f138892cc48
0619 18:45:40.093615 (+219941us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:40.095150 (+ 1535us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:40.140762 (+ 45612us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.238643 (+ 97881us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.238674 (+ 31us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.238740 (+ 66us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:40.658172 (+419432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.658238 (+ 66us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.018612 (+360374us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1763971,"mutex_wait_us":387791,"spinlock_wait_cycles":18589568,"thread_start_us":1545529,"threads_started":1}
I20260619 18:45:41.095160 12047 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:41.097188 12047 scanner-internal.cc:458] Time spent opening tablet: real 8.176s user 0.030s sys 0.032s
W20260619 18:45:41.090297 12515 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:37.865314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49800)
0619 18:45:39.653457 (+1788143us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.661002 (+ 7545us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.684454 (+ 23452us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.754582 (+ 70128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:39.757547 (+ 2965us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:39.790368 (+ 32821us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.528989 (+738621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.529077 (+ 88us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.974842 (+445765us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 1179 requested bytes
Metrics: {"client-negotiator.queue_time_us":1647342,"mutex_wait_us":729716,"thread_start_us":1216075,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:45:41.312937 12516 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.733238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49810 (local address 127.6.120.254:36501)
0619 18:45:39.764557 (+ 31319us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.764587 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.764638 (+ 51us) server_negotiation.cc:407] Connection header received
0619 18:45:39.764770 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.764799 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.765095 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.773223 (+ 8128us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.567872 (+794649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.013957 (+446085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.131058 (+117101us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49810: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":544452,"server-negotiator.queue_time_us":17195}
W20260619 18:45:41.316846 12014 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.580998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49786 (local address 127.6.120.254:36501)
0619 18:45:39.611330 (+ 30332us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.611370 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.611417 (+ 47us) server_negotiation.cc:407] Connection header received
0619 18:45:39.611546 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.611582 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.111091 (+499509us) spinlock_profiling.cc:243] Waited 2.72 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:40.111419 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.119556 (+ 8137us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.688685 (+569129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.089897 (+401212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.137059 (+ 47162us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49786: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":609128,"server-negotiator.queue_time_us":7814,"spinlock_wait_cycles":6247168}
W20260619 18:45:41.317533 12480 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.145773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38304 (local address 127.6.120.193:37901)
0619 18:45:39.505912 (+360139us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.505943 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.097325 (+591382us) server_negotiation.cc:407] Connection header received
0619 18:45:40.163895 (+ 66570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.168799 (+ 4904us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.212878 (+ 44079us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.220853 (+ 7975us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:40.679791 (+458938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.029938 (+350147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.141472 (+111534us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38304: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":684205,"server-negotiator.queue_time_us":359685}
W20260619 18:45:41.431453 12205 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 413701us
W20260619 18:45:41.449051 12519 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.589681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:38316)
0619 18:45:39.751656 (+1161975us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.754531 (+ 2875us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.795272 (+ 40741us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.835009 (+ 39737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:39.835057 (+ 48us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:39.835113 (+ 56us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:39.920759 (+ 85646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:39.924287 (+ 3528us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.810755 (+886468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:40.812048 (+ 1293us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:41.359900 (+547852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.360012 (+ 112us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.404127 (+ 44115us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1068824,"mutex_wait_us":466693,"thread_start_us":369033,"threads_started":1}
I20260619 18:45:41.454789 12061 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:41.458964 12061 scanner-internal.cc:458] Time spent opening tablet: real 7.164s user 0.027s sys 0.056s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:45:41.521246 12510 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:37.863308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:38296)
0619 18:45:39.417579 (+1554271us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.419780 (+ 2201us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.479096 (+ 59316us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.506525 (+ 27429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:39.509942 (+ 3417us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:39.516908 (+ 6966us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:39.870121 (+353213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:39.870173 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.787421 (+917248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:40.789356 (+ 1935us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:41.395281 (+605925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.395340 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.426439 (+ 31099us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1312098,"mutex_wait_us":611735,"thread_start_us":185475,"threads_started":1}
I20260619 18:45:41.527288 12080 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:41.531425 12080 scanner-internal.cc:458] Time spent opening tablet: real 8.582s user 0.020s sys 0.025s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:41.689532 12466 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.698472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49818 (local address 127.6.120.254:36501)
0619 18:45:39.353728 (+655256us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.353774 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.704691 (+350917us) server_negotiation.cc:407] Connection header received
0619 18:45:39.738778 (+ 34087us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.741137 (+ 2359us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.765814 (+ 24677us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.786712 (+ 20898us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.519712 (+733000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.904078 (+384366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.395070 (+490992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.619055 (+223985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.656386 (+ 37331us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:41.688042 (+ 31656us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:49818: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":684741,"server-negotiator.queue_time_us":475271}
W20260619 18:45:41.853571 12478 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.510293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38316 (local address 127.6.120.193:37901)
0619 18:45:39.604501 (+ 94208us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.606091 (+ 1590us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.760355 (+154264us) server_negotiation.cc:407] Connection header received
0619 18:45:39.818755 (+ 58400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.820397 (+ 1642us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.834340 (+ 13943us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.834528 (+ 188us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:39.959992 (+125464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.796853 (+836861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.360344 (+563491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.709890 (+349546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.802801 (+ 92911us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38316: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":975947,"server-negotiator.queue_time_us":16588}
W20260619 18:45:41.914573 12524 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.970900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49818)
0619 18:45:39.698044 (+727144us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.701151 (+ 3107us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.728873 (+ 27722us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.791323 (+ 62450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:39.791433 (+ 110us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:39.791652 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.518755 (+727103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.518823 (+ 68us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.909809 (+390986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:40.910804 (+ 995us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:41.393977 (+483173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.394051 (+ 74us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.647086 (+253035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.648210 (+ 1124us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:41.722472 (+ 74262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:41.807297 (+ 84825us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:41.807335 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:41.807403 (+ 68us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:41.807552 (+ 149us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:41.851149 (+ 43597us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":679351,"mutex_wait_us":978968,"thread_start_us":227620,"threads_started":1}
W20260619 18:45:42.006526 12521 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.943375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49824)
0619 18:45:39.706866 (+763491us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.706920 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.707226 (+ 306us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.259993 (+552767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.264427 (+ 4434us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.294324 (+ 29897us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.655009 (+360685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.655088 (+ 79us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.808611 (+153523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:40.810860 (+ 2249us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:41.401002 (+590142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.404176 (+ 3174us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.004625 (+600449us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":686599,"mutex_wait_us":670718,"thread_start_us":179612,"threads_started":1}
W20260619 18:45:42.052311 12533 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.991523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49852)
0619 18:45:39.675241 (+683718us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.675298 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.704177 (+ 28879us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.885099 (+180922us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:39.886431 (+ 1332us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:39.900415 (+ 13984us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.586097 (+685682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.586181 (+ 84us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.286217 (+700036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.291216 (+ 4999us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:41.713209 (+421993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.713274 (+ 65us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.029381 (+316107us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":677581,"mutex_wait_us":963950,"thread_start_us":684214,"threads_started":1}
W20260619 18:45:42.111866 12525 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.999200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49864)
0619 18:45:39.721507 (+722307us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.721556 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.721823 (+ 267us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.505872 (+784049us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.509384 (+ 3512us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.511002 (+ 1618us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.817528 (+306526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.817597 (+ 69us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.136885 (+319288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.136922 (+ 37us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:41.581300 (+444378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.581361 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.018365 (+437004us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":657920,"mutex_wait_us":561208,"thread_start_us":337147,"threads_started":1}
W20260619 18:45:42.146443 12536 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.720647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49846 (local address 127.6.120.254:36501)
0619 18:45:39.822073 (+101426us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.824536 (+ 2463us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.828513 (+ 3977us) server_negotiation.cc:407] Connection header received
0619 18:45:39.830329 (+ 1816us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.830362 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.830611 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.830805 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.259752 (+428947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.948930 (+689178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.469460 (+520530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.059906 (+590446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.130000 (+ 70094us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49846: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1199513,"server-negotiator.queue_time_us":28590}
W20260619 18:45:42.203917 12003 scanner-internal.cc:458] Time spent opening tablet: real 9.246s user 0.012s sys 0.027s
W20260619 18:45:42.213537 12530 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.985488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49846)
0619 18:45:39.716474 (+730986us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.717807 (+ 1333us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.743627 (+ 25820us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:39.833447 (+ 89820us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:39.834595 (+ 1148us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:39.834724 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.257627 (+422903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.259377 (+ 1750us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.950553 (+691176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:40.950588 (+ 35us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:41.468926 (+518338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.469005 (+ 79us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.068332 (+599327us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":644074,"mutex_wait_us":608290,"thread_start_us":469557,"threads_started":1}
W20260619 18:45:42.224867 12535 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.849346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49852 (local address 127.6.120.254:36501)
0619 18:45:39.873473 (+ 24127us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.873506 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.873558 (+ 52us) server_negotiation.cc:407] Connection header received
0619 18:45:39.873698 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.873721 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:39.877436 (+ 3715us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:39.877649 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.587970 (+710321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.211706 (+623736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.714828 (+503122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.095393 (+380565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.179700 (+ 84307us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49852: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":925646,"server-negotiator.queue_time_us":10410}
W20260619 18:45:42.225445 12563 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.897325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49864 (local address 127.6.120.254:36501)
0619 18:45:40.385840 (+488515us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.386839 (+ 999us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.387341 (+ 502us) server_negotiation.cc:407] Connection header received
0619 18:45:40.410399 (+ 23058us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.414264 (+ 3865us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.489844 (+ 75580us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.504541 (+ 14697us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.577541 (+ 73000us) spinlock_profiling.cc:243] Waited 6.35 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.693895 (+116354us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.740160 (+ 46265us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.820800 (+ 80640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.130587 (+309787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.586898 (+456311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.042117 (+455219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.065555 (+ 23438us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49864: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":744854,"server-negotiator.queue_time_us":311501,"spinlock_wait_cycles":58197632,"thread_start_us":83081,"threads_started":1}
W20260619 18:45:42.417366 12551 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.855168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49824 (local address 127.6.120.254:36501)
0619 18:45:40.090244 (+235076us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.137801 (+ 47557us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.157188 (+ 19387us) server_negotiation.cc:407] Connection header received
0619 18:45:40.176377 (+ 19189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.180010 (+ 3633us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.214041 (+ 34031us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.257543 (+ 43502us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.655803 (+398260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:40.797231 (+141428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.409061 (+611830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.979566 (+570505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.050499 (+ 70933us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:42.249700 (+199201us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49824: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"mutex_wait_us":1064111,"server-negotiator.queue_time_us":61478,"thread_start_us":27258,"threads_started":1}
W20260619 18:45:42.447759 12463 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.138810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49886)
0619 18:45:39.139839 (+ 1029us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.139898 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.140208 (+ 310us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.511752 (+1371544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.512494 (+ 742us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.519778 (+ 7284us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.665962 (+146184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.667057 (+ 1095us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.392741 (+725684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.392789 (+ 48us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.104291 (+711502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.107615 (+ 3324us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.327648 (+220033us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":448,"mutex_wait_us":763447}
W20260619 18:45:42.455286 12239 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 304775us
W20260619 18:45:42.480655 12477 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.137503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49882)
0619 18:45:39.142183 (+ 4680us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.142241 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.142493 (+ 252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.220288 (+1077795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.220325 (+ 37us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.220457 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.802421 (+581964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.804867 (+ 2446us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.169462 (+364595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.171201 (+ 1739us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.029535 (+858334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.029605 (+ 70us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.444304 (+414699us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":4092,"mutex_wait_us":1565326}
W20260619 18:45:42.552284 12471 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.498340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49960)
0619 18:45:39.608154 (+109814us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.612183 (+ 4029us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.631762 (+ 19579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.853361 (+1221599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.854316 (+ 955us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.892666 (+ 38350us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.297847 (+405181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.300676 (+ 2829us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.683355 (+382679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.683433 (+ 78us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.165153 (+481720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.168026 (+ 2873us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.519423 (+351397us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":463,"mutex_wait_us":667018}
W20260619 18:45:42.559909 12448 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.139569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49902)
0619 18:45:39.140973 (+ 1404us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.141035 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.141414 (+ 379us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.526966 (+1385552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.526996 (+ 30us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.527115 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.791693 (+264578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.794152 (+ 2459us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.424693 (+630541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.426828 (+ 2135us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.219341 (+792513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.219401 (+ 60us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.557271 (+337870us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":817,"mutex_wait_us":1028748}
W20260619 18:45:42.593092 12209 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 105379us
W20260619 18:45:42.620886 12446 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.283418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49918)
0619 18:45:39.285400 (+ 1982us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.285454 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.285759 (+ 305us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.604949 (+1319190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.605671 (+ 722us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.636496 (+ 30825us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.813078 (+176582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.815653 (+ 2575us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.364802 (+549149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.364840 (+ 38us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.108596 (+743756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.110930 (+ 2334us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.567538 (+456608us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1538,"mutex_wait_us":992813}
W20260619 18:45:42.623445 12572 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.467929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49946)
0619 18:45:40.112099 (+644170us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b4400023f4c. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383d68a95 00007f1383d694b2 00007f138a346511 00007f138a341e1a 00007f1383e385fe 00007f138cc63a39 00007f1383e558bb 00007f1383e53cbf 00007f1383e55e22 00007f138892cc48
0619 18:45:40.494337 (+382238us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:40.495399 (+ 1062us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:40.495897 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.497151 (+ 1254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.497183 (+ 32us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.497320 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.532674 (+ 35354us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b180028bb80. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f138cce98b1 00007f138ccf6661 00007f138a34282c 00007f1383e389dc 00007f138cc63a39 00007f1383e558bb 00007f1383e53cbf 00007f1383e55e22 00007f138892cc48 00007f138892d6a1 00007f138892d266
0619 18:45:40.803534 (+270860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.805540 (+ 2006us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.392958 (+587418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.393002 (+ 44us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.186920 (+793918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.190025 (+ 3105us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.545437 (+355412us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1011372,"mutex_wait_us":975647,"spinlock_wait_cycles":14292096,"thread_start_us":908419,"threads_started":1}
W20260619 18:45:42.642536 12518 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:38.723741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49814)
0619 18:45:39.722452 (+998711us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.722504 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.722756 (+ 252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.364889 (+642133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.364929 (+ 40us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.365076 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.806378 (+441302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.806445 (+ 67us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.352077 (+545632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.353550 (+ 1473us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.216602 (+863052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.216663 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.636544 (+419881us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":921454,"mutex_wait_us":1415177,"thread_start_us":328704,"threads_started":1}
W20260619 18:45:42.678371 12460 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.518842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49968)
0619 18:45:39.532633 (+ 13791us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.532695 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.533422 (+ 727us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.035460 (+1502038us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.035506 (+ 46us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.035682 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.525913 (+490231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.526618 (+ 705us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.029196 (+502578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.029259 (+ 63us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.515304 (+486045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.515373 (+ 69us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.599244 (+ 83871us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":10147,"mutex_wait_us":808908}
W20260619 18:45:42.689268 12532 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.403135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49944)
0619 18:45:39.611177 (+208042us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.611225 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.611467 (+ 242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.833632 (+1222165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.833673 (+ 41us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.833868 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.302500 (+468632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.304931 (+ 2431us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.822722 (+517791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.823779 (+ 1057us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.440470 (+616691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.441718 (+ 1248us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.558761 (+117043us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":204951,"mutex_wait_us":853293,"thread_start_us":99871,"threads_started":1}
W20260619 18:45:42.822353 12584 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.802735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50196)
0619 18:45:40.218904 (+416169us) spinlock_profiling.cc:243] Waited 3.4 ms on lock 0x7b4400023f4c. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383d68a95 00007f1383d694b2 00007f138a346511 00007f138a341e1a 00007f1383e385fe 00007f138cc63a39 00007f1383e558bb 00007f1383e53cbf 00007f1383e55e22 00007f138892cc48
0619 18:45:40.830457 (+611553us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:40.830543 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:40.830872 (+ 329us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:42.820715 (+1989843us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1010531,"spinlock_wait_cycles":7811328,"thread_start_us":880911,"threads_started":1}
W20260619 18:45:42.853554 12678 net_util.cc:251] Time spent resolve address for 127.6.120.193: real 0.261s user 0.000s sys 0.000s
W20260619 18:45:42.866902 12118 meta_cache.cc:1097] Time spent processing table locations response: real 0.186s user 0.001s sys 0.007s
W20260619 18:45:42.870760 12171 meta_cache.cc:1261] Time spent looking up entry by key: real 0.233s user 0.001s sys 0.009s
W20260619 18:45:42.873749 12243 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 50471.3us
W20260619 18:45:42.875584 12369 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 245133us
W20260619 18:45:42.926757 12459 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.645320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50056)
0619 18:45:39.652406 (+ 7086us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.652454 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.652765 (+ 311us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.037662 (+1384897us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.037701 (+ 39us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.037828 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.514971 (+477143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.515040 (+ 69us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.856487 (+341447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.857356 (+ 869us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.216755 (+359399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.216839 (+ 84us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.924830 (+707991us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":3009,"mutex_wait_us":842153}
W20260619 18:45:42.925865 12091 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.875025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49882 (local address 127.6.120.254:36501)
0619 18:45:40.163739 (+288714us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.168350 (+ 4611us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.173324 (+ 4974us) server_negotiation.cc:407] Connection header received
0619 18:45:40.186953 (+ 13629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.188720 (+ 1767us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.219341 (+ 30621us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:40.219563 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.219791 (+ 228us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.539020 (+319229us) spinlock_profiling.cc:243] Waited 973 us on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.642472 (+103452us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1ec6c 00007f1383e1ebd6 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.811972 (+169500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.156263 (+344291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.031394 (+875131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.489255 (+457861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.921180 (+431925us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49882: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1386738,"server-negotiator.queue_time_us":287665,"spinlock_wait_cycles":11358720,"thread_start_us":135905,"threads_started":1}
W20260619 18:45:42.944356 12197 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 66284.7us
W20260619 18:45:42.986987 12566 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.923227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50264)
0619 18:45:40.304097 (+380870us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:40.323813 (+ 19716us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:40.364760 (+ 40947us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:42.968389 (+2603629us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 34 requested bytes
Metrics: {"client-negotiator.queue_time_us":249152,"thread_start_us":118223,"threads_started":1}
W20260619 18:45:42.979532 12219 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 754675us
W20260619 18:45:43.001271 12490 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.041376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49902 (local address 127.6.120.254:36501)
0619 18:45:40.525880 (+484504us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.525924 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.525985 (+ 61us) server_negotiation.cc:407] Connection header received
0619 18:45:40.526145 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.526181 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.526516 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.526710 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.800692 (+273982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.414192 (+613500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.949731 (+1535539us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49902: BlockingRecv error: recv got EOF from 127.0.0.1:49902 (error 108)
Metrics: {"mutex_wait_us":1112627,"server-negotiator.queue_time_us":475542,"thread_start_us":323164,"threads_started":1}
W20260619 18:45:43.027807 12531 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.401650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49938)
0619 18:45:39.747638 (+345988us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.747716 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.748036 (+ 320us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.657443 (+909407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.658926 (+ 1483us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.667478 (+ 8552us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.980877 (+313399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.983225 (+ 2348us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.410194 (+426969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.411907 (+ 1713us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.103137 (+691230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.106078 (+ 2941us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.951432 (+845354us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":275045,"mutex_wait_us":1296707,"thread_start_us":208191,"threads_started":1}
W20260619 18:45:43.039677 12410 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.667682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50088)
0619 18:45:39.714411 (+ 46729us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.716565 (+ 2154us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.732390 (+ 15825us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.108606 (+1376216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.108653 (+ 47us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.108829 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.407293 (+298464us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.409238 (+ 1945us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.027235 (+617997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.029332 (+ 2097us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.445319 (+415987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.448730 (+ 3411us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.980098 (+531368us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":89,"mutex_wait_us":967521}
W20260619 18:45:43.038044 12464 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.585385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50010)
0619 18:45:39.609740 (+ 24355us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.609806 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.610106 (+ 300us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.539232 (+929126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.539265 (+ 33us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.539381 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.961540 (+422159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.963669 (+ 2129us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.398082 (+434413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.398127 (+ 45us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:41.978777 (+580650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.980952 (+ 2175us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.168542 (+187590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.174658 (+ 6116us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.471997 (+297339us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:42.540688 (+ 68691us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:42.540729 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:42.540819 (+ 90us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:42.541041 (+ 222us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:42.951210 (+410169us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 15 requested bytes
Metrics: {"client-negotiator.queue_time_us":4740,"mutex_wait_us":1465366}
W20260619 18:45:43.069954 12596 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.824764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49968 (local address 127.6.120.254:36501)
0619 18:45:41.033721 (+208957us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.033754 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.033804 (+ 50us) server_negotiation.cc:407] Connection header received
0619 18:45:41.033949 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.033980 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.034246 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.034461 (+ 215us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.194381 (+159920us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:41.530960 (+336579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.019179 (+488219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.999397 (+980218us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49968: BlockingRecv error: recv got EOF from 127.0.0.1:49968 (error 108)
Metrics: {"mutex_wait_us":748441,"server-negotiator.queue_time_us":208463,"spinlock_wait_cycles":2550528,"thread_start_us":233555,"threads_started":1}
W20260619 18:45:43.067873 12570 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.158252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49918 (local address 127.6.120.254:36501)
0619 18:45:40.586057 (+427805us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.586108 (+ 51us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.586181 (+ 73us) server_negotiation.cc:407] Connection header received
0619 18:45:40.586373 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.586401 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.600452 (+ 14051us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.603764 (+ 3312us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.778494 (+174730us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.828214 (+ 49720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.364492 (+536278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.120133 (+755641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.574354 (+454221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.994376 (+420022us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49918: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1237259,"server-negotiator.queue_time_us":427114,"spinlock_wait_cycles":29094656,"thread_start_us":135785,"threads_started":1}
W20260619 18:45:43.077708 12501 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.833876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50220)
0619 18:45:39.835241 (+ 1365us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.836194 (+ 953us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.840137 (+ 3943us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:42.457369 (+2617232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:42.465527 (+ 8158us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:42.468076 (+ 2549us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:42.561727 (+ 93651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.565856 (+ 4129us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.956426 (+390570us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":862,"mutex_wait_us":167273}
W20260619 18:45:43.095978 12450 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.685516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50136)
0619 18:45:39.750869 (+ 65353us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.752417 (+ 1548us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.794294 (+ 41877us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.866635 (+2072341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.867991 (+ 1356us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.876083 (+ 8092us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:42.425565 (+549482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.425629 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.997664 (+572035us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":2446,"mutex_wait_us":601998}
W20260619 18:45:43.106766 12595 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.892409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50056 (local address 127.6.120.254:36501)
0619 18:45:41.036556 (+144147us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.036600 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.036666 (+ 66us) server_negotiation.cc:407] Connection header received
0619 18:45:41.036858 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.036890 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.037188 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.037423 (+ 235us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.517815 (+480392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.846361 (+328546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.219826 (+373465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.961283 (+741457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.091416 (+130133us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50056: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1437351,"server-negotiator.queue_time_us":143502}
W20260619 18:45:43.107236 12537 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.652222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50124)
0619 18:45:39.742718 (+ 90496us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.742793 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.743144 (+ 351us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.868482 (+2125338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.869290 (+ 808us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.869421 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:42.473654 (+604233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.474371 (+ 717us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.018628 (+544257us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":89827,"mutex_wait_us":744073,"thread_start_us":48569,"threads_started":1}
W20260619 18:45:43.115267 12591 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.638300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49944 (local address 127.6.120.254:36501)
0619 18:45:40.832489 (+194189us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.832532 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.832590 (+ 58us) server_negotiation.cc:407] Connection header received
0619 18:45:40.832757 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.832793 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.833097 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.833331 (+ 234us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.332012 (+498681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.811181 (+479169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.002986 (+1191805us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49944: BlockingRecv error: recv got EOF from 127.0.0.1:49944 (error 108)
Metrics: {"mutex_wait_us":936665,"server-negotiator.queue_time_us":193507}
W20260619 18:45:43.110862 12455 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.608163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50032)
0619 18:45:39.611538 (+ 3375us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.611604 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.613722 (+ 2118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.857049 (+1243327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.859828 (+ 2779us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.892859 (+ 33031us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.388856 (+495997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.388913 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.713345 (+324432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.713397 (+ 52us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.429269 (+715872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.429332 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.042631 (+613299us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":329,"mutex_wait_us":1445860}
W20260619 18:45:43.151902 12087 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.751784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49814 (local address 127.6.120.254:36501)
0619 18:45:39.799562 (+ 47778us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.799595 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:39.799648 (+ 53us) server_negotiation.cc:407] Connection header received
0619 18:45:39.799844 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:39.799869 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.291645 (+491776us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:40.350225 (+ 58580us) spinlock_profiling.cc:243] Waited 9.34 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:40.353756 (+ 3531us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.354069 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.806749 (+452680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.343627 (+536878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.000892 (+1657265us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49814: BlockingRecv error: recv got EOF from 127.0.0.1:49814 (error 108)
Metrics: {"mutex_wait_us":1049232,"server-negotiator.queue_time_us":47338,"spinlock_wait_cycles":31826688,"thread_start_us":65949,"threads_started":1}
W20260619 18:45:43.155929 12431 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.663967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50066)
0619 18:45:39.671017 (+ 7050us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.671082 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.673138 (+ 2056us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.141713 (+1468575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.143159 (+ 1446us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.158188 (+ 15029us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.411836 (+253648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.414233 (+ 2397us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.798842 (+384609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.801725 (+ 2883us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.067830 (+266105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.095517 (+ 27687us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.998570 (+903053us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1157,"mutex_wait_us":694425}
W20260619 18:45:43.162779 12492 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.682574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50134)
0619 18:45:39.707690 (+ 25116us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.707763 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.708001 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.929501 (+2221500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.932676 (+ 3175us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.948238 (+ 15562us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:42.517427 (+569189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.518596 (+ 1169us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.996779 (+478183us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":2734,"mutex_wait_us":767129}
W20260619 18:45:43.182821 12437 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.376154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49922)
0619 18:45:39.402313 (+ 26159us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.405138 (+ 2825us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.437689 (+ 32551us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.674199 (+1236510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.674782 (+ 583us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.682241 (+ 7459us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.991821 (+309580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.995188 (+ 3367us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.363318 (+368130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.365175 (+ 1857us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.255127 (+889952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.320936 (+ 65809us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.004457 (+683521us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":3694,"mutex_wait_us":1546140}
W20260619 18:45:43.184458 12432 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.704155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50138)
0619 18:45:39.723172 (+ 19017us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.723217 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.751807 (+ 28590us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:42.072308 (+2320501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:42.072341 (+ 33us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:42.072503 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:42.522570 (+450067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.523659 (+ 1089us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.044962 (+521303us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1159,"mutex_wait_us":727835}
W20260619 18:45:43.278575 12237 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 70106.3us
W20260619 18:45:43.278659 12563 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.076966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50208 (local address 127.6.120.254:36501)
0619 18:45:42.226577 (+149611us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:42.226627 (+ 50us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:42.226682 (+ 55us) server_negotiation.cc:407] Connection header received
0619 18:45:42.226869 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:42.226904 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:42.227293 (+ 389us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:42.227485 (+ 192us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:43.087944 (+860459us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50208: BlockingRecv error: recv got EOF from 127.0.0.1:50208 (error 108)
Metrics: {"mutex_wait_us":224618,"server-negotiator.queue_time_us":149085,"spinlock_wait_cycles":28416}
W20260619 18:45:43.285713 12185 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.585262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49996)
0619 18:45:39.660852 (+ 75590us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.663651 (+ 2799us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.683303 (+ 19652us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.542951 (+859648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.543822 (+ 871us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.543983 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.028237 (+484254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.028323 (+ 86us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.425486 (+397163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.425543 (+ 57us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.165353 (+739810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.168057 (+ 2704us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.044740 (+876683us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":16353,"mutex_wait_us":1424374}
W20260619 18:45:43.278432 12207 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 81737.6us
W20260619 18:45:43.309666 12502 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.638670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49960 (local address 127.6.120.254:36501)
0619 18:45:40.842179 (+203509us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.842219 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.842300 (+ 81us) server_negotiation.cc:407] Connection header received
0619 18:45:40.842479 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.842515 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.842813 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.853061 (+ 10248us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.307938 (+454877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.682622 (+374684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.173641 (+491019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.035263 (+861622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.162597 (+127334us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49960: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1353053,"server-negotiator.queue_time_us":202942,"thread_start_us":184912,"threads_started":1}
W20260619 18:45:43.314320 12091 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.081711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50264 (local address 127.6.120.254:36501)
0619 18:45:42.964413 (+882702us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:42.964448 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:42.964505 (+ 57us) server_negotiation.cc:407] Connection header received
0619 18:45:42.964650 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:42.965592 (+ 942us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:42.967468 (+ 1876us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:42.967676 (+ 208us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:43.182646 (+214970us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50264: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"mutex_wait_us":164230,"server-negotiator.queue_time_us":868768}
W20260619 18:45:43.316303 12547 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.811388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50208)
0619 18:45:39.870397 (+ 59009us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.870444 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.870709 (+ 265us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:42.227561 (+2356852us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:42.227601 (+ 40us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:42.227731 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:42.917171 (+689440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.920583 (+ 3412us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.064589 (+144006us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":58540,"mutex_wait_us":728841,"thread_start_us":34842,"threads_started":1}
W20260619 18:45:43.330440 12577 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.300180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49938 (local address 127.6.120.254:36501)
0619 18:45:40.601950 (+301770us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.601986 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.602050 (+ 64us) server_negotiation.cc:407] Connection header received
0619 18:45:40.606701 (+ 4651us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.608191 (+ 1490us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.647198 (+ 39007us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.656733 (+ 9535us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.777870 (+121137us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.991314 (+213444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.396086 (+404772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.111612 (+715526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.430023 (+318411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.430365 (+ 342us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:43.077962 (+647597us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49938: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"mutex_wait_us":1003959,"server-negotiator.queue_time_us":298863,"spinlock_wait_cycles":8947456,"thread_start_us":106746,"threads_started":1}
W20260619 18:45:43.331566 12557 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.984217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49886 (local address 127.6.120.254:36501)
0619 18:45:40.496341 (+512124us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.496378 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.496424 (+ 46us) server_negotiation.cc:407] Connection header received
0619 18:45:40.496594 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.496630 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.503683 (+ 7053us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.505848 (+ 2165us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.765743 (+259895us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.775680 (+ 9937us) spinlock_profiling.cc:243] Waited 6.37 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.813788 (+ 38108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.388068 (+574280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.112755 (+724687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.037933 (+925178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.178162 (+140229us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:49886: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1541840,"server-negotiator.queue_time_us":511623,"spinlock_wait_cycles":63000960,"thread_start_us":132813,"threads_started":1}
W20260619 18:45:43.332906 12058 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.415640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49946 (local address 127.6.120.254:36501)
0619 18:45:39.576230 (+160590us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:39.576268 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.495534 (+919266us) server_negotiation.cc:407] Connection header received
0619 18:45:40.496234 (+ 700us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.496275 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.496604 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.496807 (+ 203us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.805897 (+309090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.390699 (+584802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.194110 (+803411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.112949 (+918839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.239039 (+126090us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:49946: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1379284,"server-negotiator.queue_time_us":47277}
W20260619 18:45:43.345383 12569 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.985103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50010 (local address 127.6.120.254:36501)
0619 18:45:40.529595 (+544492us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.529638 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.529709 (+ 71us) server_negotiation.cc:407] Connection header received
0619 18:45:40.529886 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.529921 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.530228 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.536933 (+ 6705us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.647601 (+110668us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f13888caca0 00007f138897f49c 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.765416 (+117815us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.968401 (+202985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.397617 (+429216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.988433 (+590816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.152994 (+164561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.235394 (+ 82400us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:42.541592 (+306198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 18:45:42.541654 (+ 62us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 18:45:42.541700 (+ 46us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 18:45:42.541789 (+ 89us) server_negotiation.cc:922] calling sasl_server_start()
0619 18:45:42.541952 (+ 163us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 18:45:42.542030 (+ 78us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 18:45:42.542254 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0619 18:45:43.141149 (+598895us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50010: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"mutex_wait_us":682877,"server-negotiator.queue_time_us":520522,"spinlock_wait_cycles":64024064,"thread_start_us":354624,"threads_started":1}
W20260619 18:45:43.345739 12560 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.887226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50250 (local address 127.6.120.254:36501)
0619 18:45:40.210003 (+322777us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.212748 (+ 2745us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.215150 (+ 2402us) server_negotiation.cc:407] Connection header received
0619 18:45:40.238943 (+ 23793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.238974 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.239222 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.258176 (+ 18954us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.690864 (+432688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.332296 (+641432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.167973 (+835677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.093978 (+926005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.253705 (+159727us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50250: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1701864,"server-negotiator.queue_time_us":281201,"thread_start_us":37110,"threads_started":1}
W20260619 18:45:43.352203 12490 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.110661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50196 (local address 127.6.120.254:36501)
0619 18:45:43.104410 (+993749us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.108419 (+ 4009us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.110750 (+ 2331us) server_negotiation.cc:407] Connection header received
0619 18:45:43.120436 (+ 9686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.143701 (+ 23265us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.163833 (+ 20132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.181318 (+ 17485us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50196: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"server-negotiator.queue_time_us":933267}
W20260619 18:45:43.360459 12544 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.732689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50052 (local address 127.6.120.254:36501)
0619 18:45:40.940439 (+207750us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.940480 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.940554 (+ 74us) server_negotiation.cc:407] Connection header received
0619 18:45:40.940753 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.940791 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.941125 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.941388 (+ 263us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.349257 (+407869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.868857 (+519600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.176345 (+1307488us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50052: BlockingRecv error: recv got EOF from 127.0.0.1:50052 (error 108)
Metrics: {"mutex_wait_us":833589,"server-negotiator.queue_time_us":207184}
W20260619 18:45:43.391287 12462 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.639448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50052)
0619 18:45:39.702641 (+ 63193us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.704463 (+ 1822us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.723593 (+ 19130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.941486 (+1217893us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.941528 (+ 42us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.941670 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.303151 (+361481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.308199 (+ 5048us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.877012 (+568813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.878860 (+ 1848us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:43.060395 (+1181535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.060447 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.164361 (+103914us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":2263,"mutex_wait_us":1340666}
W20260619 18:45:43.435413 12554 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.878079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50250)
0619 18:45:40.112893 (+234814us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:40.114208 (+ 1315us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:40.157859 (+ 43651us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.257494 (+ 99635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.258483 (+ 989us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.258635 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:40.688861 (+430226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:40.688944 (+ 83us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.343314 (+654370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.343352 (+ 38us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:42.154133 (+810781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.156270 (+ 2137us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.113108 (+956838us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":58817,"mutex_wait_us":1214986,"thread_start_us":27096,"threads_started":1}
W20260619 18:45:43.475319 12585 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.491634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50032 (local address 127.6.120.254:36501)
0619 18:45:40.785373 (+293739us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.785428 (+ 55us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.787082 (+ 1654us) server_negotiation.cc:407] Connection header received
0619 18:45:40.793295 (+ 6213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.794677 (+ 1382us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.828001 (+ 33324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.854893 (+ 26892us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.927790 (+ 72897us) spinlock_profiling.cc:243] Waited 984 us on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:41.390207 (+462417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.712725 (+322518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.429620 (+716895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.196630 (+767010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.350172 (+153542us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50032: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1187629,"server-negotiator.queue_time_us":244006,"spinlock_wait_cycles":2263808,"thread_start_us":209403,"threads_started":1}
W20260619 18:45:43.539804 12582 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.353914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50308)
0619 18:45:40.693437 (+339523us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:40.693504 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:40.693852 (+ 348us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.439509 (+2745657us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 34 requested bytes
Metrics: {"client-negotiator.queue_time_us":338800,"thread_start_us":98655,"threads_started":1}
W20260619 18:45:43.596037 12411 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.490437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49922 (local address 127.6.120.254:36501)
0619 18:45:40.649749 (+159312us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.649789 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.649855 (+ 66us) server_negotiation.cc:407] Connection header received
0619 18:45:40.650024 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.650059 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.650379 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.673678 (+ 23299us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.823465 (+149787us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.835196 (+ 11731us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b1800194920. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f138cce98b1 00007f138ccf6661 00007f1383e23f96 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1ec6c 00007f1383e1ebd6 0000000000620c99
0619 18:45:40.835718 (+ 522us) spinlock_profiling.cc:243] Waited 3.51 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1ec6c 00007f1383e1ebd6 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.999794 (+164076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.360578 (+360784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.329471 (+968893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.383688 (+1054217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.576950 (+193262us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49922: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1706750,"server-negotiator.queue_time_us":158767,"spinlock_wait_cycles":16704000,"thread_start_us":319836,"threads_started":1}
W20260619 18:45:43.599145 12590 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.306440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50292)
0619 18:45:41.038540 (+732100us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:41.038600 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:41.038957 (+ 357us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:42.968689 (+1929732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:42.968723 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:42.969862 (+ 1139us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:43.278229 (+308367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.280324 (+ 2095us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.597496 (+317172us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":731422,"mutex_wait_us":311375,"thread_start_us":346119,"threads_started":1}
W20260619 18:45:43.612649 12523 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.736422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50066 (local address 127.6.120.254:36501)
0619 18:45:41.091938 (+355516us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.095451 (+ 3513us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.098200 (+ 2749us) server_negotiation.cc:407] Connection header received
0619 18:45:41.109526 (+ 11326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.115967 (+ 6441us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.134732 (+ 18765us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.140282 (+ 5550us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.421645 (+281363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.790076 (+368431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.106126 (+316050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.254620 (+1148494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.445029 (+190409us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50066: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1722845,"server-negotiator.queue_time_us":277364,"thread_start_us":314871,"threads_started":1}
W20260619 18:45:43.631002 12444 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.673630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50126)
0619 18:45:39.705825 (+ 32195us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.705873 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.706230 (+ 357us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.806494 (+2100264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.808515 (+ 2021us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.815015 (+ 6500us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.920353 (+105338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.921640 (+ 1287us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.430578 (+508938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.430612 (+ 34us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:43.192367 (+761755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.196884 (+ 4517us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.529818 (+332934us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":5958,"mutex_wait_us":962922}
W20260619 18:45:43.631220 12413 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.744457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50134 (local address 127.6.120.254:36501)
0619 18:45:41.925115 (+180658us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.925151 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.925203 (+ 52us) server_negotiation.cc:407] Connection header received
0619 18:45:41.925337 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.925366 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.925631 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.925847 (+ 216us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:42.520320 (+594473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.268030 (+747710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.569033 (+301003us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50134: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1196214,"server-negotiator.queue_time_us":137488,"thread_start_us":304363,"threads_started":1}
W20260619 18:45:43.633356 12502 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.156095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50308 (local address 127.6.120.254:36501)
0619 18:45:43.344750 (+1188655us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.344789 (+ 39us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.344852 (+ 63us) server_negotiation.cc:407] Connection header received
0619 18:45:43.345021 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.345058 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.377831 (+ 32773us) spinlock_profiling.cc:243] Waited 6.86 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:43.388010 (+ 10179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.429442 (+ 41432us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:43.632084 (+202642us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50308: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"mutex_wait_us":166082,"server-negotiator.queue_time_us":1158163,"spinlock_wait_cycles":15792768}
W20260619 18:45:43.633458 12558 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.875128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49996 (local address 127.6.120.254:36501)
0619 18:45:40.193129 (+318001us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.489788 (+296659us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.500673 (+ 10885us) server_negotiation.cc:407] Connection header received
0619 18:45:40.510920 (+ 10247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.510956 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.535744 (+ 24788us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:40.535976 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.539974 (+ 3998us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.674679 (+134705us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.761114 (+ 86435us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:40.871099 (+109985us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:41.088441 (+217342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.423141 (+334700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.176574 (+753433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.563485 (+1386911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.612256 (+ 48771us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:49996: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1713958,"server-negotiator.queue_time_us":284490,"spinlock_wait_cycles":65241984,"thread_start_us":39979,"threads_started":1}
W20260619 18:45:43.648406 12573 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.175543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50276)
0619 18:45:40.492379 (+316836us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:40.492487 (+ 108us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:40.494036 (+ 1549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:40.831235 (+337199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:40.831280 (+ 45us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:40.831450 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.346968 (+515518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.349117 (+ 2149us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.063154 (+714037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.063189 (+ 35us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:43.237297 (+1174108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.248153 (+ 10856us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.522127 (+273974us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":315193,"mutex_wait_us":1620416,"thread_start_us":287526,"threads_started":1}
W20260619 18:45:43.693080 12441 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.674984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50102)
0619 18:45:39.738903 (+ 63919us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.740688 (+ 1785us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.773175 (+ 32487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.041471 (+1268296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.041520 (+ 49us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.041717 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.287772 (+246055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.287854 (+ 82us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.988258 (+700404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.989008 (+ 750us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:43.256875 (+1267867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.262916 (+ 6041us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.549965 (+287049us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":5249,"mutex_wait_us":1389030}
W20260619 18:45:43.696942 12551 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.079050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50220 (local address 127.6.120.254:36501)
0619 18:45:42.439126 (+360076us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:42.439159 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:42.439212 (+ 53us) server_negotiation.cc:407] Connection header received
0619 18:45:42.441909 (+ 2697us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:42.442576 (+ 667us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:42.453521 (+ 10945us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:42.456324 (+ 2803us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:42.567534 (+111210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.482065 (+914531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.695323 (+213258us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50220: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1074501,"server-negotiator.queue_time_us":354784}
W20260619 18:45:43.913676 12189 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 254569us
W20260619 18:45:43.903843 12222 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 265909us
W20260619 18:45:43.952823 12612 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.052691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50088 (local address 127.6.120.254:36501)
0619 18:45:41.060679 (+ 7988us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.060737 (+ 58us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.061882 (+ 1145us) server_negotiation.cc:407] Connection header received
0619 18:45:41.062194 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.064662 (+ 2468us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.093244 (+ 28582us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.108087 (+ 14843us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.428429 (+320342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.019167 (+590738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.453195 (+434028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.380413 (+927218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.697387 (+316974us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50088: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1792801,"server-negotiator.queue_time_us":5674}
W20260619 18:45:43.970185 12224 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 761130us
W20260619 18:45:43.973647 12507 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.580963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50328)
0619 18:45:40.582343 (+ 1380us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:40.582424 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:40.582743 (+ 319us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.092944 (+2510201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.094632 (+ 1688us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.110705 (+ 16073us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:43.378186 (+267481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.379943 (+ 1757us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.696693 (+316750us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":752,"mutex_wait_us":319442}
W20260619 18:45:44.029301 12653 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.807676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50138 (local address 127.6.120.254:36501)
0619 18:45:42.070172 (+262496us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:42.070771 (+ 599us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:42.070829 (+ 58us) server_negotiation.cc:407] Connection header received
0619 18:45:42.070978 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:42.071007 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:42.071243 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:42.071446 (+ 203us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:42.544844 (+473398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.450080 (+905236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.631186 (+181106us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50138: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1350457,"server-negotiator.queue_time_us":261961,"thread_start_us":190776,"threads_started":1}
W20260619 18:45:44.037703 12549 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.837961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50234)
0619 18:45:40.128720 (+290759us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:40.131534 (+ 2814us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:40.189770 (+ 58236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.352219 (+1162449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.352915 (+ 696us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.353065 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.684465 (+331400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.684536 (+ 71us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.064020 (+379484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.064940 (+ 920us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:43.266981 (+1202041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.267045 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.835632 (+568587us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":134023,"mutex_wait_us":1520600,"thread_start_us":58442,"threads_started":1}
W20260619 18:45:44.050541 12603 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.892773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50102 (local address 127.6.120.254:36501)
0619 18:45:41.038540 (+145767us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.040163 (+ 1623us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.040242 (+ 79us) server_negotiation.cc:407] Connection header received
0619 18:45:41.040438 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.040475 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.040808 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.041232 (+ 424us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.414877 (+373645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.979459 (+564582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.691710 (+1712251us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50102: BlockingRecv error: recv got EOF from 127.0.0.1:50102 (error 108)
Metrics: {"mutex_wait_us":947021,"server-negotiator.queue_time_us":144937,"thread_start_us":420264,"threads_started":1}
W20260619 18:45:44.060853 12589 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.504786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50276 (local address 127.6.120.254:36501)
0619 18:45:40.812800 (+308014us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.818417 (+ 5617us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:40.819807 (+ 1390us) server_negotiation.cc:407] Connection header received
0619 18:45:40.823816 (+ 4009us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:40.824916 (+ 1100us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:40.829762 (+ 4846us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:40.830042 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:40.830313 (+ 271us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:40.916348 (+ 86035us) spinlock_profiling.cc:243] Waited 1.36 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:41.361953 (+445605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.054764 (+692811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.691771 (+1637007us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50276: BlockingRecv error: recv got EOF from 127.0.0.1:50276 (error 108)
Metrics: {"mutex_wait_us":793181,"server-negotiator.queue_time_us":305502,"spinlock_wait_cycles":9194624,"thread_start_us":187649,"threads_started":1}
W20260619 18:45:44.072724 12583 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.335569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50320)
0619 18:45:40.691903 (+356334us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:40.691975 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:40.692350 (+ 375us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.593920 (+901570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.594736 (+ 816us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.623446 (+ 28710us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.684302 (+ 60856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.684403 (+ 101us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.040142 (+355739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.048530 (+ 8388us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:43.478002 (+1429472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.478106 (+ 104us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.938101 (+459995us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":355655,"mutex_wait_us":1623379,"thread_start_us":115349,"threads_started":1}
W20260619 18:45:44.074736 12194 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.591555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50026)
0619 18:45:39.610619 (+ 19064us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.610670 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.610889 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.655807 (+2044918us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.657536 (+ 1729us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.682342 (+ 24806us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.686785 (+ 4443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.686844 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.211249 (+524405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.212732 (+ 1483us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:43.691667 (+1478935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.712654 (+ 20987us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.048170 (+335516us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":277,"mutex_wait_us":1481501}
W20260619 18:45:44.078672 12014 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.059147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50234 (local address 127.6.120.254:36501)
0619 18:45:41.347893 (+288746us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.347926 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.347974 (+ 48us) server_negotiation.cc:407] Connection header received
0619 18:45:41.348123 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.348151 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.348384 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.349048 (+ 664us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.685422 (+336374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.049694 (+364272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.010500 (+1960806us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50234: BlockingRecv error: recv got EOF from 127.0.0.1:50234 (error 108)
Metrics: {"mutex_wait_us":603199,"server-negotiator.queue_time_us":279051,"thread_start_us":238869,"threads_started":1}
W20260619 18:45:44.057557 12425 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 700989us
W20260619 18:45:44.099273 12485 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.804090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50168)
0619 18:45:39.812302 (+ 8212us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.812352 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.812635 (+ 283us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:42.248194 (+2435559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:42.250132 (+ 1938us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:42.327440 (+ 77308us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:42.418332 (+ 90892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.418416 (+ 84us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.434807 (+ 16391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.434837 (+ 30us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:43.976333 (+1541496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.976426 (+ 93us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.094451 (+118025us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":3520,"mutex_wait_us":1546381}
W20260619 18:45:44.088537 12513 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.916947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50358)
0619 18:45:40.920913 (+ 3966us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:40.921021 (+ 108us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:40.921376 (+ 355us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.261344 (+2339968us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.261379 (+ 35us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.261509 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:43.634810 (+373301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.634865 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.999841 (+364976us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1225,"mutex_wait_us":413214}
W20260619 18:45:44.087639 12592 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.515625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50324)
0619 18:45:40.917561 (+401936us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:40.919177 (+ 1616us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:40.936295 (+ 17118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:42.960282 (+2023987us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:42.960325 (+ 43us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:42.960453 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:43.434693 (+474240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.437122 (+ 2429us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.651975 (+214853us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":343941,"mutex_wait_us":507356,"thread_start_us":176977,"threads_started":1}
W20260619 18:45:44.110601 12574 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.798020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50182)
0619 18:45:40.239208 (+441188us) spinlock_profiling.cc:243] Waited 5.03 ms on lock 0x7b4400023f4c. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383d68a95 00007f1383d694b2 00007f138a346511 00007f138a341e1a 00007f1383e385fe 00007f138cc63a39 00007f1383e558bb 00007f1383e53cbf 00007f1383e55e22 00007f138892cc48
0619 18:45:40.665643 (+426435us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:40.666930 (+ 1287us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:40.680497 (+ 13567us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.400070 (+719573us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.401321 (+ 1251us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.412491 (+ 11170us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.587568 (+175077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.594574 (+ 7006us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.063528 (+468954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.063569 (+ 41us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:43.551976 (+1488407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.553969 (+ 1993us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.697904 (+143935us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":792514,"mutex_wait_us":1524818,"spinlock_wait_cycles":11579776,"thread_start_us":691058,"threads_started":1}
W20260619 18:45:44.111007 12497 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.736328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50330 (local address 127.6.120.254:36501)
0619 18:45:40.989716 (+253388us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.990540 (+ 824us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.042242 (+ 51702us) server_negotiation.cc:407] Connection header received
0619 18:45:41.042418 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.042462 (+ 44us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.042801 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.043028 (+ 227us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.449222 (+406194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.997564 (+548342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.992141 (+1994577us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50330: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":928603,"server-negotiator.queue_time_us":226121,"thread_start_us":119299,"threads_started":1}
W20260619 18:45:44.135676 12619 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.329746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50320 (local address 127.6.120.254:36501)
0619 18:45:41.583848 (+254102us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.583894 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.583942 (+ 48us) server_negotiation.cc:407] Connection header received
0619 18:45:41.584098 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.584144 (+ 46us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.584392 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.584619 (+ 227us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.693318 (+108699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.037302 (+343984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.029987 (+1992685us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50320: BlockingRecv error: recv got EOF from 127.0.0.1:50320 (error 108)
Metrics: {"mutex_wait_us":369861,"server-negotiator.queue_time_us":226013}
W20260619 18:45:44.131067 12405 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.652079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50112)
0619 18:45:39.714369 (+ 62290us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.716866 (+ 2497us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.750577 (+ 33711us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.709661 (+1959084us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.709702 (+ 41us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.709875 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.791900 (+ 82025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.795055 (+ 3155us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.437165 (+642110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.437215 (+ 50us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:43.590979 (+1153764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.600851 (+ 9872us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.992221 (+391370us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":7992,"mutex_wait_us":1349188}
W20260619 18:45:44.149426 12645 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.732718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50124 (local address 127.6.120.254:36501)
0619 18:45:41.862713 (+129995us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.862761 (+ 48us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.862821 (+ 60us) server_negotiation.cc:407] Connection header received
0619 18:45:41.863069 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.863107 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.864345 (+ 1238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.872325 (+ 7980us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:42.478950 (+606625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.637133 (+1158183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.069203 (+432070us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50124: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1561762,"server-negotiator.queue_time_us":121977}
W20260619 18:45:44.154870 12634 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.344399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50126 (local address 127.6.120.254:36501)
0619 18:45:41.775020 (+430621us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.775962 (+ 942us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.776890 (+ 928us) server_negotiation.cc:407] Connection header received
0619 18:45:41.788591 (+ 11701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.789144 (+ 553us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.799537 (+ 10393us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.804862 (+ 5325us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.840013 (+ 35151us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:41.947398 (+107385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.430254 (+482856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.962014 (+1531760us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50126: BlockingRecv error: recv got EOF from 127.0.0.1:50126 (error 108)
Metrics: {"mutex_wait_us":865046,"server-negotiator.queue_time_us":346403,"spinlock_wait_cycles":5314048,"thread_start_us":282524,"threads_started":1}
W20260619 18:45:44.161089 12466 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.589090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50048 (local address 127.6.120.254:36501)
0619 18:45:41.775056 (+185966us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.776214 (+ 1158us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.777622 (+ 1408us) server_negotiation.cc:407] Connection header received
0619 18:45:41.783997 (+ 6375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.785489 (+ 1492us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.797261 (+ 11772us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.802699 (+ 5438us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.973136 (+170437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.202218 (+229082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.159296 (+1957078us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50048: BlockingRecv error: recv got EOF from 127.0.0.1:50048 (error 108)
Metrics: {"mutex_wait_us":295499,"server-negotiator.queue_time_us":110439,"spinlock_wait_cycles":1646336,"thread_start_us":133500,"threads_started":1}
W20260619 18:45:44.176812 12535 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.065086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50168 (local address 127.6.120.254:36501)
0619 18:45:42.226218 (+161132us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:42.226270 (+ 52us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:42.226342 (+ 72us) server_negotiation.cc:407] Connection header received
0619 18:45:42.226806 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:42.226865 (+ 59us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:42.233277 (+ 6412us) spinlock_profiling.cc:243] Waited 893 us on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f13888caca0 00007f138897f49c 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:42.233490 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:42.233679 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:42.429560 (+195881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.431185 (+ 1625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.173085 (+1741900us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50168: BlockingRecv error: recv got EOF from 127.0.0.1:50168 (error 108)
Metrics: {"mutex_wait_us":256434,"server-negotiator.queue_time_us":158740,"spinlock_wait_cycles":2077824}
W20260619 18:45:44.193925 12624 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.339557 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50112 (local address 127.6.120.254:36501)
0619 18:45:41.708579 (+369022us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.708638 (+ 59us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.708713 (+ 75us) server_negotiation.cc:407] Connection header received
0619 18:45:41.708907 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.708944 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.709261 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.709543 (+ 282us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.816503 (+106960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.436722 (+620219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.030073 (+1593351us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50112: BlockingRecv error: recv got EOF from 127.0.0.1:50112 (error 108)
Metrics: {"mutex_wait_us":588524,"server-negotiator.queue_time_us":310068}
W20260619 18:45:44.206563 12419 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.643996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50048)
0619 18:45:39.704755 (+ 60759us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.708921 (+ 4166us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.737296 (+ 28375us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.806251 (+2068955us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.808344 (+ 2093us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.817602 (+ 9258us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.971874 (+154272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.971944 (+ 70us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.212725 (+240781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.213503 (+ 778us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:43.947394 (+1733891us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.951003 (+ 3609us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.071010 (+120007us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1712,"mutex_wait_us":1434022}
W20260619 18:45:44.128471 12632 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.655142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50136 (local address 127.6.120.254:36501)
0619 18:45:41.787004 (+131862us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.787048 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.789177 (+ 2129us) server_negotiation.cc:407] Connection header received
0619 18:45:41.795216 (+ 6039us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.797003 (+ 1787us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.841817 (+ 44814us) spinlock_profiling.cc:243] Waited 8.21 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:41.858390 (+ 16573us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.862473 (+ 4083us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:42.425975 (+563502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.436234 (+1010259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.960547 (+524313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50136: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1407294,"server-negotiator.queue_time_us":45901,"spinlock_wait_cycles":18874624,"thread_start_us":126839,"threads_started":1}
W20260619 18:45:44.338750 12509 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.023941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50370)
0619 18:45:41.129386 (+105445us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:41.130262 (+ 876us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:41.139134 (+ 8872us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.801768 (+662634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.802740 (+ 972us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.811960 (+ 9220us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.860297 (+ 48337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.861181 (+ 884us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.522296 (+661115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.522332 (+ 36us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:43.691420 (+1169088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.694750 (+ 3330us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.187385 (+492635us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":37700,"mutex_wait_us":1149951}
W20260619 18:45:44.264247 12614 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.053224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50182 (local address 127.6.120.254:36501)
0619 18:45:41.367139 (+313915us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.368047 (+ 908us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.368686 (+ 639us) server_negotiation.cc:407] Connection header received
0619 18:45:41.374067 (+ 5381us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.375461 (+ 1394us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.391817 (+ 16356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.398696 (+ 6879us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.618481 (+219785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.057703 (+439222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.015588 (+1957885us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50182: BlockingRecv error: recv got EOF from 127.0.0.1:50182 (error 108)
Metrics: {"mutex_wait_us":614555,"server-negotiator.queue_time_us":276484,"thread_start_us":5370,"threads_started":1}
W20260619 18:45:44.362099 12598 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.680192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50330)
0619 18:45:41.040262 (+360070us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:41.040383 (+ 121us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:41.040748 (+ 365us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.043330 (+ 2582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.043372 (+ 42us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.043542 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.446354 (+402812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.448097 (+ 1743us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.997897 (+549800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.997931 (+ 34us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:44.040719 (+2042788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.044671 (+ 3952us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.165600 (+120929us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":357169,"mutex_wait_us":2154594,"thread_start_us":375423,"threads_started":1}
W20260619 18:45:44.403893 12406 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.664480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50072)
0619 18:45:39.730355 (+ 65875us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.731556 (+ 1201us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.750395 (+ 18839us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.844091 (+2093696us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.846754 (+ 2663us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.857288 (+ 10534us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.995874 (+138586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.995956 (+ 82us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.471861 (+475905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.471910 (+ 49us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:44.185269 (+1713359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.190928 (+ 5659us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.232666 (+ 41738us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":5354,"mutex_wait_us":1728601}
W20260619 18:45:44.402922 12516 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.058800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49980 (local address 127.6.120.254:36501)
0619 18:45:41.361581 (+302781us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.362315 (+ 734us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.363828 (+ 1513us) server_negotiation.cc:407] Connection header received
0619 18:45:41.368152 (+ 4324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.368754 (+ 602us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.379103 (+ 10349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.388500 (+ 9397us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.712531 (+324031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.065472 (+352941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.206673 (+2141201us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:49980: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":498532,"server-negotiator.queue_time_us":272591,"thread_start_us":256368,"threads_started":1}
W20260619 18:45:44.417434 12491 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.354971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50370 (local address 127.6.120.254:36501)
0619 18:45:41.753318 (+398347us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.771942 (+ 18624us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.775331 (+ 3389us) server_negotiation.cc:407] Connection header received
0619 18:45:41.780653 (+ 5322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.781972 (+ 1319us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.793456 (+ 11484us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.799630 (+ 6174us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.834043 (+ 34413us) spinlock_profiling.cc:243] Waited 4.97 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:41.872034 (+ 37991us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:41.993735 (+121701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.518777 (+525042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.712348 (+1193571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.358691 (+646343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.402225 (+ 43534us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50370: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1132906,"server-negotiator.queue_time_us":341333,"spinlock_wait_cycles":48491520,"thread_start_us":266375,"threads_started":1}
W20260619 18:45:44.421130 12620 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.315735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50026 (local address 127.6.120.254:36501)
0619 18:45:41.619274 (+303539us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.620058 (+ 784us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.625899 (+ 5841us) server_negotiation.cc:407] Connection header received
0619 18:45:41.636406 (+ 10507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.647352 (+ 10946us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.651468 (+ 4116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.655382 (+ 3914us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.690240 (+ 34858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.201802 (+511562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.182918 (+1981116us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50026: BlockingRecv error: recv got EOF from 127.0.0.1:50026 (error 108)
Metrics: {"mutex_wait_us":528201,"server-negotiator.queue_time_us":219728,"thread_start_us":272848,"threads_started":1}
W20260619 18:45:44.412482 12081 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.110072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50324 (local address 127.6.120.254:36501)
0619 18:45:42.957460 (+847388us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:42.957497 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:42.957548 (+ 51us) server_negotiation.cc:407] Connection header received
0619 18:45:42.957691 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:42.957726 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:42.957992 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:42.958194 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:43.441986 (+483792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.049171 (+607185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.234346 (+185175us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50324: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":770183,"server-negotiator.queue_time_us":846909}
W20260619 18:45:44.446267 12633 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.370932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50408)
0619 18:45:41.727745 (+356813us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:41.727800 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:41.728093 (+ 293us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.258136 (+1530043us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.262811 (+ 4675us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.293378 (+ 30567us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.130901 (+837523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.137541 (+ 6640us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.437856 (+300315us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":330192,"mutex_wait_us":755763,"thread_start_us":284162,"threads_started":1}
W20260619 18:45:44.469313 12182 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.104294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50292 (local address 127.6.120.254:36501)
0619 18:45:42.957817 (+853523us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:42.957879 (+ 62us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:42.957939 (+ 60us) server_negotiation.cc:407] Connection header received
0619 18:45:42.958083 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:42.958119 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:42.967489 (+ 9370us) spinlock_profiling.cc:243] Waited 4.31 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:42.967709 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:42.967912 (+ 203us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:43.294330 (+326418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.110885 (+816555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.208500 (+ 97615us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50292: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":879768,"server-negotiator.queue_time_us":851586,"spinlock_wait_cycles":9907968}
W20260619 18:45:44.536535 12613 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.140654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50382 (local address 127.6.120.254:36501)
0619 18:45:41.346176 (+205522us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.347484 (+ 1308us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.348878 (+ 1394us) server_negotiation.cc:407] Connection header received
0619 18:45:41.354531 (+ 5653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.354732 (+ 201us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.368776 (+ 14044us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.373653 (+ 4877us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.379706 (+ 6053us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:41.586131 (+206425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.924505 (+338374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.447062 (+1522557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.046941 (+599879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.143688 (+ 96747us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:44.232649 (+ 88961us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50382: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":873958,"server-negotiator.queue_time_us":199878,"spinlock_wait_cycles":4325120,"thread_start_us":169404,"threads_started":1}
W20260619 18:45:44.552707 12636 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.723861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50072 (local address 127.6.120.254:36501)
0619 18:45:41.809305 (+ 85444us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.810785 (+ 1480us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.811782 (+ 997us) server_negotiation.cc:407] Connection header received
0619 18:45:41.817613 (+ 5831us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.818861 (+ 1248us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.832311 (+ 13450us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.841780 (+ 9469us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.997220 (+155440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.470131 (+472911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.424941 (+1954810us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50072: BlockingRecv error: recv got EOF from 127.0.0.1:50072 (error 108)
Metrics: {"mutex_wait_us":603677,"server-negotiator.queue_time_us":64525,"spinlock_wait_cycles":1866112}
W20260619 18:45:44.555033 12556 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.110355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50328 (local address 127.6.120.254:36501)
0619 18:45:43.028203 (+917848us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.030277 (+ 2074us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.032223 (+ 1946us) server_negotiation.cc:407] Connection header received
0619 18:45:43.044769 (+ 12546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.047668 (+ 2899us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.064854 (+ 17186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.087513 (+ 22659us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:43.143436 (+ 55923us) spinlock_profiling.cc:243] Waited 5.26 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:43.380923 (+237487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.343161 (+962238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.424377 (+ 81216us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50328: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1141798,"server-negotiator.queue_time_us":865469,"spinlock_wait_cycles":12089216}
W20260619 18:45:44.557163 12596 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.112744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50344 (local address 127.6.120.254:36501)
0619 18:45:43.071217 (+958473us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.071253 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.072361 (+ 1108us) server_negotiation.cc:407] Connection header received
0619 18:45:43.072569 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.072611 (+ 42us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.072964 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.088099 (+ 15135us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:43.145931 (+ 57832us) spinlock_profiling.cc:243] Waited 4.98 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:43.173432 (+ 27501us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:43.198568 (+ 25136us) spinlock_profiling.cc:243] Waited 4.29 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f13888caca0 00007f138897f49c 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:43.310534 (+111966us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.555199 (+1244665us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50344: BlockingRecv error: recv got EOF from 127.0.0.1:50344 (error 108)
Metrics: {"mutex_wait_us":310125,"server-negotiator.queue_time_us":957846,"spinlock_wait_cycles":28905088}
W20260619 18:45:44.572351 12511 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.692581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38340 (local address 127.6.120.193:37901)
0619 18:45:40.981693 (+289112us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:40.981728 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.336649 (+354921us) server_negotiation.cc:407] Connection header received
0619 18:45:41.342651 (+ 6002us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.343740 (+ 1089us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.347888 (+ 4148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.348049 (+ 161us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:41.597597 (+249548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.979381 (+381784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.055906 (+1076525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.609138 (+553232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.051519 (+442381us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:44.484731 (+433212us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:38340: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1737741,"server-negotiator.queue_time_us":267199,"thread_start_us":467026,"threads_started":1}
W20260619 18:45:44.580559 12546 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.748788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50398 (local address 127.6.120.254:36501)
0619 18:45:42.036878 (+288090us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:42.037978 (+ 1100us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:42.039133 (+ 1155us) server_negotiation.cc:407] Connection header received
0619 18:45:42.049577 (+ 10444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:42.050548 (+ 971us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:42.067174 (+ 16626us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:42.101575 (+ 34401us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:42.439837 (+338262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.262022 (+822185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.560378 (+1298356us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50398: BlockingRecv error: recv got EOF from 127.0.0.1:50398 (error 108)
Metrics: {"mutex_wait_us":1136433,"server-negotiator.queue_time_us":227985,"thread_start_us":262450,"threads_started":1}
W20260619 18:45:44.584012 12607 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.779652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50344)
0619 18:45:41.337402 (+557750us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:41.342210 (+ 4808us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:41.349542 (+ 7332us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.092689 (+1743147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.094750 (+ 2061us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.111934 (+ 17184us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.357971 (+1246037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.358664 (+ 693us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.475149 (+116485us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":419623,"mutex_wait_us":963900,"thread_start_us":370619,"threads_started":1}
W20260619 18:45:44.656275 12213 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 1.39444e+06us
W20260619 18:45:44.723050 12483 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:39.509571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:49980)
0619 18:45:39.620255 (+110684us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:39.622922 (+ 2667us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:39.632466 (+ 9544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.387884 (+1755418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.387918 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.388674 (+ 756us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.712135 (+323461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.712210 (+ 75us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.081776 (+369566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.102337 (+ 20561us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:44.347132 (+2244795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.354949 (+ 7817us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.516692 (+161743us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":6219,"mutex_wait_us":2216901}
W20260619 18:45:44.728700 12515 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.155732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50398)
0619 18:45:41.193538 (+ 37806us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:41.193606 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:41.195032 (+ 1426us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:42.103183 (+908151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:42.104732 (+ 1549us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:42.115224 (+ 10492us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:42.436887 (+321663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.436948 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.262480 (+825532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.262511 (+ 31us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:44.356423 (+1093912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.356502 (+ 79us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.476285 (+119783us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1565,"mutex_wait_us":1251650}
W20260619 18:45:44.771791 12604 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.952780 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50362 (local address 127.6.120.254:36501)
0619 18:45:41.054523 (+101743us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.054575 (+ 52us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:41.130953 (+ 76378us) server_negotiation.cc:407] Connection header received
0619 18:45:41.153075 (+ 22122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:41.155132 (+ 2057us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:41.181722 (+ 26590us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:41.189259 (+ 7537us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:41.306263 (+117004us) spinlock_profiling.cc:243] Waited 981 us on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:41.505443 (+199180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.985585 (+480142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.262456 (+1276871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.630718 (+368262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.119858 (+489140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:44.544649 (+424791us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50362: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1684751,"server-negotiator.queue_time_us":97907,"spinlock_wait_cycles":2256128}
W20260619 18:45:44.847280 12692 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.773s user 0.011s sys 0.029s
W20260619 18:45:44.847772 12692 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.798s user 0.011s sys 0.030s
W20260619 18:45:44.778872 12676 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.770s user 0.034s sys 0.095s
W20260619 18:45:44.864673 12689 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.715s user 0.013s sys 0.026s
W20260619 18:45:45.069391 12144 net_util.cc:504] Time spent look up canonical hostname for localhost 'dist-test-slave-90mn': real 0.294s user 0.001s sys 0.000s
W20260619 18:45:45.069638 12357 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.553s user 0.016s sys 0.047s
W20260619 18:45:45.072029 12357 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.555s user 0.016s sys 0.048s
W20260619 18:45:44.960345 12247 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 190251us
W20260619 18:45:45.040419 12512 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.952680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50362)
0619 18:45:41.130004 (+177324us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:41.130061 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:41.137844 (+ 7783us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.189866 (+ 52022us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.190787 (+ 921us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.193011 (+ 2224us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.474815 (+281804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.477260 (+ 2445us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.995255 (+517995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.995296 (+ 41us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:43.262130 (+1266834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.262192 (+ 62us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.635167 (+372975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.635202 (+ 35us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:44.382832 (+747630us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:44.436067 (+ 53235us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:44.436095 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:44.436171 (+ 76us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:44.436302 (+ 131us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:44.559240 (+122938us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":77996,"mutex_wait_us":2041764}
W20260619 18:45:45.079550 12676 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.072s user 0.040s sys 0.099s
W20260619 18:45:45.142282 12689 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.033s user 0.023s sys 0.033s
W20260619 18:45:45.157629 12713 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.718s user 0.023s sys 0.029s
W20260619 18:45:45.158151 12713 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.734s user 0.023s sys 0.029s
W20260619 18:45:45.160213 12687 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.654s user 0.031s sys 0.057s
W20260619 18:45:45.160717 12687 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.032s user 0.031s sys 0.058s
W20260619 18:45:45.172739 12683 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.142s user 0.020s sys 0.042s
W20260619 18:45:45.180763 12154 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.552s user 0.010s sys 0.023s
W20260619 18:45:45.181152 12694 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.646s user 0.027s sys 0.036s
W20260619 18:45:45.192390 12694 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.984s user 0.027s sys 0.037s
W20260619 18:45:45.205978 12683 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.561s user 0.020s sys 0.043s
W20260619 18:45:45.235240 12217 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 879015us
W20260619 18:45:45.220860 12227 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 405497us
W20260619 18:45:45.266260 12654 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.822089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:38346)
0619 18:45:42.204375 (+382286us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.205561 (+ 1186us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.218685 (+ 13124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:42.254925 (+ 36240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:42.274287 (+ 19362us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:42.327066 (+ 52779us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:42.957091 (+630025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.957203 (+ 112us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.480825 (+523622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.480894 (+ 69us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:44.585868 (+1104974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.585949 (+ 81us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.227645 (+641696us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":314726,"mutex_wait_us":1740911,"thread_start_us":157811,"threads_started":1}
W20260619 18:45:45.263094 12631 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.327268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50402)
0619 18:45:41.694512 (+367244us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:41.694584 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:41.694935 (+ 351us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:42.166325 (+471390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:42.168027 (+ 1702us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:42.182349 (+ 14322us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:42.576388 (+394039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.576470 (+ 82us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.560703 (+984233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.561828 (+ 1125us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:44.566860 (+1005032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.567679 (+ 819us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.246144 (+678465us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":364097,"mutex_wait_us":1764253,"thread_start_us":285386,"threads_started":1}
W20260619 18:45:45.273798 12536 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.051589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50402 (local address 127.6.120.254:36501)
0619 18:45:42.147553 (+ 95964us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:42.147599 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:42.147685 (+ 86us) server_negotiation.cc:407] Connection header received
0619 18:45:42.147863 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:42.147898 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:42.153267 (+ 5369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:42.164843 (+ 11576us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:42.228014 (+ 63171us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:42.583879 (+355865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.549287 (+965408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.270497 (+1721210us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50402: BlockingRecv error: recv got EOF from 127.0.0.1:50402 (error 108)
Metrics: {"mutex_wait_us":1200933,"server-negotiator.queue_time_us":92882,"spinlock_wait_cycles":7132160}
W20260619 18:45:45.286346 12661 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.973213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50432)
0619 18:45:42.139351 (+166138us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.139404 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.139671 (+ 267us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:42.162190 (+ 22519us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:42.162241 (+ 51us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:42.162425 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:42.537087 (+374662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.545401 (+ 8314us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.343641 (+798240us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.348033 (+ 4392us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:45.039182 (+1691149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.039279 (+ 97us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.277556 (+238277us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":165006,"mutex_wait_us":1989536,"thread_start_us":133746,"threads_started":1}
W20260619 18:45:45.305794 12508 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.151424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50382)
0619 18:45:41.175419 (+ 23995us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:41.175474 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:41.175751 (+ 277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.375312 (+199561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.376054 (+ 742us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.389446 (+ 13392us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:41.513344 (+123898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.513415 (+ 71us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.926141 (+412726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.926179 (+ 38us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:43.445741 (+1519562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.446591 (+ 850us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.071084 (+624493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.089048 (+ 17964us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:44.408827 (+319779us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:44.430827 (+ 22000us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:44.430869 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:44.430943 (+ 74us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:44.431102 (+ 159us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:45.222217 (+791115us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":2074,"mutex_wait_us":2400442}
W20260619 18:45:45.377969 12600 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:40.691457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:38340)
0619 18:45:41.336386 (+644929us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:41.336459 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:41.336863 (+ 404us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:41.349783 (+ 12920us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:41.349825 (+ 42us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:41.350335 (+ 510us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:41.586248 (+235913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:41.587902 (+ 1654us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:41.996740 (+408838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:41.998302 (+ 1562us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:43.045263 (+1046961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.049502 (+ 4239us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.610427 (+560925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.610493 (+ 66us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:44.385335 (+774842us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:44.587817 (+202482us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 18:45:45.307035 (+719218us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":626377,"mutex_wait_us":2438425,"thread_start_us":338983,"threads_started":1}
W20260619 18:45:45.404570 12223 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 45257.8us
I20260619 18:45:45.412739 12142 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:45.413544 12142 scanner-internal.cc:458] Time spent opening tablet: real 5.174s user 0.012s sys 0.019s
W20260619 18:45:45.412928 12659 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.913140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50428)
0619 18:45:42.319950 (+406810us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.326830 (+ 6880us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.328046 (+ 1216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.089425 (+761379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.092640 (+ 3215us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.108656 (+ 16016us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.386448 (+1277792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.387569 (+ 1121us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.288665 (+901096us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 1179 requested bytes
Metrics: {"client-negotiator.queue_time_us":312547,"mutex_wait_us":1334383,"thread_start_us":150457,"threads_started":1}
I20260619 18:45:45.371730 12136 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:45.500151 12187 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.063758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50468 (local address 127.6.120.254:36501)
0619 18:45:42.194744 (+130986us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:42.195183 (+ 439us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:42.197790 (+ 2607us) server_negotiation.cc:407] Connection header received
0619 18:45:42.200819 (+ 3029us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:42.201959 (+ 1140us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:42.212107 (+ 10148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:42.214307 (+ 2200us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:42.623464 (+409157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.960899 (+337435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.204705 (+1243806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.289120 (+1084415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.421094 (+131974us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50468: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1660006,"server-negotiator.queue_time_us":90716}
W20260619 18:45:45.500346 12652 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.929728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50432 (local address 127.6.120.254:36501)
0619 18:45:42.154592 (+224864us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:42.160869 (+ 6277us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:42.160943 (+ 74us) server_negotiation.cc:407] Connection header received
0619 18:45:42.161122 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:42.161166 (+ 44us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:42.161549 (+ 383us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:42.161837 (+ 288us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:42.553963 (+392126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.310038 (+756075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.413720 (+2103682us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50432: BlockingRecv error: recv got EOF from 127.0.0.1:50432 (error 108)
Metrics: {"mutex_wait_us":1055040,"server-negotiator.queue_time_us":199927}
W20260619 18:45:45.487262 12136 scanner-internal.cc:458] Time spent opening tablet: real 3.903s user 0.002s sys 0.010s
W20260619 18:45:45.513232 12595 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.115169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50358 (local address 127.6.120.254:36501)
0619 18:45:43.175505 (+1060336us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.179954 (+ 4449us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.181149 (+ 1195us) server_negotiation.cc:407] Connection header received
0619 18:45:43.190270 (+ 9121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.193484 (+ 3214us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.247582 (+ 54098us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.258601 (+ 11019us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:43.342567 (+ 83966us) spinlock_profiling.cc:243] Waited 5.26 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:43.698093 (+355526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.576957 (+878864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.315528 (+738571us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50358: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1829771,"server-negotiator.queue_time_us":992335,"spinlock_wait_cycles":12090112}
W20260619 18:45:45.528400 12667 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.037423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50458)
0619 18:45:42.232144 (+194721us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.232209 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.232505 (+ 296us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.473377 (+1240872us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.474398 (+ 1021us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.532227 (+ 57829us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.366484 (+834257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.370551 (+ 4067us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.414070 (+1043519us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":175615,"mutex_wait_us":688257,"thread_start_us":110567,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:45:45.551988 12091 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.137076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50442 (local address 127.6.120.254:36501)
0619 18:45:43.315271 (+1178195us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.315305 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.315362 (+ 57us) server_negotiation.cc:407] Connection header received
0619 18:45:43.315519 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.315549 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.327144 (+ 11595us) spinlock_profiling.cc:243] Waited 917 us on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:43.329138 (+ 1994us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.330258 (+ 1120us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:43.449420 (+119162us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.112072 (+662652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.408250 (+296178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.513361 (+1105111us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50442: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":925119,"server-negotiator.queue_time_us":1176511,"spinlock_wait_cycles":7529984}
W20260619 18:45:45.581045 12591 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.121340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50408 (local address 127.6.120.254:36501)
0619 18:45:43.168714 (+1047374us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.170752 (+ 2038us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.172928 (+ 2176us) server_negotiation.cc:407] Connection header received
0619 18:45:43.178953 (+ 6025us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.183120 (+ 4167us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.242019 (+ 58899us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.257203 (+ 15184us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.137907 (+880704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.271979 (+1134072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.406376 (+134397us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50408: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1421279,"server-negotiator.queue_time_us":994523}
W20260619 18:45:45.583364 12525 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.186433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50490)
0619 18:45:42.210119 (+ 23686us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.211227 (+ 1108us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.220301 (+ 9074us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.369451 (+1149150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.369494 (+ 43us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.369668 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.373027 (+1003359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.374697 (+ 1670us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.581504 (+1206807us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.120.254:36501: BlockingRecv error: recv got EOF from 127.6.120.254:36501 (error 108)
Metrics: {"client-negotiator.queue_time_us":1950,"mutex_wait_us":975294}
W20260619 18:45:45.583447 12058 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.164285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50448 (local address 127.6.120.254:36501)
0619 18:45:43.361261 (+1196976us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.361304 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.361374 (+ 70us) server_negotiation.cc:407] Connection header received
0619 18:45:43.361551 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.361587 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.361923 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.362210 (+ 287us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:43.596691 (+234481us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.293763 (+697072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.316076 (+1022313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.581214 (+265138us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50448: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1989626,"server-negotiator.queue_time_us":1182594,"spinlock_wait_cycles":2367232}
W20260619 18:45:45.579933 12563 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.134477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50454 (local address 127.6.120.254:36501)
0619 18:45:43.332216 (+1197739us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.332255 (+ 39us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.332304 (+ 49us) server_negotiation.cc:407] Connection header received
0619 18:45:43.332438 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.332463 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.332694 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.332891 (+ 197us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:43.391727 (+ 58836us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:43.440816 (+ 49089us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:43.998670 (+557854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.391693 (+1393023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.577531 (+185838us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50454: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1962457,"server-negotiator.queue_time_us":1171219,"spinlock_wait_cycles":36612224}
W20260619 18:45:45.594326 12521 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.013551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50454)
0619 18:45:42.014844 (+ 1293us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.014895 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.015212 (+ 317us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.342516 (+1327304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.346814 (+ 4298us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.356012 (+ 9198us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:43.969075 (+613063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:43.972669 (+ 3594us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.578156 (+1605487us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.120.254:36501: BlockingRecv error: recv got EOF from 127.6.120.254:36501 (error 108)
Metrics: {"client-negotiator.queue_time_us":871,"mutex_wait_us":601094,"thread_start_us":142104,"threads_started":1}
W20260619 18:45:45.595296 12569 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.191000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50490 (local address 127.6.120.254:36501)
0619 18:45:43.368428 (+1177428us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.368472 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.368541 (+ 69us) server_negotiation.cc:407] Connection header received
0619 18:45:43.368714 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.368751 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.369055 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.369751 (+ 696us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.383044 (+1013293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.302246 (+919202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.502076 (+199830us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50490: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1584202,"server-negotiator.queue_time_us":1176812}
W20260619 18:45:45.646361 12666 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.058125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50448)
0619 18:45:42.417719 (+359594us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.417826 (+ 107us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.418180 (+ 354us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.362296 (+944116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.362334 (+ 38us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.363872 (+ 1538us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.162153 (+798281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.162231 (+ 78us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.599646 (+1437415us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.120.254:36501: BlockingRecv error: recv got EOF from 127.6.120.254:36501 (error 108)
Metrics: {"client-negotiator.queue_time_us":358950,"mutex_wait_us":709054,"thread_start_us":285474,"threads_started":1}
W20260619 18:45:45.659559 12087 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.133409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50444 (local address 127.6.120.254:36501)
0619 18:45:43.286343 (+1152934us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.287698 (+ 1355us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.294890 (+ 7192us) server_negotiation.cc:407] Connection header received
0619 18:45:43.305375 (+ 10485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.306604 (+ 1229us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.354508 (+ 47904us) spinlock_profiling.cc:243] Waited 7.42 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:43.365066 (+ 10558us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.379694 (+ 14628us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:43.435887 (+ 56193us) spinlock_profiling.cc:243] Waited 3.51 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.274451 (+838564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.424449 (+1149998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.580094 (+155645us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50444: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1858433,"server-negotiator.queue_time_us":1043361,"spinlock_wait_cycles":25137792}
W20260619 18:45:45.675026 12480 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.825356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38346 (local address 127.6.120.193:37901)
0619 18:45:41.830537 (+ 5181us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:41.830568 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:42.207454 (+376886us) server_negotiation.cc:407] Connection header received
0619 18:45:42.228976 (+ 21522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:42.229008 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:42.236419 (+ 7411us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:42.254548 (+ 18129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:42.957517 (+702969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.480197 (+522680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.718691 (+1238494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.424179 (+705488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.542927 (+118748us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:38346: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1377831,"server-negotiator.queue_time_us":682}
W20260619 18:45:45.676127 12570 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.111826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50428 (local address 127.6.120.254:36501)
0619 18:45:43.074233 (+962407us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.074275 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.074341 (+ 66us) server_negotiation.cc:407] Connection header received
0619 18:45:43.074512 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.074549 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.074884 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.088142 (+ 13258us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.389073 (+1300931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.068213 (+679140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.542384 (+474171us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50428: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1138295,"server-negotiator.queue_time_us":958668}
W20260619 18:45:45.670258 12560 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.182970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50458 (local address 127.6.120.254:36501)
0619 18:45:43.434769 (+1251799us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.435567 (+ 798us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.439365 (+ 3798us) server_negotiation.cc:407] Connection header received
0619 18:45:43.443344 (+ 3979us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.444439 (+ 1095us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.456569 (+ 12130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.471505 (+ 14936us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.376442 (+904937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.584409 (+1207967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.651193 (+ 66784us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50458: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1571141,"server-negotiator.queue_time_us":1171346}
W20260619 18:45:45.686144 12670 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.197272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50478)
0619 18:45:42.434698 (+237426us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.434775 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.439953 (+ 5178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.469478 (+1029525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.471143 (+ 1665us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.523453 (+ 52310us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.413177 (+889724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.419272 (+ 6095us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.580762 (+1161490us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":223500,"mutex_wait_us":646262,"thread_start_us":171476,"threads_started":1}
W20260619 18:45:45.685711 12544 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.472206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50510 (local address 127.6.120.254:36501)
0619 18:45:43.374151 (+901945us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.374192 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.374253 (+ 61us) server_negotiation.cc:407] Connection header received
0619 18:45:43.374406 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.374442 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.374744 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.374986 (+ 242us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.557341 (+1182355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.400793 (+843452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.643621 (+242828us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50510: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1516312,"server-negotiator.queue_time_us":901383}
W20260619 18:45:45.732580 12660 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.964668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50444)
0619 18:45:42.071452 (+106784us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.071557 (+ 105us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.071918 (+ 361us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.384841 (+1312923us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.386841 (+ 2000us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.430009 (+ 43168us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.212833 (+782824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.217893 (+ 5060us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.653628 (+1435735us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":106118,"mutex_wait_us":886238,"thread_start_us":2164,"threads_started":1}
W20260619 18:45:45.744701 12557 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.344479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50492 (local address 127.6.120.254:36501)
0619 18:45:43.369688 (+1025209us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.369730 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.369798 (+ 68us) server_negotiation.cc:407] Connection header received
0619 18:45:43.369967 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.370006 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.370308 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.370536 (+ 228us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.273823 (+903287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.961344 (+687521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.580759 (+619415us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50492: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1383855,"server-negotiator.queue_time_us":1024636}
W20260619 18:45:45.763929 12490 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.448224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50494 (local address 127.6.120.254:36501)
0619 18:45:43.371832 (+923608us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.371885 (+ 53us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.371947 (+ 62us) server_negotiation.cc:407] Connection header received
0619 18:45:43.372126 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.372174 (+ 48us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.372499 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.372751 (+ 252us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:43.564153 (+191402us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:43.575058 (+ 10905us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1ec6c 00007f1383e1ebd6 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.192406 (+617348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.264885 (+1072479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.646960 (+382075us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50494: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1677184,"server-negotiator.queue_time_us":923031,"spinlock_wait_cycles":5456000}
W20260619 18:45:45.784240 12448 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.630991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50546)
0619 18:45:42.632039 (+ 1048us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.634748 (+ 2709us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.635107 (+ 359us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.002201 (+1367094us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.003062 (+ 861us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.013204 (+ 10142us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.399057 (+1385853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.403428 (+ 4371us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.742600 (+339172us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":446,"mutex_wait_us":1347708}
W20260619 18:45:45.802429 12681 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.551597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50522)
0619 18:45:42.869997 (+318400us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.870064 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.870387 (+ 323us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.920298 (+1049911us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.922150 (+ 1852us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.925184 (+ 3034us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.596562 (+671378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.596628 (+ 66us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.798373 (+1201745us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":317758,"mutex_wait_us":631291,"thread_start_us":138657,"threads_started":1}
W20260619 18:45:45.802970 12446 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.644200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50550)
0619 18:45:42.648875 (+ 4675us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.648931 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.651524 (+ 2593us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.638179 (+986655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.652826 (+ 14647us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.698596 (+ 45770us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.687189 (+988593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.687395 (+ 206us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.800752 (+1113357us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1178,"mutex_wait_us":1066857}
W20260619 18:45:45.807778 12411 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.555916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50522 (local address 127.6.120.254:36501)
0619 18:45:43.765389 (+1209473us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.795965 (+ 30576us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.826892 (+ 30927us) server_negotiation.cc:407] Connection header received
0619 18:45:43.849079 (+ 22187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.872844 (+ 23765us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.913926 (+ 41082us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.919429 (+ 5503us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.721063 (+801634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.645757 (+924694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.749283 (+103526us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50522: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1445314,"server-negotiator.queue_time_us":1055871}
W20260619 18:45:45.809648 12532 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.697421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50570)
0619 18:45:42.717108 (+ 19687us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.717177 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.717548 (+ 371us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.176066 (+1458518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.176099 (+ 33us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.176254 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.561689 (+385435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.561745 (+ 56us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.808352 (+1246607us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 1179 requested bytes
Metrics: {"client-negotiator.queue_time_us":18933,"mutex_wait_us":401805}
W20260619 18:45:45.816431 12608 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.962593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50570 (local address 127.6.120.254:36501)
0619 18:45:44.105295 (+1142702us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.107544 (+ 2249us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.111525 (+ 3981us) server_negotiation.cc:407] Connection header received
0619 18:45:44.119162 (+ 7637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.121261 (+ 2099us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.166996 (+ 45735us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.180721 (+ 13725us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.588457 (+407736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.781770 (+1193313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.810940 (+ 29170us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50570: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"mutex_wait_us":1444872,"server-negotiator.queue_time_us":1077858}
W20260619 18:45:45.818463 12460 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.688589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50562)
0619 18:45:42.867742 (+179153us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.867827 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.868213 (+ 386us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.915326 (+1047113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.915378 (+ 52us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.920267 (+ 4889us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.966139 (+1045872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.966247 (+ 108us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.760658 (+794411us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":178083,"mutex_wait_us":922728}
W20260619 18:45:45.818871 12524 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.956872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50442)
0619 18:45:41.999601 (+ 42729us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.003135 (+ 3534us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.026881 (+ 23746us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.329978 (+1303097us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.330008 (+ 30us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.330130 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.092674 (+762544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.099748 (+ 7074us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.408583 (+308835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.408617 (+ 34us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:45.568168 (+1159551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.568245 (+ 77us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.816650 (+248405us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1668,"mutex_wait_us":1989748}
W20260619 18:45:45.819003 12471 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.593089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50536)
0619 18:45:42.922122 (+329033us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.923967 (+ 1845us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.942434 (+ 18467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.633023 (+690589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.633067 (+ 44us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.633207 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.548655 (+915448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.551866 (+ 3211us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.817310 (+1265444us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":283500,"mutex_wait_us":957820}
W20260619 18:45:45.821543 12533 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.062794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50468)
0619 18:45:42.133646 (+ 70852us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.134533 (+ 887us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.141813 (+ 7280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:42.214550 (+ 72737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:42.214587 (+ 37us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:42.214708 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:42.621462 (+406754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.621534 (+ 72us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:42.963543 (+342009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:42.964327 (+ 784us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:44.192240 (+1227913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.196521 (+ 4281us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.736095 (+1539574us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.120.254:36501: BlockingRecv error: recv got EOF from 127.6.120.254:36501 (error 108)
Metrics: {"client-negotiator.queue_time_us":2036,"mutex_wait_us":1698631}
W20260619 18:45:45.822016 12502 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.645187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50550 (local address 127.6.120.254:36501)
0619 18:45:43.634359 (+989172us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.634389 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.634439 (+ 50us) server_negotiation.cc:407] Connection header received
0619 18:45:43.634565 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.634592 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.634821 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.638806 (+ 3985us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.012022 (+373216us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.689309 (+677287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.750145 (+1060836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.820292 (+ 70147us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50550: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1709762,"server-negotiator.queue_time_us":988721,"spinlock_wait_cycles":4946176}
W20260619 18:45:45.826335 12413 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.599045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50536 (local address 127.6.120.254:36501)
0619 18:45:43.632209 (+1033164us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.632240 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.632292 (+ 52us) server_negotiation.cc:407] Connection header received
0619 18:45:43.632427 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.632453 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.632702 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.632922 (+ 220us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.719332 (+1086410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.678979 (+959647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.807053 (+128074us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50536: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":976781,"server-negotiator.queue_time_us":1031476}
W20260619 18:45:45.833503 12585 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.513657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50518 (local address 127.6.120.254:36501)
0619 18:45:43.586160 (+1072503us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.591829 (+ 5669us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.594210 (+ 2381us) server_negotiation.cc:407] Connection header received
0619 18:45:43.610243 (+ 16033us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.611171 (+ 928us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.635733 (+ 24562us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.642416 (+ 6683us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:43.815975 (+173559us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.603984 (+788009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.646396 (+1042412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.810392 (+163996us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50518: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1825323,"server-negotiator.queue_time_us":1028770,"spinlock_wait_cycles":58990336}
W20260619 18:45:45.856880 12523 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.928262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50562 (local address 127.6.120.254:36501)
0619 18:45:43.914263 (+986001us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.914305 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.914385 (+ 80us) server_negotiation.cc:407] Connection header received
0619 18:45:43.914577 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.914621 (+ 44us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.914956 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.915226 (+ 270us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.027060 (+111834us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.966623 (+939563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.826864 (+860241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.852290 (+ 25426us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50562: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1184573,"server-negotiator.queue_time_us":985403,"spinlock_wait_cycles":8178432}
W20260619 18:45:45.879972 12577 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.173614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50478 (local address 127.6.120.254:36501)
0619 18:45:43.433281 (+1259667us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.434259 (+ 978us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.434811 (+ 552us) server_negotiation.cc:407] Connection header received
0619 18:45:43.439572 (+ 4761us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.440623 (+ 1051us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.452129 (+ 11506us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.459883 (+ 7754us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.428407 (+968524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.645647 (+1217240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.843686 (+198039us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50478: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1824148,"server-negotiator.queue_time_us":1179930}
W20260619 18:45:45.905311 12477 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.517626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50518)
0619 18:45:42.520446 (+ 2820us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.520501 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.521927 (+ 1426us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.651426 (+1129499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.651462 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.651591 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.389265 (+737674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.389323 (+ 58us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.903374 (+1514051us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":90,"mutex_wait_us":796185}
W20260619 18:45:45.907773 12658 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.853855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50416)
0619 18:45:42.073615 (+219760us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.086189 (+ 12574us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.111180 (+ 24991us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:42.210647 (+ 99467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:42.211733 (+ 1086us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:42.221266 (+ 9533us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:42.921390 (+700124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:42.921455 (+ 65us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.630127 (+708672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:43.635504 (+ 5377us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:45.731507 (+2096003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.731602 (+ 95us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.905437 (+173835us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":219158,"mutex_wait_us":2604122,"thread_start_us":120808,"threads_started":1}
W20260619 18:45:46.120702 12684 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.868585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38348 (local address 127.6.120.193:37901)
0619 18:45:43.247876 (+379291us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.252567 (+ 4691us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.254005 (+ 1438us) server_negotiation.cc:407] Connection header received
0619 18:45:43.287379 (+ 33374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.294472 (+ 7093us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.338132 (+ 43660us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.346579 (+ 8447us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:44.528804 (+1182225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.513360 (+984556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.931719 (+418359us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:38348: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1442744,"server-negotiator.queue_time_us":244719,"thread_start_us":163306,"threads_started":1}
W20260619 18:45:46.121472 12463 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.470483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50510)
0619 18:45:42.510412 (+ 39929us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.513105 (+ 2693us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.519860 (+ 6755us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.375133 (+855273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.375180 (+ 47us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.375353 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.553693 (+1178340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.553756 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.404296 (+850540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.404360 (+ 64us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:45.838010 (+433650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.838067 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.955510 (+117443us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1779,"mutex_wait_us":1509540}
W20260619 18:45:46.215961 12648 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:41.858383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50416 (local address 127.6.120.254:36501)
0619 18:45:42.177488 (+319105us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:42.179547 (+ 2059us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:42.185719 (+ 6172us) server_negotiation.cc:407] Connection header received
0619 18:45:42.192068 (+ 6349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:42.193252 (+ 1184us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:42.203006 (+ 9754us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:42.207844 (+ 4838us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:42.934169 (+726325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:43.617461 (+683292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.937705 (+2320244us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50416: BlockingRecv error: recv got EOF from 127.0.0.1:50416 (error 108)
Metrics: {"mutex_wait_us":734410,"server-negotiator.queue_time_us":249939,"spinlock_wait_cycles":1137920}
W20260619 18:45:46.259774 12530 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.390680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50492)
0619 18:45:42.429028 (+ 38348us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.429084 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.429332 (+ 248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.370866 (+941534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.370914 (+ 48us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.371078 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.273224 (+902146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.273308 (+ 84us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:44.962263 (+688955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:44.962351 (+ 88us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:45.919275 (+956924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.920625 (+ 1350us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.251371 (+330746us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":96,"mutex_wait_us":1830012}
W20260619 18:45:46.224799 12610 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 211314us
W20260619 18:45:46.290278 12566 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.026957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50618)
0619 18:45:43.097299 (+ 70342us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.099171 (+ 1872us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.117306 (+ 18135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.726294 (+1608988us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.726346 (+ 52us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.726498 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.585045 (+858547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.585096 (+ 51us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.255856 (+670760us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":372,"mutex_wait_us":883138}
W20260619 18:45:46.291999 12551 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.945403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50578 (local address 127.6.120.254:36501)
0619 18:45:43.966339 (+1020936us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.966373 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.969009 (+ 2636us) server_negotiation.cc:407] Connection header received
0619 18:45:43.974306 (+ 5297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.975868 (+ 1562us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.998150 (+ 22282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.003410 (+ 5260us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.165603 (+162193us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.446078 (+280475us) spinlock_profiling.cc:243] Waited 6.86 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.530934 (+ 84856us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1ec6c 00007f1383e1ebd6 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.583539 (+ 52605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.493191 (+909652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.271218 (+778027us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50578: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1273557,"server-negotiator.queue_time_us":974993,"spinlock_wait_cycles":46922368}
W20260619 18:45:46.311546 12673 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.451894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50494)
0619 18:45:42.494581 (+ 42687us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.496453 (+ 1872us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.514035 (+ 17582us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.373169 (+859134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.373218 (+ 49us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.373385 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.046801 (+673416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.051489 (+ 4688us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.278394 (+1226905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.278449 (+ 55us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:45.882326 (+603877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.882382 (+ 56us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.224838 (+342456us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":26684,"mutex_wait_us":1295684,"thread_start_us":18735,"threads_started":1}
W20260619 18:45:46.315299 12455 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.254154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50698)
0619 18:45:43.348925 (+ 94771us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.350116 (+ 1191us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.359584 (+ 9468us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.493165 (+1133581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.495105 (+ 1940us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.527821 (+ 32716us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.600166 (+1072345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.600241 (+ 75us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.287903 (+687662us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":16673,"mutex_wait_us":695598}
W20260619 18:45:46.319918 12450 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.176247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50658)
0619 18:45:43.293331 (+117084us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.298113 (+ 4782us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.312658 (+ 14545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.544921 (+1232263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.546276 (+ 1355us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.560701 (+ 14425us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.645032 (+1084331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.645141 (+ 109us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.318141 (+673000us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":2033,"mutex_wait_us":1148918}
W20260619 18:45:46.332752 12634 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.163204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50640 (local address 127.6.120.254:36501)
0619 18:45:44.156082 (+992878us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.156145 (+ 63us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.156231 (+ 86us) server_negotiation.cc:407] Connection header received
0619 18:45:44.156408 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.156444 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.156744 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.156965 (+ 221us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.444880 (+287915us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.585391 (+140511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.699284 (+1113893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.331199 (+631915us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50640: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1377110,"server-negotiator.queue_time_us":990158,"spinlock_wait_cycles":38680832}
W20260619 18:45:46.343993 12589 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.071993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50626 (local address 127.6.120.254:36501)
0619 18:45:44.186716 (+1114723us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.190313 (+ 3597us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.193520 (+ 3207us) server_negotiation.cc:407] Connection header received
0619 18:45:44.202463 (+ 8943us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.204243 (+ 1780us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.233431 (+ 29188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.268441 (+ 35010us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.492152 (+1223711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.863211 (+371059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.308421 (+445210us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50626: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":717716,"server-negotiator.queue_time_us":1033658}
W20260619 18:45:46.349197 12691 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.994926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50598)
0619 18:45:43.043468 (+ 48542us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.043553 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.043944 (+ 391us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.468047 (+1424103us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.470186 (+ 2139us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.489719 (+ 19533us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.602655 (+112936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.602747 (+ 92us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.204531 (+601784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.204597 (+ 66us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:45.840090 (+635493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.840168 (+ 78us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.291682 (+451514us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":47778,"mutex_wait_us":803917,"thread_start_us":51256,"threads_started":1}
W20260619 18:45:46.359392 12014 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.031455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50604 (local address 127.6.120.254:36501)
0619 18:45:44.119951 (+1088496us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.127492 (+ 7541us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.128946 (+ 1454us) server_negotiation.cc:407] Connection header received
0619 18:45:44.140637 (+ 11691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.140678 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.424696 (+284018us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.433631 (+ 8935us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.443632 (+ 10001us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.726930 (+283298us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:45.378629 (+651699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.931201 (+552572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.307426 (+376225us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50604: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1164178,"server-negotiator.queue_time_us":1062119,"spinlock_wait_cycles":83290752}
W20260619 18:45:46.361557 12464 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.168095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50650)
0619 18:45:43.182071 (+ 13976us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.184364 (+ 2293us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.187042 (+ 2678us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.260924 (+1073882us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.273708 (+ 12784us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.273874 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.226775 (+952901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.232922 (+ 6147us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.312901 (+1079979us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":96,"mutex_wait_us":924199}
W20260619 18:45:46.363989 12699 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.164377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38354 (local address 127.6.120.193:37901)
0619 18:45:43.380679 (+216302us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.380721 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.587795 (+207074us) server_negotiation.cc:407] Connection header received
0619 18:45:43.588502 (+ 707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.588551 (+ 49us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.589047 (+ 496us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.589309 (+ 262us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:44.436268 (+846959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.306851 (+870583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.296991 (+990140us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:38354: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1695330,"server-negotiator.queue_time_us":215677,"thread_start_us":311766,"threads_started":1}
W20260619 18:45:46.399684 12653 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.968346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50588 (local address 127.6.120.254:36501)
0619 18:45:44.117083 (+1148737us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.117120 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.117191 (+ 71us) server_negotiation.cc:407] Connection header received
0619 18:45:44.117338 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.117375 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.119747 (+ 2372us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.122289 (+ 2542us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.413016 (+290727us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.593086 (+180070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.780261 (+1187175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.351192 (+570931us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50588: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1707482,"server-negotiator.queue_time_us":1081359,"spinlock_wait_cycles":4695936}
W20260619 18:45:46.420980 12466 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.170104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50674 (local address 127.6.120.254:36501)
0619 18:45:44.162635 (+992531us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.162672 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.162755 (+ 83us) server_negotiation.cc:407] Connection header received
0619 18:45:44.162916 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.162952 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.163244 (+ 292us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.166235 (+ 2991us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.216333 (+1050098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.852674 (+636341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.413793 (+561119us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50674: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1193837,"server-negotiator.queue_time_us":991490}
W20260619 18:45:46.427134 12632 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.253591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50698 (local address 127.6.120.254:36501)
0619 18:45:44.395969 (+1142378us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.397350 (+ 1381us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.398517 (+ 1167us) server_negotiation.cc:407] Connection header received
0619 18:45:44.402549 (+ 4032us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.404055 (+ 1506us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.460868 (+ 56813us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.476368 (+ 15500us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.490579 (+ 14211us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.558931 (+ 68352us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:45.601738 (+1042807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.306316 (+704578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.414544 (+108228us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50698: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1535929,"server-negotiator.queue_time_us":1101744,"spinlock_wait_cycles":14780928}
W20260619 18:45:46.459980 12612 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.958705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50582 (local address 127.6.120.254:36501)
0619 18:45:43.975716 (+1017011us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.978164 (+ 2448us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.981739 (+ 3575us) server_negotiation.cc:407] Connection header received
0619 18:45:43.991600 (+ 9861us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.997544 (+ 5944us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.008867 (+ 11323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.015108 (+ 6241us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.434918 (+419810us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.540206 (+105288us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.604447 (+ 64241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.623152 (+1018705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.427040 (+803888us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50582: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1458776,"server-negotiator.queue_time_us":994929,"spinlock_wait_cycles":13472384}
W20260619 18:45:46.463464 12603 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.991884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50598 (local address 127.6.120.254:36501)
0619 18:45:44.166739 (+1174855us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.168862 (+ 2123us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.170586 (+ 1724us) server_negotiation.cc:407] Connection header received
0619 18:45:44.186308 (+ 15722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.190078 (+ 3770us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.430473 (+240395us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.438617 (+ 8144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.458748 (+ 20131us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.545506 (+ 86758us) spinlock_profiling.cc:243] Waited 8.8 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.552966 (+ 7460us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.583650 (+ 30684us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.604934 (+ 21284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.202590 (+597656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.841289 (+638699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.305373 (+464084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.390935 (+ 85562us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50598: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1077213,"server-negotiator.queue_time_us":1097971,"spinlock_wait_cycles":85231488}
W20260619 18:45:46.463714 12624 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.188952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50688 (local address 127.6.120.254:36501)
0619 18:45:44.195207 (+1006255us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.195250 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.195319 (+ 69us) server_negotiation.cc:407] Connection header received
0619 18:45:44.195482 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.195518 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.195810 (+ 292us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.196063 (+ 253us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.720797 (+524734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.677262 (+956465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.368462 (+691200us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50688: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1305881,"server-negotiator.queue_time_us":1005720}
W20260619 18:45:46.484324 12081 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.434571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50738 (local address 127.6.120.254:36501)
0619 18:45:44.496804 (+1062233us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.516880 (+ 20076us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.719501 (+202621us) server_negotiation.cc:407] Connection header received
0619 18:45:44.719810 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.719860 (+ 50us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.720511 (+ 651us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.720778 (+ 267us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.772533 (+1051755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.297333 (+524800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.465143 (+167810us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50738: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1080903,"server-negotiator.queue_time_us":997004}
W20260619 18:45:46.501252 12620 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.360285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50724 (local address 127.6.120.254:36501)
0619 18:45:44.422353 (+1062068us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.422394 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.422457 (+ 63us) server_negotiation.cc:407] Connection header received
0619 18:45:44.422607 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.422644 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.422984 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.423231 (+ 247us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.312479 (+889248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.907546 (+595067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.441881 (+534335us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50724: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":687376,"server-negotiator.queue_time_us":1061510}
W20260619 18:45:46.511837 12614 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.267181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50704 (local address 127.6.120.254:36501)
0619 18:45:44.404126 (+1136945us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.409625 (+ 5499us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.412217 (+ 2592us) server_negotiation.cc:407] Connection header received
0619 18:45:44.425182 (+ 12965us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.427193 (+ 2011us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.546523 (+119330us) spinlock_profiling.cc:243] Waited 5.36 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.554221 (+ 7698us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.564969 (+ 10748us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.579212 (+ 14243us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:45.520972 (+941760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.954393 (+433421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.506458 (+552065us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50704: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1303320,"server-negotiator.queue_time_us":1097909,"spinlock_wait_cycles":14723840}
W20260619 18:45:46.512579 11110 tablet_mm_ops.cc:140] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:1f02be074be240fa8534ef577aa46f77)
W20260619 18:45:46.522293 12558 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.880239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50546 (local address 127.6.120.254:36501)
0619 18:45:43.961256 (+1081017us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.963325 (+ 2069us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.964670 (+ 1345us) server_negotiation.cc:407] Connection header received
0619 18:45:43.967967 (+ 3297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.969130 (+ 1163us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.986620 (+ 17490us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.998643 (+ 12023us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.413361 (+1414718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.263247 (+849886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.463497 (+200250us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50546: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1122563,"server-negotiator.queue_time_us":1023754}
W20260619 18:45:46.522997 12491 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.332547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50712 (local address 127.6.120.254:36501)
0619 18:45:44.434511 (+1101964us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.435781 (+ 1270us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.438804 (+ 3023us) server_negotiation.cc:407] Connection header received
0619 18:45:44.454535 (+ 15731us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.458860 (+ 4325us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.486039 (+ 27179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.495377 (+ 9338us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.567058 (+ 71681us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:45.564739 (+997681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.941648 (+376909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.516604 (+574956us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50712: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1187129,"server-negotiator.queue_time_us":1085427,"spinlock_wait_cycles":6082304}
W20260619 18:45:46.649713 12554 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.552348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50760)
0619 18:45:43.610803 (+ 58455us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.611603 (+ 800us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.615395 (+ 3792us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.586410 (+971015us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.586450 (+ 40us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.586585 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.587231 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.587296 (+ 65us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.647695 (+2060399us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.6.120.254:36501: BlockingRecv error: recv got EOF from 127.6.120.254:36501 (error 108)
Metrics: {"client-negotiator.queue_time_us":2217,"mutex_wait_us":92750}
W20260619 18:45:46.651787 12685 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.870226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:38348)
0619 18:45:43.184349 (+314123us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.190539 (+ 6190us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.257092 (+ 66553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.348980 (+ 91888us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.350052 (+ 1072us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.354612 (+ 4560us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:44.524879 (+1170267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.524961 (+ 82us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.523072 (+998111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.527334 (+ 4262us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.380638 (+853304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.380693 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.444715 (+ 64022us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":213728,"mutex_wait_us":1685994,"thread_start_us":157481,"threads_started":1}
W20260619 18:45:46.660902 12613 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.541972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50760 (local address 127.6.120.254:36501)
0619 18:45:44.553830 (+1011858us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.553873 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.553940 (+ 67us) server_negotiation.cc:407] Connection header received
0619 18:45:44.559419 (+ 5479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.560610 (+ 1191us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.585553 (+ 24943us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.585816 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.586043 (+ 227us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.550010 (+963967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.506543 (+956533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.549460 (+ 42917us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50760: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1812072,"server-negotiator.queue_time_us":995899,"spinlock_wait_cycles":2451840}
W20260619 18:45:46.662024 12703 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.352352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38368 (local address 127.6.120.193:37901)
0619 18:45:43.614026 (+261674us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.614067 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.616213 (+ 2146us) server_negotiation.cc:407] Connection header received
0619 18:45:43.617079 (+ 866us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:43.617121 (+ 42us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:43.617542 (+ 421us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:43.617760 (+ 218us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:44.583562 (+965802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.679310 (+1095748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.451922 (+772612us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:38368: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1678981,"server-negotiator.queue_time_us":221401,"thread_start_us":16621,"threads_started":1}
W20260619 18:45:46.661722 12459 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.962333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50582)
0619 18:45:43.000933 (+ 38600us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.003555 (+ 2622us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.032517 (+ 28962us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.016852 (+984335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.018769 (+ 1917us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.029836 (+ 11067us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.491311 (+461475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.493023 (+ 1712us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.642931 (+1149908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.642988 (+ 57us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.389258 (+746270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.389314 (+ 56us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.443879 (+ 54565us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1193,"mutex_wait_us":1018804}
I20260619 18:45:46.672370 12166 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:46.674300 12166 scanner-internal.cc:458] Time spent opening tablet: real 4.182s user 0.027s sys 0.011s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:46.676891 12518 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.055346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50604)
0619 18:45:43.148341 (+ 92995us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.150242 (+ 1901us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.165617 (+ 15375us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.454088 (+1288471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.458495 (+ 4407us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.482310 (+ 23815us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.377756 (+895446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.377839 (+ 83us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.932883 (+555044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.932925 (+ 42us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.660911 (+727986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.660974 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.675327 (+ 14353us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1525,"mutex_wait_us":1550629}
W20260619 18:45:46.688712 12535 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.169052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50650 (local address 127.6.120.254:36501)
0619 18:45:44.178984 (+1009932us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.179024 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.179071 (+ 47us) server_negotiation.cc:407] Connection header received
0619 18:45:44.184020 (+ 4949us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.187112 (+ 3092us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.229378 (+ 42266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.265904 (+ 36526us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.425404 (+159500us) spinlock_profiling.cc:243] Waited 40.1 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.517145 (+ 91741us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:44.538348 (+ 21203us) spinlock_profiling.cc:243] Waited 6.66 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f13888caca0 00007f138897f49c 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:45.411916 (+873568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.285453 (+873537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.444802 (+159349us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50650: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1765184,"server-negotiator.queue_time_us":1006315,"spinlock_wait_cycles":114259712}
W20260619 18:45:46.689041 12636 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.559760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50764 (local address 127.6.120.254:36501)
0619 18:45:44.553554 (+993794us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.553589 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.553631 (+ 42us) server_negotiation.cc:407] Connection header received
0619 18:45:44.553756 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.553782 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.554041 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.559645 (+ 5604us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.580684 (+ 21039us) spinlock_profiling.cc:243] Waited 5.3 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:45.318816 (+738132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.904184 (+585368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.641176 (+736992us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50764: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1282849,"server-negotiator.queue_time_us":993412,"spinlock_wait_cycles":12196736}
W20260619 18:45:46.710337 12410 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.097515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50636)
0619 18:45:43.175827 (+ 78312us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.178233 (+ 2406us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.188164 (+ 9931us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.662980 (+1474816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.663064 (+ 84us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.663332 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.584783 (+921451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.584844 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.693758 (+108914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.693807 (+ 49us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:45.862754 (+168947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.862850 (+ 96us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.485528 (+622678us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1018,"mutex_wait_us":1367178}
W20260619 18:45:46.760380 12516 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.365874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50730 (local address 127.6.120.254:36501)
0619 18:45:44.431219 (+1065345us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.431261 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.431327 (+ 66us) server_negotiation.cc:407] Connection header received
0619 18:45:44.435819 (+ 4492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.437562 (+ 1743us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.549423 (+111861us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.560400 (+ 10977us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.561768 (+ 1368us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.730376 (+168608us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:45.496792 (+766416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.963771 (+466979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.496326 (+532555us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50730: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1285761,"server-negotiator.queue_time_us":1063454,"spinlock_wait_cycles":5021952}
W20260619 18:45:46.761821 12696 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.352627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38362 (local address 127.6.120.193:37901)
0619 18:45:43.613700 (+261073us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:43.613745 (+ 45us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:43.990883 (+377138us) server_negotiation.cc:407] Connection header received
0619 18:45:44.013350 (+ 22467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.015841 (+ 2491us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.035446 (+ 19605us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.041406 (+ 5960us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:44.597371 (+555965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.650111 (+1052740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.479466 (+829355us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:38362: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1435261,"server-negotiator.queue_time_us":217102,"thread_start_us":199424,"threads_started":1}
W20260619 18:45:46.762212 12572 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.973688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50588)
0619 18:45:43.032449 (+ 58761us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.034449 (+ 2000us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.051651 (+ 17202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.122524 (+1070873us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.122561 (+ 37us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.122680 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.553316 (+430636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.553375 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.794218 (+1240843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.794277 (+ 59us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.659802 (+865525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.659889 (+ 87us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.760608 (+100719us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1604,"mutex_wait_us":1207098}
W20260619 18:45:46.776618 12700 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.364193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:38368)
0619 18:45:43.614484 (+250291us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.614548 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.614951 (+ 403us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.630068 (+ 15117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.635436 (+ 5368us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.637287 (+ 1851us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:44.578097 (+940810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.578907 (+ 810us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.691875 (+1112968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.691976 (+ 101us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.641102 (+949126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.641161 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.679041 (+ 37880us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":213306,"mutex_wait_us":1686992,"thread_start_us":158351,"threads_started":1}
W20260619 18:45:46.783483 12497 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.080353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50618 (local address 127.6.120.254:36501)
0619 18:45:44.145158 (+1064805us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.145202 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.145280 (+ 78us) server_negotiation.cc:407] Connection header received
0619 18:45:44.145468 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.145504 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.429488 (+283984us) spinlock_profiling.cc:243] Waited 8.32 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.544427 (+114939us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.567327 (+ 22900us) spinlock_profiling.cc:243] Waited 890 us on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f13888caca0 00007f138897f49c 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.725592 (+158265us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1ec6c 00007f1383e1ebd6 0000000000620c99 00007f13888caca0 00007f138897f49c 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.725855 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.726129 (+ 274us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.592726 (+866597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.458516 (+865790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.537179 (+ 78663us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50618: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1496244,"server-negotiator.queue_time_us":1030732,"spinlock_wait_cycles":56327936}
W20260619 18:45:46.788373 12492 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.188182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50688)
0619 18:45:43.306260 (+118078us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.308098 (+ 1838us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.325404 (+ 17306us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.196248 (+870844us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.196297 (+ 49us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.200774 (+ 4477us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.720180 (+519406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.720277 (+ 97us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.677605 (+957328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.677639 (+ 34us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.535294 (+857655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.537640 (+ 2346us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.715844 (+178204us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1128,"mutex_wait_us":1356085}
I20260619 18:45:46.788672 12124 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:46.822575 12556 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.630851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50768 (local address 127.6.120.254:36501)
0619 18:45:44.556219 (+925368us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.556255 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.556323 (+ 68us) server_negotiation.cc:407] Connection header received
0619 18:45:44.556484 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.556519 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.556838 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.557119 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.312795 (+755676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.751523 (+438728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.703607 (+952084us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50768: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1139799,"server-negotiator.queue_time_us":924787}
W20260619 18:45:46.825966 12182 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.448759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50750 (local address 127.6.120.254:36501)
0619 18:45:44.474315 (+1025556us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.474358 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.474428 (+ 70us) server_negotiation.cc:407] Connection header received
0619 18:45:44.474604 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.474641 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.652033 (+177392us) spinlock_profiling.cc:243] Waited 8.01 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.652610 (+ 577us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.652961 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.599622 (+946661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.270899 (+671277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.688214 (+417315us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50750: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1490150,"server-negotiator.queue_time_us":1025012,"spinlock_wait_cycles":18426624}
W20260619 18:45:46.828635 12462 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.447064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50750)
0619 18:45:43.550879 (+103815us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.552445 (+ 1566us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.565469 (+ 13024us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.730060 (+1164591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.730109 (+ 49us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.730240 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.586977 (+856737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.590838 (+ 3861us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.274038 (+683200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.274092 (+ 54us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.761305 (+487213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.761365 (+ 60us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.826880 (+ 65515us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":563,"mutex_wait_us":1258367}
W20260619 18:45:46.821650 12124 scanner-internal.cc:458] Time spent opening tablet: real 4.197s user 0.016s sys 0.016s
W20260619 18:45:46.832617 12711 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.609298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38384 (local address 127.6.120.193:37901)
0619 18:45:44.008505 (+399207us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.009825 (+ 1320us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.011013 (+ 1188us) server_negotiation.cc:407] Connection header received
0619 18:45:44.020256 (+ 9243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.023413 (+ 3157us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.383011 (+359598us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b4800081e18. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f138cd02aa0 00007f138cceb061 00007f1388974dbb 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.398361 (+ 15350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.403949 (+ 5588us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:44.596417 (+192468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.635464 (+1039047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.735705 (+1100241us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:38384: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1123937,"server-negotiator.queue_time_us":347954,"spinlock_wait_cycles":3221888,"thread_start_us":316674,"threads_started":1}
W20260619 18:45:46.836130 12710 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.609317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:38384)
0619 18:45:43.993326 (+384009us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.996261 (+ 2935us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:44.009587 (+ 13326us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.407655 (+398068us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.407704 (+ 49us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.407764 (+ 60us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:44.595723 (+187959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.595813 (+ 90us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.645347 (+1049534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.645403 (+ 56us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.791857 (+1146454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.791922 (+ 65us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.831765 (+ 39843us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":317654,"mutex_wait_us":931478,"thread_start_us":225095,"threads_started":1}
W20260619 18:45:46.842442 12584 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:42.924869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50578)
0619 18:45:42.925693 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:42.925751 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:42.932737 (+ 6986us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.007454 (+1074717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.009455 (+ 2001us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.021200 (+ 11745us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.573709 (+552509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.573789 (+ 80us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.494465 (+920676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.494547 (+ 82us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.656083 (+1161536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.657207 (+ 1124us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.756723 (+ 99516us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":380,"mutex_wait_us":1548353}
W20260619 18:45:46.842765 12645 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.164551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50658 (local address 127.6.120.254:36501)
0619 18:45:44.150657 (+986106us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.150699 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.150766 (+ 67us) server_negotiation.cc:407] Connection header received
0619 18:45:44.150937 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.150974 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.433649 (+282675us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.532038 (+ 98389us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.533612 (+ 1574us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.539576 (+ 5964us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.646096 (+1106520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.683911 (+1037815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.767687 (+ 83776us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50658: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1840033,"server-negotiator.queue_time_us":985536,"spinlock_wait_cycles":15123072}
W20260619 18:45:46.844254 12537 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.181257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50674)
0619 18:45:43.188568 (+ 7311us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.188618 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.188851 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.169675 (+980824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.172500 (+ 2825us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.172692 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.203323 (+1030631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.203427 (+ 104us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.853184 (+649757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.853236 (+ 52us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.725176 (+871940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.725248 (+ 72us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.793955 (+ 68707us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":4864,"mutex_wait_us":1726152}
W20260619 18:45:46.858043 12531 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.070199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50626)
0619 18:45:43.071500 (+ 1301us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.071565 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.071874 (+ 309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.273340 (+1201466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.273399 (+ 59us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.273562 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.491000 (+1217438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.491112 (+ 112us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.864929 (+373817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.864980 (+ 51us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.815672 (+950692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.816781 (+ 1109us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.836748 (+ 19967us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":613,"mutex_wait_us":2068801}
W20260619 18:45:46.865268 12619 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.096354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50636 (local address 127.6.120.254:36501)
0619 18:45:44.136868 (+1040514us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.136926 (+ 58us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.136994 (+ 68us) server_negotiation.cc:407] Connection header received
0619 18:45:44.137157 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.137193 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.434999 (+297806us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.446358 (+ 11359us) spinlock_profiling.cc:243] Waited 6.39 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.546679 (+100321us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f13888caca0 00007f138897f49c 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:44.552069 (+ 5390us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.562431 (+ 10362us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.596612 (+1034181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.691924 (+ 95312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.868545 (+176621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.769942 (+901397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.819793 (+ 49851us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50636: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1824516,"server-negotiator.queue_time_us":1038878,"spinlock_wait_cycles":79796864}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:46.863466 12706 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.365369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:38362)
0619 18:45:43.978863 (+613494us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.983216 (+ 4353us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:44.004045 (+ 20829us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.042369 (+ 38324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.047321 (+ 4952us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.052907 (+ 5586us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:44.597049 (+544142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.597109 (+ 60us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.659423 (+1062314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.659479 (+ 56us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.760584 (+1101105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.760654 (+ 70us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.839725 (+ 79071us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":564099,"mutex_wait_us":1486781,"thread_start_us":363534,"threads_started":1}
W20260619 18:45:46.874188 12698 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.299993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:38354)
0619 18:45:43.587536 (+287543us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.587611 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.588068 (+ 457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:43.600955 (+ 12887us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:43.606836 (+ 5881us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:43.611009 (+ 4173us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:44.418620 (+807611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.418829 (+ 209us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.344009 (+925180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.360264 (+ 16255us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.737308 (+1377044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.738061 (+ 753us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.848315 (+110254us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":282303,"mutex_wait_us":2004768,"thread_start_us":241632,"threads_started":1}
W20260619 18:45:46.874972 12590 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.617977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50768)
0619 18:45:43.950571 (+332594us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.956756 (+ 6185us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.965586 (+ 8830us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.557201 (+591615us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.557236 (+ 35us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.557376 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.584358 (+ 26982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.584418 (+ 60us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.751945 (+1167527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.752016 (+ 71us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.817482 (+1065466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.817561 (+ 79us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.864238 (+ 46677us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":67155,"mutex_wait_us":991849}
I20260619 18:45:46.875653 12118 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
I20260619 18:45:46.861233 12150 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:46.876426 12118 scanner-internal.cc:458] Time spent opening tablet: real 4.006s user 0.012s sys 0.008s
I20260619 18:45:46.876660 12171 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:46.877012 12150 scanner-internal.cc:458] Time spent opening tablet: real 3.420s user 0.003s sys 0.002s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:46.886497 12437 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.330603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50712)
0619 18:45:43.331813 (+ 1210us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.331897 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.332159 (+ 262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.497128 (+1164969us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.521258 (+ 24130us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.530407 (+ 9149us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.545995 (+1015588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.550101 (+ 4106us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.950917 (+400816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.950969 (+ 52us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.839948 (+888979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.840927 (+ 979us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.875310 (+ 34383us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":595,"mutex_wait_us":1711554}
W20260619 18:45:46.877346 12171 scanner-internal.cc:458] Time spent opening tablet: real 4.240s user 0.033s sys 0.078s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:46.893560 12185 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.365010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50730)
0619 18:45:43.380281 (+ 15271us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.380337 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.380572 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.650575 (+1270003us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.650672 (+ 97us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.651006 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.038487 (+387481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.038583 (+ 96us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.975845 (+937262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.976341 (+ 496us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.865354 (+889013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.865579 (+ 225us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.890002 (+ 24423us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":78,"mutex_wait_us":1141348}
W20260619 18:45:46.890491 12431 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.261460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50704)
0619 18:45:43.262161 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.262228 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.262585 (+ 357us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.664750 (+1402165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.664866 (+ 116us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.665169 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.505020 (+839851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.507238 (+ 2218us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.955247 (+448009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.955300 (+ 53us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.867849 (+912549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.869616 (+ 1767us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.885480 (+ 15864us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":101,"mutex_wait_us":1568492}
W20260619 18:45:46.896880 12596 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.834553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50770 (local address 127.6.120.254:36501)
0619 18:45:44.563000 (+728447us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.563030 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.563076 (+ 46us) server_negotiation.cc:407] Connection header received
0619 18:45:44.563196 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.563231 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.563474 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.565244 (+ 1770us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:44.594023 (+ 28779us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:45.594663 (+1000640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.545023 (+950360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.799725 (+254702us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50770: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1901273,"server-negotiator.queue_time_us":727025,"spinlock_wait_cycles":8436096}
W20260619 18:45:46.996385 12432 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.359479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50724)
0619 18:45:43.441334 (+ 81855us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.443240 (+ 1906us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.450909 (+ 7669us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.423318 (+972409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.423352 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.423470 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.276590 (+853120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.282439 (+ 5849us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.908509 (+626070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.908548 (+ 39us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.926424 (+1017876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.926525 (+ 101us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.929521 (+ 2996us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":92,"mutex_wait_us":1612288}
W20260619 18:45:46.999862 12582 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.559505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50764)
0619 18:45:43.610985 (+ 51480us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.612318 (+ 1333us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.630503 (+ 18185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.560002 (+929499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.560045 (+ 43us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.560231 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.598699 (+ 38468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.598994 (+ 295us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.930077 (+1331083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.934412 (+ 4335us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.948771 (+1014359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.948849 (+ 78us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.975819 (+ 26970us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":2050,"mutex_wait_us":854469}
W20260619 18:45:47.008462 12547 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.440750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50738)
0619 18:45:43.448478 (+ 7728us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.448563 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.448872 (+ 309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.725137 (+1276265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.725202 (+ 65us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.725436 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.762092 (+1036656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.764931 (+ 2839us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.305337 (+540406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.307209 (+ 1872us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.003826 (+696617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.005668 (+ 1842us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.007011 (+ 1343us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":2303,"mutex_wait_us":1548420}
W20260619 18:45:47.009851 12501 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.116090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50640)
0619 18:45:43.187765 (+ 71675us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.189083 (+ 1318us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.239558 (+ 50475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.157048 (+917490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.157079 (+ 31us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.157219 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:44.157717 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:44.157788 (+ 71us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:45.733313 (+1575525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:45.738204 (+ 4891us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.864710 (+1126506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.864767 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.883392 (+ 18625us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":3754,"mutex_wait_us":917266}
W20260619 18:45:47.006376 12546 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.969102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50784 (local address 127.6.120.254:36501)
0619 18:45:44.581594 (+612492us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:44.581636 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:44.581698 (+ 62us) server_negotiation.cc:407] Connection header received
0619 18:45:44.581876 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:44.581917 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:44.582222 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:44.582436 (+ 214us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.487018 (+904582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.063410 (+576392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.004203 (+940793us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50784: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1297632,"server-negotiator.queue_time_us":611962}
W20260619 18:45:47.039480 12604 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.997039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50786 (local address 127.6.120.254:36501)
0619 18:45:45.159227 (+1162188us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:45.159282 (+ 55us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:45.159358 (+ 76us) server_negotiation.cc:407] Connection header received
0619 18:45:45.159550 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:45.159602 (+ 52us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:45.159936 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:45.169445 (+ 9509us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.696557 (+527112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.593189 (+896632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.009602 (+416413us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50786: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1035333,"server-negotiator.queue_time_us":960429}
W20260619 18:45:47.074352 12652 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.093316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50816 (local address 127.6.120.254:36501)
0619 18:45:45.550929 (+1457613us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:45.556519 (+ 5590us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:45.560022 (+ 3503us) server_negotiation.cc:407] Connection header received
0619 18:45:45.566368 (+ 6346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:45.567196 (+ 828us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:45.593309 (+ 26113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:45.603888 (+ 10579us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:46.333756 (+729868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.770676 (+436920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.072873 (+302197us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50816: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":633493,"server-negotiator.queue_time_us":1412461}
W20260619 18:45:47.102450 12441 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.711055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50770)
0619 18:45:43.914510 (+203455us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.914600 (+ 90us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.914912 (+ 312us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.666647 (+751735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.666742 (+ 95us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.668213 (+ 1471us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.588597 (+920384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.592755 (+ 4158us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.546632 (+953877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.546685 (+ 53us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.099925 (+553240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.099997 (+ 72us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.100959 (+ 962us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":192584,"mutex_wait_us":1281483}
W20260619 18:45:47.109982 12507 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.041569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50796)
0619 18:45:44.116090 (+ 74521us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:44.118542 (+ 2452us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:44.147807 (+ 29265us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:45.453990 (+1306183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:45.486886 (+ 32896us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:45.512188 (+ 25302us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.904669 (+392481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.904736 (+ 67us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.650349 (+745613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.650399 (+ 50us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.002483 (+352084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.003110 (+ 627us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.106623 (+103513us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":2233,"mutex_wait_us":702212}
W20260619 18:45:47.106670 12091 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.128277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50826 (local address 127.6.120.254:36501)
0619 18:45:45.652414 (+1524137us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:45.657138 (+ 4724us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:45.661024 (+ 3886us) server_negotiation.cc:407] Connection header received
0619 18:45:45.667986 (+ 6962us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:45.668995 (+ 1009us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:45.692647 (+ 23652us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:45.700965 (+ 8318us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.794737 (+ 93772us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:45.847153 (+ 52416us) spinlock_profiling.cc:243] Waited 8.11 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:46.066287 (+219134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.825005 (+758718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.104868 (+279863us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50826: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":812984,"server-negotiator.queue_time_us":1438026,"spinlock_wait_cycles":22516736}
W20260619 18:45:47.139441 12444 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:43.981594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50784)
0619 18:45:43.989470 (+ 7876us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:43.989553 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:43.989923 (+ 370us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:44.666419 (+676496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:44.666491 (+ 72us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:44.666714 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.318865 (+652151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.318935 (+ 70us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.063927 (+744992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.063973 (+ 46us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.998575 (+934602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.002105 (+ 3530us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.051236 (+ 49131us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":6273,"mutex_wait_us":1469775}
W20260619 18:45:47.152827 12187 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.059493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50800 (local address 127.6.120.254:36501)
0619 18:45:45.501184 (+1441691us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:45.501243 (+ 59us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:45.501317 (+ 74us) server_negotiation.cc:407] Connection header received
0619 18:45:45.501487 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:45.501522 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:45.505581 (+ 4059us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:45.510291 (+ 4710us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.635131 (+124840us) spinlock_profiling.cc:243] Waited 6.7 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:45.806850 (+171719us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:46.374573 (+567723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.646947 (+272374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.132656 (+485709us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50800: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":569081,"server-negotiator.queue_time_us":1439116,"spinlock_wait_cycles":19287296}
W20260619 18:45:47.155076 12549 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.056244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50816)
0619 18:45:44.135088 (+ 78844us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:44.148783 (+ 13695us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:44.169194 (+ 20411us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:45.633535 (+1464341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:45.633590 (+ 55us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:45.633761 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:46.333233 (+699472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.333302 (+ 69us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.783743 (+450441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.785091 (+ 1348us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.085368 (+300277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.085463 (+ 95us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.153121 (+ 67658us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":4609,"mutex_wait_us":857301}
W20260619 18:45:47.158061 12485 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.146672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50882)
0619 18:45:44.220802 (+ 74130us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:44.227423 (+ 6621us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:44.271359 (+ 43936us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:45.714501 (+1443142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:45.730315 (+ 15814us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:45.743700 (+ 13385us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:46.330839 (+587139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.330925 (+ 86us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.710927 (+380002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.710961 (+ 34us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.041005 (+330044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.041064 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.155573 (+114509us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":2219,"mutex_wait_us":829908}
W20260619 18:45:47.171077 12719 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.106299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50800)
0619 18:45:45.146316 (+1040017us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:45.146415 (+ 99us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:45.146873 (+ 458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:45.511887 (+365014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:45.511922 (+ 35us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:45.512745 (+ 823us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:46.373812 (+861067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.373885 (+ 73us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.648719 (+274834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.648761 (+ 42us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.051681 (+402920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.051754 (+ 73us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.160315 (+108561us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1039226,"mutex_wait_us":1205953,"thread_start_us":1038883,"threads_started":1}
W20260619 18:45:47.173346 12573 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.001249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50786)
0619 18:45:44.039353 (+ 38104us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:44.040851 (+ 1498us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:44.052870 (+ 12019us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:45.185695 (+1132825us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:45.186673 (+ 978us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:45.186913 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:45.694039 (+507126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:45.694117 (+ 78us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.594857 (+900740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.594912 (+ 55us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.079159 (+484247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.079251 (+ 92us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.153037 (+ 73786us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":97,"mutex_wait_us":989732}
W20260619 18:45:47.174891 12592 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.122750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50850)
0619 18:45:44.123480 (+ 730us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:44.123526 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:44.123747 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:45.793574 (+1669827us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:45.793621 (+ 47us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:45.793762 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:46.289612 (+495850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.291341 (+ 1729us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.464579 (+173238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.465599 (+ 1020us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.039546 (+573947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.039606 (+ 60us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.158705 (+119099us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":303,"mutex_wait_us":1008042}
W20260619 18:45:47.210834 12595 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.126803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50834 (local address 127.6.120.254:36501)
0619 18:45:45.561632 (+1434829us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:45.566240 (+ 4608us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:45.567007 (+ 767us) server_negotiation.cc:407] Connection header received
0619 18:45:45.587216 (+ 20209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:45.590768 (+ 3552us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:45.629496 (+ 38728us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:45.634165 (+ 4669us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:46.394678 (+760513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.676537 (+281859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.183476 (+506939us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50834: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":674797,"server-negotiator.queue_time_us":1394434}
W20260619 18:45:47.240868 12570 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.197237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50886 (local address 127.6.120.254:36501)
0619 18:45:45.677362 (+1480125us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:45.677416 (+ 54us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:45.677470 (+ 54us) server_negotiation.cc:407] Connection header received
0619 18:45:45.677605 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:45.677636 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:45.687951 (+ 10315us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:45.696204 (+ 8253us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.807588 (+111384us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:46.281448 (+473860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.753646 (+472198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.219918 (+466272us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50886: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":575132,"server-negotiator.queue_time_us":1477255,"spinlock_wait_cycles":7104768}
W20260619 18:45:47.259284 12574 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.138906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50864)
0619 18:45:44.139864 (+ 958us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:44.139916 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:44.140208 (+ 292us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:45.732502 (+1592294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:45.732560 (+ 58us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:45.732723 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:46.381125 (+648402us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.381202 (+ 77us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.794315 (+413113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.794365 (+ 50us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.103476 (+309111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.103542 (+ 66us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.257393 (+153851us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":388,"mutex_wait_us":964798}
W20260619 18:45:47.267900 12058 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.164516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50850 (local address 127.6.120.254:36501)
0619 18:45:45.585023 (+1420507us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:45.585075 (+ 52us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:45.589057 (+ 3982us) server_negotiation.cc:407] Connection header received
0619 18:45:45.599076 (+ 10019us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:45.600952 (+ 1876us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:45.783709 (+182757us) spinlock_profiling.cc:243] Waited 9.53 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:45.784002 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:45.787153 (+ 3151us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.864632 (+ 77479us) spinlock_profiling.cc:243] Waited 9.97 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:46.295061 (+430429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.449779 (+154718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.039950 (+590171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.181642 (+141692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.211281 (+ 29639us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50850: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":334654,"server-negotiator.queue_time_us":1419792,"spinlock_wait_cycles":44832768}
W20260619 18:45:47.279821 12591 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.132157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50844 (local address 127.6.120.254:36501)
0619 18:45:45.582127 (+1449970us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:45.582211 (+ 84us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:45.582284 (+ 73us) server_negotiation.cc:407] Connection header received
0619 18:45:45.582445 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:45.582475 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:45.582801 (+ 326us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:45.583072 (+ 271us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.795815 (+212743us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:46.053229 (+257414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.546590 (+493361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.800171 (+253581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.113727 (+313556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.114070 (+ 343us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:47.236594 (+122524us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50844: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1033652,"server-negotiator.queue_time_us":1449497,"spinlock_wait_cycles":3501440}
W20260619 18:45:47.287576 12569 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.172310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50882 (local address 127.6.120.254:36501)
0619 18:45:45.675825 (+1503515us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:45.675913 (+ 88us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:45.675984 (+ 71us) server_negotiation.cc:407] Connection header received
0619 18:45:45.676170 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:45.676208 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:45.676527 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:45.676770 (+ 243us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.795274 (+118504us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:46.331347 (+536073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.710414 (+379067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.042350 (+331936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.285418 (+243068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.285944 (+ 526us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50882: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":617776,"server-negotiator.queue_time_us":1459154,"spinlock_wait_cycles":10568064}
W20260619 18:45:47.288610 12583 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.167192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50844)
0619 18:45:44.263012 (+ 95820us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:44.281299 (+ 18287us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:44.344012 (+ 62713us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:45.583811 (+1239799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:45.583865 (+ 54us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:45.584030 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:46.052079 (+468049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.052541 (+ 462us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.547051 (+494510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.547098 (+ 47us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:46.794495 (+247397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.794560 (+ 65us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.114726 (+320166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.114767 (+ 41us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.213389 (+ 98622us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:47.273612 (+ 60223us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:47.273638 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:47.273693 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:47.273818 (+ 125us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:47.274617 (+ 799us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1780,"mutex_wait_us":727092}
W20260619 18:45:47.307098 12563 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.168020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50864 (local address 127.6.120.254:36501)
0619 18:45:45.670233 (+1502213us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:45.680295 (+ 10062us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:45.681678 (+ 1383us) server_negotiation.cc:407] Connection header received
0619 18:45:45.687680 (+ 6002us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:45.689172 (+ 1492us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:45.706610 (+ 17438us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:45.714170 (+ 7560us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:46.381536 (+667366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.792948 (+411412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.103862 (+310914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.281882 (+178020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.285888 (+ 4006us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50864: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":720713,"server-negotiator.queue_time_us":1436111}
W20260619 18:45:47.397132 12231 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 90684.5us
W20260619 18:45:47.421157 12405 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.157232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50886)
0619 18:45:44.230725 (+ 73493us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:44.232435 (+ 1710us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:44.295004 (+ 62569us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:45.732842 (+1437838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:45.732935 (+ 93us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:45.735579 (+ 2644us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:46.274677 (+539098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.274748 (+ 71us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.763584 (+488836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.767366 (+ 3782us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.331829 (+564463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.331883 (+ 54us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.414168 (+ 82285us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1043,"mutex_wait_us":1075337}
W20260619 18:45:47.434465 12722 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.110281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50834)
0619 18:45:45.068671 (+958390us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:45.068748 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:45.069138 (+ 390us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:45.640832 (+571694us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:45.644004 (+ 3172us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:45.661107 (+ 17103us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:46.385883 (+724776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.387861 (+ 1978us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.678990 (+291129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.679033 (+ 43us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.342855 (+663822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.342927 (+ 72us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.432675 (+ 89748us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":957617,"mutex_wait_us":1224008,"thread_start_us":1039802,"threads_started":1}
W20260619 18:45:47.438236 12490 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.643215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50906 (local address 127.6.120.254:36501)
0619 18:45:45.796496 (+1153281us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:45.796533 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:45.796589 (+ 56us) server_negotiation.cc:407] Connection header received
0619 18:45:45.796741 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:45.796770 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:45.797045 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:45.797256 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:46.409841 (+612585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.863680 (+453839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.340205 (+476525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.400643 (+ 60438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.400967 (+ 324us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:47.436823 (+ 35856us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50906: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1034917,"server-negotiator.queue_time_us":1142584}
W20260619 18:45:47.460809 12194 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.095317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50826)
0619 18:45:44.183793 (+ 88476us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:44.186882 (+ 3089us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:44.200346 (+ 13464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:45.731094 (+1530748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:45.731157 (+ 63us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:45.731349 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:46.065834 (+334485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.065915 (+ 81us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.828600 (+762685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.828656 (+ 56us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.358491 (+529835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.358548 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.444045 (+ 85497us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":657,"mutex_wait_us":892580}
W20260619 18:45:47.471763 12144 scanner-internal.cc:458] Time spent opening tablet: real 2.183s user 0.019s sys 0.007s
W20260619 18:45:47.488920 12536 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.052476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50796 (local address 127.6.120.254:36501)
0619 18:45:45.341051 (+1288575us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:45.343007 (+ 1956us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:45.345477 (+ 2470us) server_negotiation.cc:407] Connection header received
0619 18:45:45.361740 (+ 16263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:45.362129 (+ 389us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:45.403370 (+ 41241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:45.408234 (+ 4864us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:45.906113 (+497879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.642920 (+736807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.004789 (+361869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.474292 (+469503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.487118 (+ 12826us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50796: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1173344,"server-negotiator.queue_time_us":1226986,"spinlock_wait_cycles":1381120}
W20260619 18:45:47.532991 12557 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.431660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50898 (local address 127.6.120.254:36501)
0619 18:45:45.800171 (+1368511us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:45.805150 (+ 4979us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:45.812248 (+ 7098us) server_negotiation.cc:407] Connection header received
0619 18:45:45.815346 (+ 3098us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:45.822529 (+ 7183us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:45.880191 (+ 57662us) spinlock_profiling.cc:243] Waited 965 us on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:45.880440 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:45.880635 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:46.423240 (+542605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.827899 (+404659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.386932 (+559033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.420662 (+ 33730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.420992 (+ 330us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:47.498301 (+ 77309us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50898: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1020481,"server-negotiator.queue_time_us":1329511,"spinlock_wait_cycles":2219264}
W20260619 18:45:47.584721 12238 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 125554us
W20260619 18:45:47.594269 12594 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 115517us
W20260619 18:45:47.627341 12406 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.434708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50906)
0619 18:45:44.438517 (+ 3809us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:44.443489 (+ 4972us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:44.470206 (+ 26717us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:45.797634 (+1327428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:45.797684 (+ 50us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:45.797817 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:46.315834 (+518017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.315923 (+ 89us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.864087 (+548164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.864148 (+ 61us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.332841 (+468693us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.337125 (+ 4284us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.400940 (+ 63815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.400983 (+ 43us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.485263 (+ 84280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:47.497659 (+ 12396us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:47.497687 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:47.497747 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:47.498817 (+ 1070us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:47.573594 (+ 74777us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":2112,"mutex_wait_us":1048404}
W20260619 18:45:47.654316 12357 scanner-internal.cc:458] Time spent opening tablet: real 3.220s user 0.019s sys 0.048s
W20260619 18:45:47.697587 12228 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 107057us
W20260619 18:45:47.705220 12200 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 314405us
W20260619 18:45:47.781010 12190 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 274622us
W20260619 18:45:47.826738 12598 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:44.436632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50898)
0619 18:45:44.527936 (+ 91304us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:44.529334 (+ 1398us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:44.544745 (+ 15411us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:45.881624 (+1336879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:45.881698 (+ 74us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:45.881863 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:46.422345 (+540482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.422442 (+ 97us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.829379 (+406937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.829416 (+ 37us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.386150 (+556734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.386228 (+ 78us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.420973 (+ 34745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.421012 (+ 39us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.571664 (+150652us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:47.639287 (+ 67623us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:47.639307 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:47.639347 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:47.639439 (+ 92us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:47.686825 (+ 47386us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":4678,"mutex_wait_us":1247260}
W20260619 18:45:47.881580 12593 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 152784us
W20260619 18:45:47.902292 12221 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 367063us
W20260619 18:45:48.015177 12227 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 138361us
W20260619 18:45:48.135829 12697 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 328982us
W20260619 18:45:48.310410 12147 scanner-internal.cc:458] Time spent opening tablet: real 2.673s user 0.002s sys 0.012s
W20260619 18:45:48.519037 12585 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:45.283722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50976 (local address 127.6.120.254:36501)
0619 18:45:45.883295 (+599573us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:45.885898 (+ 2603us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:45.887356 (+ 1458us) server_negotiation.cc:407] Connection header received
0619 18:45:45.900982 (+ 13626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:45.902008 (+ 1026us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:45.914578 (+ 12570us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:45.917767 (+ 3189us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:46.528988 (+611221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.992237 (+463249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.470754 (+478517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.774763 (+304009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.776292 (+ 1529us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:48.315437 (+539145us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:50976: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1200529,"server-negotiator.queue_time_us":560956}
W20260619 18:45:48.537846 12154 scanner-internal.cc:458] Time spent opening tablet: real 4.305s user 0.011s sys 0.026s
W20260619 18:45:48.573644 12718 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 473318us
W20260619 18:45:48.577736 12724 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 641292us
W20260619 18:45:48.602245 12599 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 535628us
W20260619 18:45:48.670178 12247 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 1.17188e+06us
W20260619 18:45:48.717533 12635 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 335382us
W20260619 18:45:48.720391 12631 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:45.277274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:50976)
0619 18:45:45.313228 (+ 35954us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:45.313292 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:45.313631 (+ 339us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:45.918887 (+605256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:45.920728 (+ 1841us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:45.929148 (+ 8420us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:46.520792 (+591644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.525036 (+ 4244us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:46.998061 (+473025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:46.998807 (+ 746us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.468591 (+469784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.468654 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.782631 (+313977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.784301 (+ 1670us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.322769 (+538468us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:48.609430 (+286661us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:48.610343 (+ 913us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:48.611163 (+ 820us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:48.612691 (+ 1528us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:48.648929 (+ 36238us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":5431,"mutex_wait_us":1774874}
W20260619 18:45:48.749094 12218 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 398453us
W20260619 18:45:48.781008 12702 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 888393us
W20260619 18:45:49.188252 12850 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.566s user 0.032s sys 0.062s
W20260619 18:45:49.504892 12708 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.648s user 0.003s sys 0.007s
W20260619 18:45:49.527156 12708 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.671s user 0.003s sys 0.007s
W20260619 18:45:49.357182 12576 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.588s user 0.006s sys 0.010s
W20260619 18:45:49.491061 12683 meta_cache.cc:1261] Time spent looking up entry by key: real 0.665s user 0.001s sys 0.000s
W20260619 18:45:49.511391 12850 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.889s user 0.032s sys 0.063s
W20260619 18:45:49.481669 12875 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.697s user 0.005s sys 0.022s
W20260619 18:45:49.496654 12605 meta_cache.cc:1261] Time spent looking up entry by key: real 0.119s user 0.008s sys 0.007s
W20260619 18:45:49.261973 12333 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.536s user 0.034s sys 0.043s
W20260619 18:45:49.509068 12869 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.556s user 0.000s sys 0.009s
W20260619 18:45:49.539656 12576 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.770s user 0.006s sys 0.015s
W20260619 18:45:49.544978 12875 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.761s user 0.006s sys 0.023s
W20260619 18:45:49.545920 12333 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.820s user 0.034s sys 0.044s
W20260619 18:45:49.547714 12869 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.595s user 0.001s sys 0.009s
W20260619 18:45:49.565629 12223 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 1.27516e+06us
W20260619 18:45:49.578553 12560 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.401135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51296 (local address 127.6.120.254:36501)
0619 18:45:47.219872 (+818737us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.219904 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.219950 (+ 46us) server_negotiation.cc:407] Connection header received
0619 18:45:47.220083 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.220133 (+ 50us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.235250 (+ 15117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.236325 (+ 1075us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.320430 (+ 84105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.481854 (+161424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.098061 (+616207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.670586 (+572525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.785684 (+115098us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:49.555741 (+770057us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51296: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":949610,"server-negotiator.queue_time_us":810734}
W20260619 18:45:49.590538 11039 thread.cc:636] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.678s user 0.003s sys 0.006s
W20260619 18:45:49.596302 11039 thread.cc:602] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.782s user 0.005s sys 0.006s
W20260619 18:45:49.615249 12636 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:45.834719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51180 (local address 127.6.120.254:36501)
0619 18:45:46.722368 (+887649us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:46.723307 (+ 939us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:46.724578 (+ 1271us) server_negotiation.cc:407] Connection header received
0619 18:45:46.724787 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:46.724828 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:46.725153 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:46.725346 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:46.820473 (+ 95127us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:46.932351 (+111878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.396128 (+463777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.805224 (+409096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.106229 (+301005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.570093 (+463864us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:49.613512 (+1043419us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51180: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1555146,"server-negotiator.queue_time_us":876080,"spinlock_wait_cycles":7715072}
W20260619 18:45:49.615706 12645 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.141428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51212 (local address 127.6.120.254:36501)
0619 18:45:46.843813 (+702385us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:46.843856 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:46.843908 (+ 52us) server_negotiation.cc:407] Connection header received
0619 18:45:46.844047 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:46.844096 (+ 49us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:46.844595 (+ 499us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:46.847581 (+ 2986us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.091315 (+243734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.405557 (+314242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.826145 (+420588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.924672 (+ 98527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.960455 (+ 35783us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:49.614219 (+1653764us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51212: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1011561,"server-negotiator.queue_time_us":701901}
W20260619 18:45:49.620970 12613 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:45.826225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51136 (local address 127.6.120.254:36501)
0619 18:45:46.702951 (+876726us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:46.702995 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:46.703082 (+ 87us) server_negotiation.cc:407] Connection header received
0619 18:45:46.703264 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:46.703306 (+ 42us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:46.703643 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:46.707474 (+ 3831us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.083563 (+376089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.389895 (+306332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.756301 (+366406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.827118 (+ 70817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.935635 (+108517us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:49.551350 (+1615715us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51136: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1361480,"server-negotiator.queue_time_us":854649}
W20260619 18:45:49.622046 12516 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:45.836628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51154 (local address 127.6.120.254:36501)
0619 18:45:46.761365 (+924737us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:46.761396 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:46.761469 (+ 73us) server_negotiation.cc:407] Connection header received
0619 18:45:46.761592 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:46.761633 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:46.761884 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:46.762145 (+ 261us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.013057 (+250912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.343406 (+330349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.831108 (+487702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.490145 (+659037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.703433 (+213288us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:49.620460 (+917027us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51154: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1917462,"server-negotiator.queue_time_us":924323}
W20260619 18:45:49.948500 12201 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 1.29712e+06us
I20260619 18:45:50.303673 10958 rpcz_store.cc:275] Call kudu.master.MasterService.ConnectToMaster from 127.0.0.1:51230 (request call id 0) took 1576 ms. Trace:
W20260619 18:45:50.517966 12816 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.279073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51612)
0619 18:45:47.389486 (+110413us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.389565 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.389861 (+ 296us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.510692 (+1120831us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.510725 (+ 33us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.510857 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:50.487994 (+1977137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:50.493072 (+ 5078us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:50.516691 (+ 23619us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":102426,"mutex_wait_us":1907160,"thread_start_us":82420,"threads_started":1}
W20260619 18:45:50.520295 12536 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.909355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51440 (local address 127.6.120.254:36501)
0619 18:45:47.502842 (+593487us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.502869 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.502941 (+ 72us) server_negotiation.cc:407] Connection header received
0619 18:45:47.504202 (+ 1261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.504231 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.504519 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.504714 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.673619 (+168905us) spinlock_profiling.cc:243] Waited 7.73 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:48.060657 (+387038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.707781 (+647124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.779497 (+ 71716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:49.914754 (+1135257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:50.518847 (+604093us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51440: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2726519,"server-negotiator.queue_time_us":580165,"spinlock_wait_cycles":17783552}
W20260619 18:45:50.204159 12623 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 1.14902e+06us
W20260619 18:45:50.523554 12620 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.186271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51572 (local address 127.6.120.254:36501)
0619 18:45:48.123069 (+936798us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.125911 (+ 2842us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.127261 (+ 1350us) server_negotiation.cc:407] Connection header received
0619 18:45:48.130389 (+ 3128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.131885 (+ 1496us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.148639 (+ 16754us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.159672 (+ 11033us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:48.382338 (+222666us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:50.513720 (+2131382us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51572: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":614039,"server-negotiator.queue_time_us":898534,"spinlock_wait_cycles":2342144}
W20260619 18:45:50.551887 12153 meta_cache.cc:1097] Time spent processing table locations response: real 0.876s user 0.016s sys 0.017s
W20260619 18:45:50.579762 12653 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.040604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51506 (local address 127.6.120.254:36501)
0619 18:45:47.773244 (+732640us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.773278 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.773328 (+ 50us) server_negotiation.cc:407] Connection header received
0619 18:45:47.773455 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.773481 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.773731 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.773901 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.850815 (+ 76914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.852967 (+ 2152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.098965 (+245998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.571991 (+473026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.784889 (+212898us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:50.576486 (+1791597us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51506: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1937968,"server-negotiator.queue_time_us":732201}
W20260619 18:45:50.572808 12563 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.783724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51370 (local address 127.6.120.254:36501)
0619 18:45:47.358401 (+574677us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.358434 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.358488 (+ 54us) server_negotiation.cc:407] Connection header received
0619 18:45:47.358614 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.358640 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.358904 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.362084 (+ 3180us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.455204 (+ 93120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.954867 (+499663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.717227 (+762360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.781464 (+ 64237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.781855 (+ 391us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:50.513788 (+1731933us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51370: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1253978,"server-negotiator.queue_time_us":534758}
W20260619 18:45:50.563283 12721 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 993143us
I20260619 18:45:50.524029 10958 rpcz_store.cc:276] 0619 18:45:48.727291 (+ 0us) service_pool.cc:170] Inserting onto call queue
0619 18:45:48.732742 (+ 5451us) service_pool.cc:227] Handling call
0619 18:45:48.746195 (+ 13453us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b54001c3090. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ed92 00007f138cd637c9 00007f138ccfbc36 00007f138ccccc28 00007f138cdc9e59 00007f138b0db534 00007f138b0db4c2 00007f138b0db3f1 00007f138b0db36c
0619 18:45:50.303555 (+1557360us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1545489,"spinlock_wait_cycles":3398400}
W20260619 18:45:50.669828 12725 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 1.96731e+06us
W20260619 18:45:50.948915 12462 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.867895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51392)
0619 18:45:46.878261 (+ 10366us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.878355 (+ 94us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.878776 (+ 421us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.418585 (+539809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.418631 (+ 46us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.418769 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.764242 (+345473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.764322 (+ 80us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.770763 (+ 6441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.770805 (+ 42us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.671198 (+900393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.671263 (+ 65us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:50.581757 (+1910494us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":4851,"mutex_wait_us":1881041}
W20260619 18:45:50.950801 12087 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.533554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51308 (local address 127.6.120.254:36501)
0619 18:45:47.243375 (+709821us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.243421 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.243489 (+ 68us) server_negotiation.cc:407] Connection header received
0619 18:45:47.243670 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.243713 (+ 43us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.247999 (+ 4286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.264079 (+ 16080us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.403613 (+139534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.731440 (+327827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.573657 (+842217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.574754 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:49.528338 (+953584us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:50.601166 (+1072828us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51308: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2470194,"server-negotiator.queue_time_us":703706,"spinlock_wait_cycles":1720704}
W20260619 18:45:50.951120 12595 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.395090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51278 (local address 127.6.120.254:36501)
0619 18:45:47.211748 (+816658us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.211782 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.211832 (+ 50us) server_negotiation.cc:407] Connection header received
0619 18:45:47.211959 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.211984 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.212266 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.212463 (+ 197us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.373914 (+161451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.887848 (+513934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.543580 (+655732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:49.911799 (+1368219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:50.635707 (+723908us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51278: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2521916,"server-negotiator.queue_time_us":816256}
W20260619 18:45:50.839536 12214 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 2.12467e+06us
W20260619 18:45:50.968221 12814 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.254461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51600)
0619 18:45:47.326631 (+ 72170us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.326716 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.327027 (+ 311us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.571106 (+1244079us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.571149 (+ 43us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.571286 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:48.572188 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.572252 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:50.966902 (+2394650us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":71543,"mutex_wait_us":658870,"thread_start_us":60839,"threads_started":1}
W20260619 18:45:50.969791 12437 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.893428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51414)
0619 18:45:46.919278 (+ 25850us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.920444 (+ 1166us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.928758 (+ 8314us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.455486 (+526728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.455520 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.455639 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.995766 (+540127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.002512 (+ 6746us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:49.549029 (+1546517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:49.550001 (+ 972us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:50.595502 (+1045501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:50.595589 (+ 87us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:50.633856 (+ 38267us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":915,"mutex_wait_us":1548485}
W20260619 18:45:50.971249 12455 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.332227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51252)
0619 18:45:46.333682 (+ 1455us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.333738 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.334008 (+ 270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.139952 (+805944us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.140479 (+ 527us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.156649 (+ 16170us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.246539 (+ 89890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.246597 (+ 58us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.715728 (+469131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.715777 (+ 49us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.370229 (+654452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.382568 (+ 12339us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:50.969420 (+2586852us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":942,"mutex_wait_us":2191759}
W20260619 18:45:51.023406 12081 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.951266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51464 (local address 127.6.120.254:36501)
0619 18:45:47.582730 (+631464us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.585462 (+ 2732us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.585517 (+ 55us) server_negotiation.cc:407] Connection header received
0619 18:45:47.585654 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.585683 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.585957 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.586162 (+ 205us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.955250 (+369088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.500768 (+545518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.945081 (+444313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:50.972705 (+2027624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:50.973278 (+ 573us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51464: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2745055,"server-negotiator.queue_time_us":597495}
W20260619 18:45:51.022223 12531 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.903715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51426)
0619 18:45:46.942001 (+ 38286us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.943192 (+ 1191us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.952669 (+ 9477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.498452 (+545783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.499273 (+ 821us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.500702 (+ 1429us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.781174 (+280472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.781245 (+ 71us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.181741 (+400496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.193986 (+ 12245us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.938965 (+744979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.939045 (+ 80us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:50.555289 (+1616244us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":293,"mutex_wait_us":1478703}
W20260619 18:45:51.022032 12614 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.187114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51566 (local address 127.6.120.254:36501)
0619 18:45:48.140436 (+953322us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.140479 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.140539 (+ 60us) server_negotiation.cc:407] Connection header received
0619 18:45:48.140701 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.140736 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.375254 (+234518us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:48.381886 (+ 6632us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.382196 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:50.972217 (+2590021us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51566: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1850616,"server-negotiator.queue_time_us":952767,"spinlock_wait_cycles":8775424}
W20260619 18:45:51.028554 12544 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.859716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51398 (local address 127.6.120.254:36501)
0619 18:45:47.413810 (+554094us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.415303 (+ 1493us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.416309 (+ 1006us) server_negotiation.cc:407] Connection header received
0619 18:45:47.416454 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.416485 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.416742 (+ 257us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.416914 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.457337 (+ 40423us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:47.483624 (+ 26287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.728554 (+244930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.375468 (+646914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.745090 (+369622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.745464 (+ 374us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:50.592318 (+1846854us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51398: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1339394,"server-negotiator.queue_time_us":550484,"spinlock_wait_cycles":6225792}
W20260619 18:45:50.974555 12875 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.682s user 0.006s sys 0.009s
I20260619 18:45:51.025719 10957 rpcz_store.cc:275] Call kudu.master.MasterService.ConnectToMaster from 127.0.0.1:51222 (request call id 0) took 2524 ms. Trace:
I20260619 18:45:51.039106 10957 rpcz_store.cc:276] 0619 18:45:48.501278 (+ 0us) service_pool.cc:170] Inserting onto call queue
0619 18:45:48.531378 (+ 30100us) service_pool.cc:227] Handling call
0619 18:45:51.023728 (+2492350us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b3c00108b18. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fc232a 00007f1383fc2521 00007f138cdca381 00007f138b0db534 00007f138b0db4c2 00007f138b0db3f1
0619 18:45:51.025520 (+ 1792us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1982417,"spinlock_wait_cycles":3518080}
W20260619 18:45:51.041875 12091 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.333131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51252 (local address 127.6.120.254:36501)
0619 18:45:47.127828 (+794697us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.128777 (+ 949us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.132796 (+ 4019us) server_negotiation.cc:407] Connection header received
0619 18:45:47.137595 (+ 4799us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.138324 (+ 729us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.138624 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.138831 (+ 207us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.330225 (+191394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.715042 (+384817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.406813 (+691771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:49.957638 (+1550825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:51.040600 (+1082962us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51252: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2897439,"server-negotiator.queue_time_us":786774}
W20260619 18:45:51.005436 12149 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.812s user 0.024s sys 0.029s
W20260619 18:45:51.035362 12875 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.739s user 0.012s sys 0.015s
W20260619 18:45:51.048655 12149 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.234s user 0.025s sys 0.034s
W20260619 18:45:51.059056 12853 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.040240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48624 (local address 127.6.120.193:37901)
0619 18:45:48.312332 (+272092us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.314904 (+ 2572us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.319185 (+ 4281us) server_negotiation.cc:407] Connection header received
0619 18:45:48.326958 (+ 7773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.327892 (+ 934us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.405666 (+ 77774us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.424238 (+ 18572us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:51.039568 (+2615330us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48624: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2596672,"server-negotiator.queue_time_us":222504}
W20260619 18:45:51.073395 12574 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.267260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51606)
0619 18:45:47.314343 (+ 47083us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.314842 (+ 499us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.319495 (+ 4653us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.568207 (+1248712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.569178 (+ 971us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.579611 (+ 10433us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:50.223735 (+1644124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:50.223826 (+ 91us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:50.973932 (+750106us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1749,"mutex_wait_us":2288873}
W20260619 18:45:51.074460 12547 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.018074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51506)
0619 18:45:47.068932 (+ 50858us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.068993 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.069286 (+ 293us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.774834 (+705548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.776667 (+ 1833us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.797219 (+ 20552us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.849907 (+ 52688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.849984 (+ 77us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.865965 (+ 15981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.878060 (+ 12095us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.095772 (+217712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.095832 (+ 60us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.595362 (+499530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.597840 (+ 2478us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:49.912553 (+1314713us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:50.059237 (+146684us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:50.059280 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:50.059347 (+ 67us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:50.059488 (+ 141us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:50.634653 (+575165us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":504,"mutex_wait_us":2102843}
W20260619 18:45:51.080309 12836 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.672954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51808)
0619 18:45:47.681080 (+ 8126us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.681204 (+ 124us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.681616 (+ 412us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:49.785309 (+2103693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:49.785363 (+ 54us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:49.785530 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:51.042464 (+1256934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:51.042518 (+ 54us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.043009 (+ 491us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":7209,"mutex_wait_us":1194006,"thread_start_us":6668,"threads_started":1}
W20260619 18:45:51.082399 12691 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.363564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51278)
0619 18:45:46.367497 (+ 3933us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.367542 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.367767 (+ 225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.213183 (+845416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.213214 (+ 31us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.213332 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.367346 (+154014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.369450 (+ 2104us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.890661 (+521211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.891486 (+ 825us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.541642 (+650156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.541706 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.070422 (+2528716us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":3497,"mutex_wait_us":2269790}
W20260619 18:45:51.114332 12823 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.408079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51746)
0619 18:45:47.633219 (+225140us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.634902 (+ 1683us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.642805 (+ 7903us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.597588 (+954783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.599099 (+ 1511us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.611343 (+ 12244us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:49.605583 (+994240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:49.605653 (+ 70us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:50.591303 (+985650us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":206437,"mutex_wait_us":1049057,"thread_start_us":160699,"threads_started":1}
W20260619 18:45:51.129278 12634 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.259200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51600 (local address 127.6.120.254:36501)
0619 18:45:48.537442 (+1278242us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.538516 (+ 1074us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.540187 (+ 1671us) server_negotiation.cc:407] Connection header received
0619 18:45:48.546348 (+ 6161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.550947 (+ 4599us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.565838 (+ 14891us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.569254 (+ 3416us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:48.696616 (+127362us) spinlock_profiling.cc:243] Waited 5.24 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:48.945841 (+249225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.060591 (+2114750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:51.061150 (+ 559us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51600: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2336867,"server-negotiator.queue_time_us":1212689,"spinlock_wait_cycles":12041088}
W20260619 18:45:51.140225 12617 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.568s user 0.011s sys 0.012s
W20260619 18:45:51.133399 12210 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 2.42854e+06us
W20260619 18:45:51.210189 12617 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.710s user 0.011s sys 0.023s
W20260619 18:45:51.205080 12606 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 2.3606e+06us
W20260619 18:45:51.207373 12798 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 112750us
W20260619 18:45:51.231983 12187 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.375248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51286 (local address 127.6.120.254:36501)
0619 18:45:47.153925 (+778677us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.153959 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.154019 (+ 60us) server_negotiation.cc:407] Connection header received
0619 18:45:47.154173 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.154203 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.154459 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.154682 (+ 223us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.285722 (+131040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.731088 (+445366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.837395 (+106307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.181532 (+344137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.638259 (+456727us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:51.229277 (+2591018us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51286: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":3241211,"server-negotiator.queue_time_us":778211}
W20260619 18:45:51.246197 12608 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.903741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51426 (local address 127.6.120.254:36501)
0619 18:45:47.489202 (+585461us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.489239 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.489286 (+ 47us) server_negotiation.cc:407] Connection header received
0619 18:45:47.489416 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.489453 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.493785 (+ 4332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.497398 (+ 3613us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.781576 (+284178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.172149 (+390573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.941145 (+768996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:50.304089 (+1362944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:51.234083 (+929994us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51426: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2825414,"server-negotiator.queue_time_us":585007}
W20260619 18:45:51.253780 12619 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.311934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51614 (local address 127.6.120.254:36501)
0619 18:45:48.549737 (+1237803us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.551039 (+ 1302us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.554178 (+ 3139us) server_negotiation.cc:407] Connection header received
0619 18:45:48.561541 (+ 7363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.562623 (+ 1082us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.575620 (+ 12997us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.577513 (+ 1893us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:51.234863 (+2657350us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51614: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1813969,"server-negotiator.queue_time_us":1188197}
W20260619 18:45:51.298247 12554 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.658232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51320)
0619 18:45:46.660397 (+ 2165us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.660460 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.660711 (+ 251us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.248821 (+588110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.248862 (+ 41us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.249028 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.475750 (+226722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.475850 (+ 100us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.725182 (+249332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.725243 (+ 61us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.695070 (+969827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.697012 (+ 1942us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.239253 (+2542241us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1634,"mutex_wait_us":2355148}
W20260619 18:45:51.311792 12058 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.710725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51334 (local address 127.6.120.254:36501)
0619 18:45:47.286625 (+575900us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.286658 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.286708 (+ 50us) server_negotiation.cc:407] Connection header received
0619 18:45:47.286843 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.286869 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.287126 (+ 257us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.287327 (+ 201us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.416455 (+129128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.729042 (+312587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.734705 (+1005663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.787219 (+ 52514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:49.625136 (+837917us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:51.218370 (+1593234us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51334: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2730125,"server-negotiator.queue_time_us":569756}
W20260619 18:45:51.305872 12675 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 107777us
W20260619 18:45:51.353718 12466 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.279203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51612 (local address 127.6.120.254:36501)
0619 18:45:48.494731 (+1215528us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.494771 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.494837 (+ 66us) server_negotiation.cc:407] Connection header received
0619 18:45:48.497330 (+ 2493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.500583 (+ 3253us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.510378 (+ 9795us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.510615 (+ 237us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:51.220167 (+2709552us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51612: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":947317,"server-negotiator.queue_time_us":1210663}
W20260619 18:45:51.452667 12632 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.197585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51584 (local address 127.6.120.254:36501)
0619 18:45:48.315800 (+1118215us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.315843 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.315904 (+ 61us) server_negotiation.cc:407] Connection header received
0619 18:45:48.316059 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.316083 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.316420 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.316645 (+ 225us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:51.228407 (+2911762us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51584: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1221658,"server-negotiator.queue_time_us":1100763}
W20260619 18:45:51.494021 12490 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.865544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51402 (local address 127.6.120.254:36501)
0619 18:45:47.439103 (+573559us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.439133 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.439192 (+ 59us) server_negotiation.cc:407] Connection header received
0619 18:45:47.439330 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.439354 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.439592 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.440266 (+ 674us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.701255 (+260989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.703248 (+ 1993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.923891 (+220643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.168684 (+244793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.301342 (+132658us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:51.385379 (+3084037us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51402: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2376815,"server-negotiator.queue_time_us":573118}
W20260619 18:45:51.946367 12485 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.177770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51558)
0619 18:45:47.199466 (+ 21696us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.200099 (+ 633us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.216270 (+ 16171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.062377 (+846107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.063711 (+ 1334us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.076689 (+ 12978us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:50.669519 (+2592830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:50.669616 (+ 97us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.374986 (+705370us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":498,"mutex_wait_us":3134998}
W20260619 18:45:51.528645 12570 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.659132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51320 (local address 127.6.120.254:36501)
0619 18:45:47.241836 (+582704us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.241866 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.241914 (+ 48us) server_negotiation.cc:407] Connection header received
0619 18:45:47.242057 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.242084 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.242339 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.250635 (+ 8296us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.353540 (+102905us) spinlock_profiling.cc:243] Waited 5 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:47.477131 (+123591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.724471 (+247340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.707844 (+983373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:50.582163 (+1874319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:51.375191 (+793028us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51320: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2934460,"server-negotiator.queue_time_us":582339,"spinlock_wait_cycles":11501440}
W20260619 18:45:51.543299 12568 meta_cache.cc:1097] Time spent processing table locations response: real 0.052s user 0.000s sys 0.001s
W20260619 18:45:51.946071 12014 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.180469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51558 (local address 127.6.120.254:36501)
0619 18:45:48.014915 (+834446us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.014953 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.014999 (+ 46us) server_negotiation.cc:407] Connection header received
0619 18:45:48.015125 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.015149 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.041595 (+ 26446us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:48.050566 (+ 8971us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.059662 (+ 9096us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:51.421658 (+3361996us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51558: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1397802,"server-negotiator.queue_time_us":830288,"spinlock_wait_cycles":10105216}
W20260619 18:45:51.959080 12413 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.856435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51392 (local address 127.6.120.254:36501)
0619 18:45:47.408810 (+552375us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.409497 (+ 687us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.410867 (+ 1370us) server_negotiation.cc:407] Connection header received
0619 18:45:47.412630 (+ 1763us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.413167 (+ 537us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.418156 (+ 4989us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.418350 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.765164 (+346814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.767185 (+ 2021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.673717 (+906532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:50.597262 (+1923545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:51.489678 (+892416us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51392: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2808882,"server-negotiator.queue_time_us":545953}
W20260619 18:45:51.959483 12444 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.176054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51544)
0619 18:45:47.176953 (+ 899us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.177001 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.177240 (+ 239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.006657 (+829417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.006691 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.006816 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:48.017306 (+ 10490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.017367 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.520522 (+3503155us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":393,"mutex_wait_us":1022681}
W20260619 18:45:51.959347 12215 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 3.35848e+06us
W20260619 18:45:51.948776 12681 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:45.829112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51136)
0619 18:45:45.879879 (+ 50767us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:45.879948 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:45.880267 (+ 319us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:46.709602 (+829335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:46.711323 (+ 1721us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:46.726433 (+ 15110us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.082383 (+355950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.082471 (+ 88us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.390698 (+308227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.390743 (+ 45us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.754352 (+363609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.754411 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.827564 (+ 73153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.827619 (+ 55us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.584869 (+757250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:49.956574 (+1371705us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:49.956616 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:49.956686 (+ 70us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:50.028491 (+ 71805us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:51.319169 (+1290678us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":8767,"mutex_wait_us":3950838}
W20260619 18:45:51.958336 12492 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.842553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51378)
0619 18:45:46.843141 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.843198 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.843495 (+ 297us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.403884 (+560389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.403918 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.404047 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.497233 (+ 93186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.498912 (+ 1679us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.084535 (+585623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.085925 (+ 1390us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:49.605441 (+1519516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:49.605521 (+ 80us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.364649 (+1759128us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":123,"mutex_wait_us":2954713}
W20260619 18:45:51.974258 12583 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.310940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51614)
0619 18:45:47.312718 (+ 1778us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.312766 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.313120 (+ 354us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.577804 (+1264684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.577839 (+ 35us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.577994 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:51.072234 (+2494240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:51.074657 (+ 2423us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.518006 (+443349us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1123,"mutex_wait_us":2861189}
W20260619 18:45:51.975291 12549 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.195814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51584)
0619 18:45:47.207411 (+ 11597us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.207465 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.207803 (+ 338us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.318948 (+1111145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.318984 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.320777 (+ 1793us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:51.205157 (+2884380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:51.208100 (+ 2943us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.411271 (+203171us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":4504,"mutex_wait_us":2636189}
W20260619 18:45:51.975899 12507 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.148708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51530)
0619 18:45:47.168774 (+ 20066us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.168831 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.169092 (+ 261us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.032560 (+863468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.034323 (+ 1763us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.045937 (+ 11614us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:48.746754 (+700817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.746813 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.483326 (+2736513us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":13692,"mutex_wait_us":1922823}
W20260619 18:45:51.893493 12246 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 3.11683e+06us
W20260619 18:45:51.979508 12431 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.944864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51464)
0619 18:45:46.947668 (+ 2804us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.947718 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.947971 (+ 253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.586403 (+638432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.586443 (+ 40us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.586590 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.954329 (+367739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.954426 (+ 97us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.510909 (+556483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.510950 (+ 41us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.944443 (+433493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.944518 (+ 75us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.428842 (+2484324us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1558,"mutex_wait_us":2129840}
W20260619 18:45:51.979182 12558 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.899184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51414 (local address 127.6.120.254:36501)
0619 18:45:47.454538 (+555354us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.454571 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.454619 (+ 48us) server_negotiation.cc:407] Connection header received
0619 18:45:47.454745 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.454775 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.455086 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.455266 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:48.006723 (+551457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:49.543765 (+1537042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:51.433630 (+1889865us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51414: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2882626,"server-negotiator.queue_time_us":554945}
W20260619 18:45:52.016952 12612 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.457797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51762 (local address 127.6.120.254:36501)
0619 18:45:48.577916 (+1120119us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.577948 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.577994 (+ 46us) server_negotiation.cc:407] Connection header received
0619 18:45:48.578112 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.578139 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.578387 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.578568 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:52.007697 (+3429129us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51762: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1680342,"server-negotiator.queue_time_us":1110490}
W20260619 18:45:52.018116 12863 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.096325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48634 (local address 127.6.120.193:37901)
0619 18:45:48.422795 (+326470us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.422832 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.429921 (+ 7089us) server_negotiation.cc:407] Connection header received
0619 18:45:48.479569 (+ 49648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.482999 (+ 3430us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.506555 (+ 23556us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.518516 (+ 11961us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:52.011869 (+3493353us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48634: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":843652,"server-negotiator.queue_time_us":316764,"thread_start_us":200521,"threads_started":1}
W20260619 18:45:52.031988 12636 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.674286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51808 (local address 127.6.120.254:36501)
0619 18:45:49.710829 (+2036543us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:49.711812 (+ 983us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:49.714131 (+ 2319us) server_negotiation.cc:407] Connection header received
0619 18:45:49.756252 (+ 42121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:49.764358 (+ 8106us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:49.784888 (+ 20530us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:49.785156 (+ 268us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:51.503314 (+1718158us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51808: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1631424,"server-negotiator.queue_time_us":1941537}
W20260619 18:45:52.027776 12244 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 1.08619e+06us
W20260619 18:45:52.035535 12782 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.533554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51308)
0619 18:45:46.866675 (+333121us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.867526 (+ 851us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.894767 (+ 27241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.256004 (+361237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.256053 (+ 49us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.256260 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.400285 (+144025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.400344 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.734987 (+334643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.735044 (+ 57us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.572699 (+837655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.572760 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.585980 (+ 13220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.595252 (+ 9272us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.744263 (+149011us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:48.753795 (+ 9532us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:48.761023 (+ 7228us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:48.763466 (+ 2443us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:48.785543 (+ 22077us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:51.427555 (+2642012us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":282333,"mutex_wait_us":2742444,"thread_start_us":250859,"threads_started":1}
W20260619 18:45:52.160720 11039 thread.cc:636] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.801s user 0.000s sys 0.028s
W20260619 18:45:52.035413 12585 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.447871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51750 (local address 127.6.120.254:36501)
0619 18:45:48.576148 (+1128277us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.578699 (+ 2551us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.578749 (+ 50us) server_negotiation.cc:407] Connection header received
0619 18:45:48.578884 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.578912 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.579153 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.579329 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:51.583307 (+3003978us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51750: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2018149,"server-negotiator.queue_time_us":1092121}
W20260619 18:45:52.066476 12796 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.004130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51474)
0619 18:45:47.144915 (+140785us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.145021 (+ 106us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.145315 (+ 294us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.613674 (+468359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.613708 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.613845 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:48.565047 (+951202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.565128 (+ 81us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.358685 (+2793557us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":134422,"mutex_wait_us":2167318,"thread_start_us":54374,"threads_started":1}
W20260619 18:45:52.311661 12591 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.750825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51346 (local address 127.6.120.254:36501)
0619 18:45:47.337459 (+586634us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.338332 (+ 873us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.339331 (+ 999us) server_negotiation.cc:407] Connection header received
0619 18:45:47.347584 (+ 8253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.348617 (+ 1033us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.360137 (+ 11520us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.362364 (+ 2227us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.376008 (+ 13644us) spinlock_profiling.cc:243] Waited 6.41 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:47.572292 (+196284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.705095 (+132803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.746580 (+1041485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:49.624511 (+877931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:49.624823 (+ 312us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:51.354382 (+1729559us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51346: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2657704,"server-negotiator.queue_time_us":550068,"spinlock_wait_cycles":14751104}
W20260619 18:45:52.677279 12722 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.442939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51750)
0619 18:45:47.446851 (+ 3912us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.446905 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.448450 (+ 1545us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.597858 (+1149408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.599435 (+ 1577us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.611211 (+ 11776us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:51.442125 (+2830914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:51.446400 (+ 4275us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.005419 (+559019us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1922,"mutex_wait_us":3311057}
W20260619 18:45:52.312996 12203 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 1.72896e+06us
W20260619 18:45:52.313571 12410 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.797026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51358)
0619 18:45:46.822547 (+ 25521us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.822617 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.825037 (+ 2420us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.325335 (+500298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.325372 (+ 37us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.325509 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.494375 (+168866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.496036 (+ 1661us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.863450 (+367414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.863500 (+ 50us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.893944 (+ 30444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.894002 (+ 58us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.078825 (+184823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.081139 (+ 2314us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.612845 (+531706us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:49.713752 (+1100907us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:49.713785 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:49.755172 (+ 41387us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:49.780143 (+ 24971us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:51.357906 (+1577763us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":5558,"mutex_wait_us":3137165}
W20260619 18:45:52.314227 12584 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.864550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51402)
0619 18:45:46.919628 (+ 55078us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.921350 (+ 1722us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.932482 (+ 11132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.439971 (+507489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.440004 (+ 33us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.440159 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.456684 (+ 16525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.456754 (+ 70us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.705511 (+248757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.705551 (+ 40us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.923536 (+217985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.923612 (+ 76us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.171733 (+248121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.171778 (+ 45us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:49.559958 (+1388180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:50.537865 (+977907us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:50.537905 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:50.537966 (+ 61us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:50.538112 (+ 146us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:51.322738 (+784626us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":2050,"mutex_wait_us":3150031}
W20260619 18:45:52.311789 12882 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.884s user 0.008s sys 0.016s
W20260619 18:45:52.312449 12557 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.930570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51454 (local address 127.6.120.254:36501)
0619 18:45:47.579370 (+648800us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.580770 (+ 1400us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.582024 (+ 1254us) server_negotiation.cc:407] Connection header received
0619 18:45:47.586880 (+ 4856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.586911 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.587181 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.587361 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.780651 (+193290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.128990 (+348339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:51.506762 (+3377772us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51454: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1918926,"server-negotiator.queue_time_us":614437}
W20260619 18:45:52.313589 12569 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.780619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51358 (local address 127.6.120.254:36501)
0619 18:45:47.319782 (+539163us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.319834 (+ 52us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.319894 (+ 60us) server_negotiation.cc:407] Connection header received
0619 18:45:47.320041 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.320073 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.320512 (+ 439us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.320722 (+ 210us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.371367 (+ 50645us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:47.498762 (+127395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.863002 (+364240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.899138 (+ 36136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.071101 (+171963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.565470 (+494369us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:51.419884 (+2854414us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51358: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2759294,"server-negotiator.queue_time_us":524071,"spinlock_wait_cycles":3104000}
W20260619 18:45:52.311836 12537 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.857148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51398)
0619 18:45:46.857728 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.857778 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.858049 (+ 271us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.417875 (+559826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.417910 (+ 35us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.418031 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.426124 (+ 8093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.426181 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.729419 (+303238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.729487 (+ 68us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.332036 (+602549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.337286 (+ 5250us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.746095 (+408809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.746142 (+ 47us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:49.559857 (+813715us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:50.394402 (+834545us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:50.394440 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:50.394505 (+ 65us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:50.394685 (+ 180us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:51.321308 (+926623us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":2966827}
W20260619 18:45:52.311578 12910 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.621s user 0.000s sys 0.012s
W20260619 18:45:52.159268 12902 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.742s user 0.009s sys 0.023s
W20260619 18:45:52.304457 12295 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.775s user 0.006s sys 0.010s
W20260619 18:45:52.312749 12185 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.932444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51454)
0619 18:45:46.950352 (+ 17908us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.950402 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.950647 (+ 245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.587570 (+636923us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.587634 (+ 64us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.587766 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.764764 (+176998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.764832 (+ 68us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.133032 (+368200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.135546 (+ 2514us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:51.974012 (+3838466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:51.974080 (+ 68us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.028842 (+ 54762us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":9263,"mutex_wait_us":3784420}
W20260619 18:45:52.506320 12936 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.659s user 0.008s sys 0.034s
W20260619 18:45:52.320426 11039 thread.cc:602] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.962s user 0.002s sys 0.035s
W20260619 18:45:52.067296 12743 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 1.01909e+06us
W20260619 18:45:52.132083 12650 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 3.477e+06us
W20260619 18:45:52.667572 12903 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.902s user 0.021s sys 0.022s
W20260619 18:45:52.840509 12604 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.475056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51776 (local address 127.6.120.254:36501)
0619 18:45:48.707662 (+1232606us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.707711 (+ 49us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.707762 (+ 51us) server_negotiation.cc:407] Connection header received
0619 18:45:48.712167 (+ 4405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.721976 (+ 9809us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.729390 (+ 7414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.736155 (+ 6765us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:52.027677 (+3291522us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51776: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":3217021,"server-negotiator.queue_time_us":1232139}
W20260619 18:45:52.679486 12577 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.077001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51828 (local address 127.6.120.254:36501)
0619 18:45:49.677757 (+1600756us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:49.695970 (+ 18213us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:49.697939 (+ 1969us) server_negotiation.cc:407] Connection header received
0619 18:45:49.709833 (+ 11894us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:49.710526 (+ 693us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:49.780635 (+ 70109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:49.780965 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:52.006946 (+2225981us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51828: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2172790,"server-negotiator.queue_time_us":1542720}
W20260619 18:45:52.311596 12603 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.042559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51518 (local address 127.6.120.254:36501)
0619 18:45:47.828720 (+786161us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.828752 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.828806 (+ 54us) server_negotiation.cc:407] Connection header received
0619 18:45:47.828928 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.828957 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.830557 (+ 1600us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.830781 (+ 224us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:48.039052 (+208271us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:48.250557 (+211505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.769370 (+518813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.786821 (+ 17451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:49.620931 (+834110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:49.621365 (+ 434us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:51.421543 (+1800178us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51518: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":3355795,"server-negotiator.queue_time_us":743085,"spinlock_wait_cycles":5301120}
W20260619 18:45:52.696477 12536 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.743651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51898 (local address 127.6.120.254:36501)
0619 18:45:50.521193 (+1777542us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:50.521227 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:50.521279 (+ 52us) server_negotiation.cc:407] Connection header received
0619 18:45:50.521435 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:50.521461 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:50.521727 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:50.524629 (+ 2902us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:52.029070 (+1504441us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51898: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1257937,"server-negotiator.queue_time_us":1777140}
W20260619 18:45:52.313001 12860 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.869s user 0.016s sys 0.048s
W20260619 18:45:52.842000 12910 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.160s user 0.004s sys 0.021s
W20260619 18:45:52.806893 12852 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.006028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48620)
0619 18:45:48.274478 (+268450us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:48.274537 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:48.274874 (+ 337us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.277042 (+ 2168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.277092 (+ 50us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.277159 (+ 67us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:48.836595 (+559436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.836662 (+ 67us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.584291 (+2747629us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":267955,"mutex_wait_us":847002,"thread_start_us":267559,"threads_started":1}
W20260619 18:45:52.853554 12936 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.196s user 0.017s sys 0.034s
W20260619 18:45:52.852501 12902 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.435s user 0.024s sys 0.031s
W20260619 18:45:52.853250 12441 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.160320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51536)
0619 18:45:47.168529 (+ 8209us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.168596 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.168884 (+ 288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.976795 (+807911us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.980568 (+ 3773us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.995151 (+ 14583us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:49.545505 (+1550354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:49.548012 (+ 2507us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.010861 (+2462849us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":2412,"mutex_wait_us":2975622}
W20260619 18:45:52.856813 12295 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.325s user 0.011s sys 0.018s
W20260619 18:45:52.841259 12882 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.422s user 0.012s sys 0.031s
W20260619 18:45:52.449874 12143 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.703s user 0.007s sys 0.022s
W20260619 18:45:52.508347 12925 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.822s user 0.001s sys 0.021s
W20260619 18:45:52.734380 12812 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.184870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51572)
0619 18:45:47.364973 (+180103us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.365048 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.365378 (+ 330us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.159184 (+793806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.159248 (+ 64us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.166335 (+ 7087us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:50.590371 (+2424036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:50.590456 (+ 85us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.551014 (+960558us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":161276,"mutex_wait_us":2544007,"thread_start_us":117455,"threads_started":1}
W20260619 18:45:52.852221 12908 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.076s user 0.015s sys 0.015s
W20260619 18:45:52.866066 12860 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.426s user 0.021s sys 0.057s
W20260619 18:45:52.870628 12903 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.442s user 0.024s sys 0.028s
W20260619 18:45:52.471422 12232 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 1.8718e+06us
W20260619 18:45:52.887077 12143 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.376s user 0.012s sys 0.028s
W20260619 18:45:52.894657 12925 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.413s user 0.004s sys 0.029s
W20260619 18:45:53.086841 11040 thread.cc:636] server-negotiator [worker] (thread pool) Time spent creating pthread: real 1.535s user 0.000s sys 0.044s
W20260619 18:45:53.118947 11040 thread.cc:602] server-negotiator [worker] (thread pool) Time spent starting thread: real 1.575s user 0.000s sys 0.045s
W20260619 18:45:53.106154 12589 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.038658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51496 (local address 127.6.120.254:36501)
0619 18:45:47.663154 (+624496us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.663203 (+ 49us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.663292 (+ 89us) server_negotiation.cc:407] Connection header received
0619 18:45:47.663474 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.663513 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.685850 (+ 22337us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:47.686125 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.686379 (+ 254us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:48.159215 (+472836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.725621 (+566406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:51.984848 (+3259227us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51496: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2666989,"server-negotiator.queue_time_us":618399,"spinlock_wait_cycles":5857536}
W20260619 18:45:52.910290 12613 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.237833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51830 (local address 127.6.120.254:36501)
0619 18:45:49.622062 (+1384229us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:49.622096 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:49.622146 (+ 50us) server_negotiation.cc:407] Connection header received
0619 18:45:49.622272 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:49.622298 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:49.622557 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:49.622748 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:52.007141 (+2384393us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51830: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2155443,"server-negotiator.queue_time_us":1383822}
W20260619 18:45:53.099769 12834 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.641007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48562)
0619 18:45:47.679425 (+ 38418us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.679490 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.680011 (+ 521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.689692 (+ 9681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.689748 (+ 56us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.689851 (+ 103us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:48.128391 (+438540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.129367 (+ 976us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.776276 (+646909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.776318 (+ 42us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.778953 (+ 2635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.779035 (+ 82us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.571344 (+3792309us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":37847,"mutex_wait_us":2242891,"thread_start_us":37462,"threads_started":1}
I20260619 18:45:52.952821 12131 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:52.941494 12908 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.643s user 0.017s sys 0.021s
W20260619 18:45:52.872411 12765 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 411655us
W20260619 18:45:53.054596 12780 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 45258.8us
W20260619 18:45:53.140491 12596 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.681986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51860 (local address 127.6.120.254:36501)
0619 18:45:49.624175 (+942189us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:49.624208 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:49.624257 (+ 49us) server_negotiation.cc:407] Connection header received
0619 18:45:49.624384 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:49.624432 (+ 48us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:49.624755 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:49.624968 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:52.058379 (+2433411us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51860: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1936408,"server-negotiator.queue_time_us":941770}
W20260619 18:45:53.142879 12131 scanner-internal.cc:458] Time spent opening tablet: real 5.305s user 0.008s sys 0.017s
W20260619 18:45:53.211259 12477 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.963471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48592)
0619 18:45:47.967141 (+ 3670us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.975722 (+ 8581us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.992981 (+ 17259us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.069456 (+ 76475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.071231 (+ 1775us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.077808 (+ 6577us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:48.768814 (+691006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.768891 (+ 77us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.319131 (+3550240us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":460,"mutex_wait_us":1758211}
W20260619 18:45:53.211987 12516 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.660798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51844 (local address 127.6.120.254:36501)
0619 18:45:49.622909 (+962111us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:49.622939 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:49.622984 (+ 45us) server_negotiation.cc:407] Connection header received
0619 18:45:49.623102 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:49.623132 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:49.623354 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:49.623547 (+ 193us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:52.060237 (+2436690us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51844: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1287213,"server-negotiator.queue_time_us":961682}
W20260619 18:45:53.211934 12883 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.539169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48660)
0619 18:45:48.776810 (+237641us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:48.776880 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:48.777308 (+ 428us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.812077 (+ 34769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.813502 (+ 1425us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.826514 (+ 13012us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:49.618762 (+792248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:49.618819 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.643266 (+3024447us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":223373,"mutex_wait_us":1880556,"thread_start_us":31476,"threads_started":1}
W20260619 18:45:53.159781 12533 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:45.829898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51154)
0619 18:45:45.837344 (+ 7446us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:45.837401 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:45.837667 (+ 266us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:46.770457 (+932790us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:46.772247 (+ 1790us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:46.782836 (+ 10589us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.012622 (+229786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.012684 (+ 62us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.343920 (+331236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.343971 (+ 51us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.829403 (+485432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.830036 (+ 633us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.500785 (+670749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.505184 (+ 4399us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:50.477540 (+1972356us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:50.854194 (+376654us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:50.854238 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:50.854338 (+ 100us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:50.854509 (+ 171us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:52.410267 (+1555758us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1494,"mutex_wait_us":4336450}
I20260619 18:45:53.212530 12160 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:53.213650 12160 scanner-internal.cc:458] Time spent opening tablet: real 5.458s user 0.004s sys 0.007s
W20260619 18:45:53.189616 12194 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.471335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51776)
0619 18:45:47.483928 (+ 12593us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.483981 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.484237 (+ 256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.736468 (+1252231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.736505 (+ 37us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.736637 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:51.587457 (+2850820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:51.587559 (+ 102us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.313277 (+725718us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1067,"mutex_wait_us":3517954}
W20260619 18:45:53.214177 12560 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.643106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51806 (local address 127.6.120.254:36501)
0619 18:45:49.604270 (+1961164us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:49.604321 (+ 51us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:49.604382 (+ 61us) server_negotiation.cc:407] Connection header received
0619 18:45:49.604540 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:49.604570 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:49.604865 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:49.605117 (+ 252us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:53.140739 (+3535622us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51806: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":3322318,"server-negotiator.queue_time_us":1958362}
W20260619 18:45:53.221966 12480 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.979413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48592 (local address 127.6.120.193:37901)
0619 18:45:48.027680 (+ 48267us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.029478 (+ 1798us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.032307 (+ 2829us) server_negotiation.cc:407] Connection header received
0619 18:45:48.036416 (+ 4109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.039325 (+ 2909us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.060885 (+ 21560us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.068005 (+ 7120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:48.769694 (+701689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.066380 (+2296686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:52.174767 (+1108387us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48592: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":3429155,"server-negotiator.queue_time_us":550}
I20260619 18:45:53.214730 12140 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:45:53.225353 12140 scanner-internal.cc:458] Time spent opening tablet: real 4.986s user 0.015s sys 0.013s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:45:53.226015 12897 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.681095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51860)
0619 18:45:49.260276 (+579181us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:49.260351 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:49.260742 (+ 391us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:49.625054 (+364312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:49.625083 (+ 29us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:49.625207 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:52.483561 (+2858354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.502931 (+ 19370us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.972430 (+469499us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":578517,"mutex_wait_us":1962615,"thread_start_us":130716,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:45:53.227764 12463 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.140464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51212)
0619 18:45:46.141083 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.141135 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.141397 (+ 262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:46.848668 (+707271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:46.850210 (+ 1542us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:46.853229 (+ 3019us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.090940 (+237711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.091022 (+ 82us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.406514 (+315492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.406560 (+ 46us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.815425 (+408865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.824302 (+ 8877us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.925231 (+100929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.925275 (+ 44us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:49.897670 (+1972395us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:50.393906 (+496236us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:50.396240 (+ 2334us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:50.475216 (+ 78976us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:50.492173 (+ 16957us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:52.625046 (+2132873us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":5060776}
W20260619 18:45:53.230937 12501 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.041448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51518)
0619 18:45:47.042152 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.042212 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.042495 (+ 283us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.836182 (+793687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.836217 (+ 35us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.836367 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:48.169343 (+332976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.170477 (+ 1134us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.772830 (+602353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.772866 (+ 36us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.774929 (+ 2063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.774981 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:49.623309 (+848328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:49.815350 (+192041us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:51.073279 (+1257929us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:51.119276 (+ 45997us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:51.119315 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:51.119397 (+ 82us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:51.119577 (+ 180us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:52.447281 (+1327704us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":2809965}
W20260619 18:45:53.213912 12572 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.801477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51370)
0619 18:45:46.827347 (+ 25870us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.827398 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.827609 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.362599 (+534990us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.365375 (+ 2776us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.365563 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.454908 (+ 89345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.454969 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.957464 (+502495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.957523 (+ 59us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.711246 (+753723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.711310 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.785238 (+ 73928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.785298 (+ 60us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:50.223562 (+1438264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:50.473179 (+249617us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:50.473214 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:50.473278 (+ 64us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:50.476312 (+ 3034us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:52.850967 (+2374655us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":3875,"mutex_wait_us":4500243}
W20260619 18:45:53.234117 12898 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.721339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48664)
0619 18:45:49.813596 (+1092257us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b18002fd100. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f138cce98b1 00007f138ccf6661 00007f1383e56638 00007f1383e59b11 00007f1383e59ac9 00007f1383e59a59 00007f1383e59a21 00007f1383e58d1d 00007f138d0ae204 00007f138d0ae039 00007f1383e38dc6
0619 18:45:49.815571 (+ 1975us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:49.815612 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:49.815942 (+ 330us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:49.825784 (+ 9842us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:49.837387 (+ 11603us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:49.844726 (+ 7339us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:52.432545 (+2587819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.432606 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.159163 (+726557us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":829344,"mutex_wait_us":3092159,"spinlock_wait_cycles":5378304,"thread_start_us":826327,"threads_started":1}
I20260619 18:45:53.234754 12158 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:53.235225 12158 scanner-internal.cc:458] Time spent opening tablet: real 4.946s user 0.014s sys 0.009s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:53.236454 12752 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.662629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48570 (local address 127.6.120.193:37901)
0619 18:45:47.665634 (+ 3005us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.665669 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.665717 (+ 48us) server_negotiation.cc:407] Connection header received
0619 18:45:47.665871 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.665898 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.683780 (+ 17882us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.686031 (+ 2251us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:48.004455 (+318424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.660959 (+656504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:49.621543 (+960584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:49.622593 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:49.623005 (+ 412us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:52.138730 (+2515725us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48570: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2745492,"server-negotiator.queue_time_us":2476}
W20260619 18:45:53.236831 12862 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.099229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48634)
0619 18:45:48.413547 (+314318us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:48.423598 (+ 10051us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:48.459153 (+ 35555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.520538 (+ 61385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.521861 (+ 1323us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.527651 (+ 5790us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:51.418609 (+2890958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:51.418669 (+ 60us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.137558 (+718889us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":250928,"mutex_wait_us":3475554,"thread_start_us":157714,"threads_started":1}
W20260619 18:45:53.237031 12182 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.566246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51790 (local address 127.6.120.254:36501)
0619 18:45:48.948491 (+1382245us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.948537 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.948608 (+ 71us) server_negotiation.cc:407] Connection header received
0619 18:45:48.948778 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.948814 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.949155 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.949372 (+ 217us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:52.877159 (+3927787us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51790: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":3891669,"server-negotiator.queue_time_us":1270994}
W20260619 18:45:53.237663 12961 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.503s user 0.001s sys 0.012s
W20260619 18:45:53.220890 12592 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.194061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51594)
0619 18:45:47.207961 (+ 13900us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.209342 (+ 1381us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.210145 (+ 803us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.312279 (+1102134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.315318 (+ 3039us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.326489 (+ 11171us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:48.786401 (+459912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.786467 (+ 66us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.211847 (+3425380us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":991,"mutex_wait_us":2433485}
W20260619 18:45:53.224881 12464 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.374262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51286)
0619 18:45:46.375016 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.375063 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.375297 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.163651 (+788354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.164748 (+ 1097us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.169098 (+ 4350us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.284309 (+115211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.285410 (+ 1101us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.735091 (+449681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.735138 (+ 47us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.836794 (+101656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.836865 (+ 71us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.215251 (+378386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.216234 (+ 983us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:50.203765 (+1987531us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:50.537139 (+333374us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:50.537183 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:50.537263 (+ 80us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:50.537446 (+ 183us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:52.605822 (+2068376us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":336,"mutex_wait_us":4344163}
W20260619 18:45:53.223666 12777 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.399611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51296)
0619 18:45:46.461057 (+ 61446us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.461122 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.461375 (+ 253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.241792 (+780417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.241843 (+ 51us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.242027 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.244402 (+ 2375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.244452 (+ 50us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.482146 (+237694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.482202 (+ 56us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.090383 (+608181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.092896 (+ 2513us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.671145 (+578249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.671191 (+ 46us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.856598 (+185407us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:50.164513 (+1307915us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:50.164553 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:50.164628 (+ 75us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:50.164808 (+ 180us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:52.474520 (+2309712us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":60878,"mutex_wait_us":4230523,"thread_start_us":53307,"threads_started":1}
W20260619 18:45:53.161742 12956 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.654s user 0.000s sys 0.013s
I20260619 18:45:53.242122 12529 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:53.236479 12719 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.177199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51546)
0619 18:45:47.204869 (+ 27670us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.208006 (+ 3137us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.218259 (+ 10253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.126834 (+908575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.128172 (+ 1338us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.137470 (+ 9298us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:49.843676 (+1706206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:49.897149 (+ 53473us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.216267 (+2319118us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1027,"mutex_wait_us":3638750}
W20260619 18:45:53.246960 12590 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.892309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51410)
0619 18:45:46.923957 (+ 31648us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.929037 (+ 5080us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.946880 (+ 17843us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.454061 (+507181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.454102 (+ 41us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.454231 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.516394 (+ 62163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.516486 (+ 92us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.051443 (+534957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.056377 (+ 4934us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.831951 (+775574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.833706 (+ 1755us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.028833 (+3195127us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1762,"mutex_wait_us":2671054}
W20260619 18:45:53.249414 12645 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.834672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51822 (local address 127.6.120.254:36501)
0619 18:45:49.616571 (+1781899us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:49.616605 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:49.616665 (+ 60us) server_negotiation.cc:407] Connection header received
0619 18:45:49.616792 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:49.616818 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:49.617138 (+ 320us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:49.625714 (+ 8576us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:52.485967 (+2860253us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51822: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2803667,"server-negotiator.queue_time_us":1781506}
W20260619 18:45:53.249554 12631 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.734494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51884)
0619 18:45:48.736916 (+ 2422us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:48.736965 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:48.737273 (+ 308us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:50.597625 (+1860352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:50.597677 (+ 52us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:50.597795 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:51.695427 (+1097632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:51.695489 (+ 62us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.319066 (+623577us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1984,"mutex_wait_us":1549896}
W20260619 18:45:53.643301 12893 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.661787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48664 (local address 127.6.120.193:37901)
0619 18:45:48.838429 (+176642us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.859905 (+ 21476us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:49.815739 (+955834us) server_negotiation.cc:407] Connection header received
0619 18:45:49.816229 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:49.816263 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:49.816645 (+ 382us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:49.816864 (+ 219us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:52.972560 (+3155696us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48664: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2948066,"server-negotiator.queue_time_us":71897,"thread_start_us":28492,"threads_started":1}
W20260619 18:45:53.643088 12545 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 355368us
W20260619 18:45:53.266253 12523 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.009025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51490 (local address 127.6.120.254:36501)
0619 18:45:47.651813 (+642788us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.651848 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.651896 (+ 48us) server_negotiation.cc:407] Connection header received
0619 18:45:47.652026 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.652052 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.652351 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.658074 (+ 5723us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:48.061756 (+403682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.750974 (+689218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:52.319010 (+3568036us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51490: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":3002806,"server-negotiator.queue_time_us":642393}
W20260619 18:45:53.643080 12899 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.742638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51898)
0619 18:45:49.705550 (+962912us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:49.710109 (+ 4559us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:49.764480 (+ 54371us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:50.525219 (+760739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:50.533176 (+ 7957us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:50.562981 (+ 29805us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:51.986159 (+1423178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:51.993035 (+ 6876us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.950004 (+956969us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":844117,"mutex_wait_us":1881486,"thread_start_us":304578,"threads_started":1}
W20260619 18:45:53.261897 12573 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.184164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51566)
0619 18:45:47.216045 (+ 31881us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.217423 (+ 1378us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.229923 (+ 12500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.403440 (+1173517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.406267 (+ 2827us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.406452 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:51.413261 (+3006809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:51.418036 (+ 4775us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.367139 (+949103us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1061,"mutex_wait_us":3780437}
W20260619 18:45:53.252555 12961 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.627s user 0.001s sys 0.013s
W20260619 18:45:53.656814 12849 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.986317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48604 (local address 127.6.120.193:37901)
0619 18:45:48.008323 (+ 22006us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.008369 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.468685 (+460316us) server_negotiation.cc:407] Connection header received
0619 18:45:48.483364 (+ 14679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.488208 (+ 4844us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.564487 (+ 76279us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b4800081e18. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f138cd02aa0 00007f138cceb061 00007f1388974dbb 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:48.570340 (+ 5853us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.581980 (+ 11640us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:52.174378 (+3592398us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48604: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":3424367,"server-negotiator.queue_time_us":21479,"spinlock_wait_cycles":4084608,"thread_start_us":8337,"threads_started":1}
W20260619 18:45:53.657222 12513 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.654816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48570)
0619 18:45:47.655964 (+ 1148us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.656017 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.656360 (+ 343us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.686324 (+ 29964us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.686371 (+ 47us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.686525 (+ 154us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:47.761350 (+ 74825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.761464 (+ 114us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.669863 (+908399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.669905 (+ 42us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:49.619528 (+949623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:49.619598 (+ 70us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:49.697841 (+ 78243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:49.698818 (+ 977us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:51.696614 (+1997796us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:51.696945 (+ 331us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 18:45:52.509335 (+812390us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":640,"mutex_wait_us":3707355}
W20260619 18:45:53.626446 12556 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.002332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51474 (local address 127.6.120.254:36501)
0619 18:45:47.592533 (+590201us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.593388 (+ 855us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.594150 (+ 762us) server_negotiation.cc:407] Connection header received
0619 18:45:47.603426 (+ 9276us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.603466 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.606347 (+ 2881us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.612655 (+ 6308us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:48.565563 (+952908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.283368 (+2717805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:52.444777 (+1161409us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51474: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":3924590,"server-negotiator.queue_time_us":549277}
W20260619 18:45:53.640965 12535 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.176220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51544 (local address 127.6.120.254:36501)
0619 18:45:48.004805 (+828585us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.004838 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.004888 (+ 50us) server_negotiation.cc:407] Connection header received
0619 18:45:48.005825 (+ 937us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.005854 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.006140 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.006351 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:48.496276 (+489925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.529120 (+3032844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:52.320911 (+791791us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51544: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":4191401,"server-negotiator.queue_time_us":828146}
W20260619 18:45:53.648370 12956 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.193s user 0.000s sys 0.014s
W20260619 18:45:53.650801 12146 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.719s user 0.004s sys 0.015s
W20260619 18:45:53.658581 12432 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.017964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51496)
0619 18:45:47.050959 (+ 32995us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.051018 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.051331 (+ 313us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.686697 (+635366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.686745 (+ 48us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.686895 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:48.148049 (+461154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.156478 (+ 8429us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.729711 (+573233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.731624 (+ 1913us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:50.599835 (+1868211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:50.599910 (+ 75us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.612551 (+2012641us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":5585,"mutex_wait_us":3587080}
W20260619 18:45:53.657408 12242 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 353433us
W20260619 18:45:53.676364 12411 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.841705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51378 (local address 127.6.120.254:36501)
0619 18:45:47.400983 (+559278us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.401018 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.401074 (+ 56us) server_negotiation.cc:407] Connection header received
0619 18:45:47.401224 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.401252 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.401526 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.401722 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.502865 (+101143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.083114 (+580249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:49.607657 (+1524543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.992750 (+2385093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:52.486683 (+493933us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51378: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":3394797,"server-negotiator.queue_time_us":558867}
W20260619 18:45:53.661947 12529 scanner-internal.cc:458] Time spent opening tablet: real 5.777s user 0.005s sys 0.011s
W20260619 18:45:53.658210 12920 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.873s user 0.025s sys 0.011s
W20260619 18:45:53.665093 12838 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.731205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48580 (local address 127.6.120.193:37901)
0619 18:45:47.982121 (+250916us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.982166 (+ 45us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.985554 (+ 3388us) server_negotiation.cc:407] Connection header received
0619 18:45:48.002578 (+ 17024us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.003482 (+ 904us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.026572 (+ 23090us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.032883 (+ 6311us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:48.098762 (+ 65879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.933626 (+834864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:52.130877 (+3197251us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48580: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2106371,"server-negotiator.queue_time_us":178299,"thread_start_us":98170,"threads_started":1}
W20260619 18:45:53.684851 12648 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.147353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51536 (local address 127.6.120.254:36501)
0619 18:45:47.949448 (+802095us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.949486 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.949552 (+ 66us) server_negotiation.cc:407] Connection header received
0619 18:45:47.949709 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.949742 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.961435 (+ 11693us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.966408 (+ 4973us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:48.037936 (+ 71528us) spinlock_profiling.cc:243] Waited 4.87 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:49.553137 (+1515201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.133270 (+2580133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:52.643039 (+509769us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51536: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":3046509,"server-negotiator.queue_time_us":801619,"spinlock_wait_cycles":11197696}
W20260619 18:45:53.713881 12914 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:49.587296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48690 (local address 127.6.120.193:37901)
0619 18:45:50.497913 (+910617us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:50.497940 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:50.556692 (+ 58752us) server_negotiation.cc:407] Connection header received
0619 18:45:50.557186 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:50.557239 (+ 53us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:50.557687 (+ 448us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:50.557945 (+ 258us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:53.147626 (+2589681us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48690: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1833052,"server-negotiator.queue_time_us":900839,"thread_start_us":20114,"threads_started":1}
W20260619 18:45:53.660678 12960 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.007s user 0.009s sys 0.043s
W20260619 18:45:53.697117 12146 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.288s user 0.005s sys 0.015s
W20260619 18:45:53.697220 12733 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.777s user 0.005s sys 0.008s
W20260619 18:45:53.735545 12165 meta_cache.cc:1097] Time spent processing table locations response: real 0.061s user 0.001s sys 0.000s
W20260619 18:45:53.749891 12960 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.719s user 0.009s sys 0.044s
W20260619 18:45:53.751490 12459 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.735643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51334)
0619 18:45:46.787541 (+ 51898us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.796953 (+ 9412us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.805203 (+ 8250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.287600 (+482397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.287632 (+ 32us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.298268 (+ 10636us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.412989 (+114721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.415128 (+ 2139us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.730112 (+314984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.730165 (+ 53us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.733927 (+1003762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.733992 (+ 65us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.826733 (+ 92741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.832725 (+ 5992us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:50.601440 (+1768715us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:50.624861 (+ 23421us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:50.625849 (+ 988us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:50.626674 (+ 825us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:50.639410 (+ 12736us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:52.157045 (+1517635us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":14164,"mutex_wait_us":4175382}
W20260619 18:45:53.742740 12920 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.555s user 0.027s sys 0.013s
W20260619 18:45:53.759058 12518 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.748947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51346)
0619 18:45:46.798882 (+ 49935us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:46.800365 (+ 1483us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:46.813029 (+ 12664us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.365801 (+552772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.367310 (+ 1509us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.374946 (+ 7636us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.571817 (+196871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.571886 (+ 69us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.708857 (+136971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.711353 (+ 2496us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.746143 (+1034790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.746199 (+ 56us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:49.697792 (+951593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:49.698600 (+ 808us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:50.966987 (+1268387us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:51.018995 (+ 52008us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:51.019034 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:51.019094 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:51.019252 (+ 158us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:51.969949 (+950697us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":5253,"mutex_wait_us":3244479}
I20260619 18:45:53.743345 12548 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
I20260619 18:45:53.783722 12164 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:53.825713 12524 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:45.831124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51180)
0619 18:45:45.833059 (+ 1935us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:45.833107 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:45.833369 (+ 262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:46.725580 (+892211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:46.725614 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:46.725754 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:46.813539 (+ 87785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:46.815185 (+ 1646us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:47.396596 (+581411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:47.396634 (+ 38us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:47.796863 (+400229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.799046 (+ 2183us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.118279 (+319233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.120315 (+ 2036us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:50.549774 (+2429459us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:50.832863 (+283089us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:50.833714 (+ 851us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:50.834802 (+ 1088us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:50.839711 (+ 4909us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:52.339532 (+1499821us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1489,"mutex_wait_us":4445989}
W20260619 18:45:53.859714 12548 scanner-internal.cc:458] Time spent opening tablet: real 6.471s user 0.006s sys 0.025s
W20260619 18:45:53.803833 12733 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.498s user 0.005s sys 0.010s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:53.892138 12876 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.502473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48650)
0619 18:45:48.566665 (+ 64192us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:48.568606 (+ 1941us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:48.577474 (+ 8868us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.635764 (+ 58290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.636720 (+ 956us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.640713 (+ 3993us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:51.415562 (+2774849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:51.419730 (+ 4168us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.839473 (+2419743us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":62644,"mutex_wait_us":4871311,"thread_start_us":55675,"threads_started":1}
I20260619 18:45:53.892997 12564 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:53.893523 12564 scanner-internal.cc:458] Time spent opening tablet: real 5.792s user 0.006s sys 0.003s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:45:53.875890 12624 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.420321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51746 (local address 127.6.120.254:36501)
0619 18:45:48.553811 (+1133490us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.554870 (+ 1059us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.560209 (+ 5339us) server_negotiation.cc:407] Connection header received
0619 18:45:48.563825 (+ 3616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.566233 (+ 2408us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.580809 (+ 14576us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:48.581010 (+ 201us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.581222 (+ 212us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:50.223416 (+1642194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.237364 (+3013948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:53.687521 (+450157us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51746: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":4910636,"server-negotiator.queue_time_us":1086754,"spinlock_wait_cycles":14239488}
W20260619 18:45:53.872649 12792 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.904163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51440)
0619 18:45:47.038210 (+134047us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.038260 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.038530 (+ 270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.506780 (+468250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.506821 (+ 41us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.506972 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:47.949824 (+442852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:47.951587 (+ 1763us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.710228 (+758641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.710275 (+ 47us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:48.772452 (+ 62177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.772519 (+ 67us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.569172 (+3796653us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":133538,"mutex_wait_us":2964037,"thread_start_us":121273,"threads_started":1}
W20260619 18:45:53.902343 12816 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:50.599861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51914)
0619 18:45:50.600633 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:50.600702 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:50.600993 (+ 291us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:50.943907 (+342914us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:50.943960 (+ 53us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:50.944080 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:52.518707 (+1574627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.518787 (+ 80us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.896615 (+1377828us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":124,"mutex_wait_us":1716203}
W20260619 18:45:53.902474 12828 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.574680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51790)
0619 18:45:47.666878 (+ 92198us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.668374 (+ 1496us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.699305 (+ 30931us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.949429 (+1250124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.949458 (+ 29us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.949610 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:52.431998 (+3482388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.432074 (+ 76us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.432731 (+ 657us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":50841,"mutex_wait_us":2658973,"thread_start_us":7975,"threads_started":1}
W20260619 18:45:53.899930 12653 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:49.491366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51910 (local address 127.6.120.254:36501)
0619 18:45:50.580923 (+1089557us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:50.580970 (+ 47us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:50.581026 (+ 56us) server_negotiation.cc:407] Connection header received
0619 18:45:50.660995 (+ 79969us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:50.669486 (+ 8491us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:50.750714 (+ 81228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:50.777524 (+ 26810us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:53.250614 (+2473090us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51910: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1495703,"server-negotiator.queue_time_us":1089028}
W20260619 18:45:53.889709 12164 scanner-internal.cc:458] Time spent opening tablet: real 6.398s user 0.010s sys 0.005s
W20260619 18:45:53.903527 12904 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.813603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48678 (local address 127.6.120.193:37901)
0619 18:45:49.596892 (+783289us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:49.599296 (+ 2404us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:49.696656 (+ 97360us) server_negotiation.cc:407] Connection header received
0619 18:45:49.754008 (+ 57352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:49.754043 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:49.754408 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:49.774842 (+ 20434us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:52.066234 (+2291392us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48678: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1994593,"server-negotiator.queue_time_us":725589,"thread_start_us":782776,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:45:53.931867 12896 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.707406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51870)
0619 18:45:49.235196 (+527790us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:49.235283 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:49.235780 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:49.625560 (+389780us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:49.625599 (+ 39us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:49.625722 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:51.063514 (+1437792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:51.064483 (+ 969us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.188547 (+1124064us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":523680,"mutex_wait_us":1575157,"thread_start_us":81763,"threads_started":1}
W20260619 18:45:53.926251 12180 meta_cache.cc:1097] Time spent processing table locations response: real 0.480s user 0.001s sys 0.000s
W20260619 18:45:53.960371 12652 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.196321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51594 (local address 127.6.120.254:36501)
0619 18:45:48.268984 (+1072663us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.270941 (+ 1957us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.288839 (+ 17898us) server_negotiation.cc:407] Connection header received
0619 18:45:48.293319 (+ 4480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.294373 (+ 1054us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.304123 (+ 9750us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.311859 (+ 7736us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:49.911433 (+1599574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.675508 (+2764075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:53.903199 (+1227691us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51594: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":5392450,"server-negotiator.queue_time_us":985573}
W20260619 18:45:53.961731 12551 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.138726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51530 (local address 127.6.120.254:36501)
0619 18:45:47.993165 (+854439us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.995332 (+ 2167us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.000912 (+ 5580us) server_negotiation.cc:407] Connection header received
0619 18:45:48.005611 (+ 4699us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.009366 (+ 3755us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.023609 (+ 14243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.031746 (+ 8137us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:48.751969 (+720223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.810390 (+4058421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:53.948654 (+1138264us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51530: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":5572306,"server-negotiator.queue_time_us":805830}
W20260619 18:45:53.966977 12546 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.710562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51870 (local address 127.6.120.254:36501)
0619 18:45:49.624430 (+913868us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:49.624466 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:49.624510 (+ 44us) server_negotiation.cc:407] Connection header received
0619 18:45:49.624633 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:49.624662 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:49.624914 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:49.625095 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:51.068072 (+1442977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:51.995546 (+927474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:53.248392 (+1252846us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51870: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2948640,"server-negotiator.queue_time_us":913449}
W20260619 18:45:53.972566 12628 meta_cache.cc:1097] Time spent processing table locations response: real 0.078s user 0.001s sys 0.000s
W20260619 18:45:53.979970 12502 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:46.893972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51410 (local address 127.6.120.254:36501)
0619 18:45:47.452909 (+558937us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.452944 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.453005 (+ 61us) server_negotiation.cc:407] Connection header received
0619 18:45:47.453156 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.453180 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.453475 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.453679 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:47.516815 (+ 63136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.046763 (+529948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.888807 (+842044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.941760 (+4052953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:53.252267 (+310507us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51410: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":4618103,"server-negotiator.queue_time_us":555302}
W20260619 18:45:53.999800 12081 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:50.917484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51918 (local address 127.6.120.254:36501)
0619 18:45:51.039499 (+122015us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.039534 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.218945 (+179411us) server_negotiation.cc:407] Connection header received
0619 18:45:51.226155 (+ 7210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.227133 (+ 978us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.252318 (+ 25185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.252532 (+ 214us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:53.995622 (+2743090us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51918: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1197452,"server-negotiator.queue_time_us":120372,"spinlock_wait_cycles":14080}
W20260619 18:45:54.000033 12945 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:49.722605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48698)
0619 18:45:51.044306 (+1321701us) spinlock_profiling.cc:243] Waited 8.84 ms on lock 0x7b4400023f4c. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383d68a95 00007f1383d694b2 00007f138a346511 00007f138a341e1a 00007f1383e385fe 00007f138cc63a39 00007f1383e558bb 00007f1383e53cbf 00007f1383e55e22 00007f138892cc48
0619 18:45:51.231130 (+186824us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.231184 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.231565 (+ 381us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.239420 (+ 7855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.248225 (+ 8805us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.254868 (+ 6643us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:52.972034 (+1717166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.972087 (+ 53us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.961219 (+989132us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1506621,"mutex_wait_us":2495695,"spinlock_wait_cycles":20331392,"thread_start_us":722501,"threads_started":1}
W20260619 18:45:54.004630 12405 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.444300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51762)
0619 18:45:47.445938 (+ 1638us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.445986 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.446258 (+ 272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.596342 (+1150084us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.598615 (+ 2273us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.610468 (+ 11853us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:52.850328 (+4239860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.850387 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.696129 (+845742us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":504,"mutex_wait_us":4952524}
W20260619 18:45:54.043354 12497 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.271313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51606 (local address 127.6.120.254:36501)
0619 18:45:48.533602 (+1262289us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.537697 (+ 4095us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.538540 (+ 843us) server_negotiation.cc:407] Connection header received
0619 18:45:48.542559 (+ 4019us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.544074 (+ 1515us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.562822 (+ 18748us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.567791 (+ 4969us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:50.225774 (+1657983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.810069 (+2584295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:53.870910 (+1060841us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51606: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":3335307,"server-negotiator.queue_time_us":1208087,"spinlock_wait_cycles":1457536}
W20260619 18:45:54.029405 12598 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.834093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51822)
0619 18:45:47.834898 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.834957 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.835207 (+ 250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:49.697773 (+1862566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:49.698848 (+ 1075us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:49.721638 (+ 22790us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:52.306034 (+2584396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.308188 (+ 2154us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.909761 (+1601573us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":351,"mutex_wait_us":4037911}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
I20260619 18:45:54.010818 12576 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:54.058802 12930 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:49.910484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48718)
0619 18:45:50.959928 (+1049444us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:50.965626 (+ 5698us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:50.982244 (+ 16618us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.060950 (+ 78706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.060993 (+ 43us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.061060 (+ 67us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:52.160586 (+1099526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.166240 (+ 5654us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.936563 (+1770323us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1007054,"mutex_wait_us":1785704,"thread_start_us":135102,"threads_started":1}
W20260619 18:45:54.060274 12091 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.017575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51940 (local address 127.6.120.254:36501)
0619 18:45:51.042703 (+ 25128us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.042735 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.042781 (+ 46us) server_negotiation.cc:407] Connection header received
0619 18:45:51.042929 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.042953 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.043203 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.046400 (+ 3197us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:54.058594 (+3012194us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51940: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":976898,"server-negotiator.queue_time_us":24290}
W20260619 18:45:54.053896 12406 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.641819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51806)
0619 18:45:47.654301 (+ 12482us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.654357 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.654594 (+ 237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:49.606044 (+1951450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:49.606080 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:49.606222 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:51.694954 (+2088732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:51.695038 (+ 84us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.847944 (+2152906us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":265,"mutex_wait_us":3976277}
W20260619 18:45:54.056984 12927 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:49.815284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48698 (local address 127.6.120.193:37901)
0619 18:45:50.546973 (+731689us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:50.547013 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.233795 (+686782us) server_negotiation.cc:407] Connection header received
0619 18:45:51.233972 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.233997 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.234319 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.234505 (+ 186us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:53.162864 (+1928359us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48698: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1222208,"server-negotiator.queue_time_us":728743,"thread_start_us":33307,"threads_started":1}
I20260619 18:45:54.067039 12713 scanner-internal.cc:172] Scan of tablet d63b7834d93346288748391962132228 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:54.074478 12135 meta_cache.cc:1097] Time spent processing table locations response: real 0.100s user 0.000s sys 0.001s
W20260619 18:45:54.087303 12576 scanner-internal.cc:458] Time spent opening tablet: real 5.319s user 0.007s sys 0.026s
W20260619 18:45:54.092165 12856 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.045400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48624)
0619 18:45:48.276021 (+230621us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:48.276075 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:48.276465 (+ 390us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.423062 (+146597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.423106 (+ 44us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.423173 (+ 67us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:51.697623 (+3274450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:51.697719 (+ 96us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.162797 (+1465078us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":228844,"mutex_wait_us":4100945,"thread_start_us":199992,"threads_started":1}
W20260619 18:45:54.427961 12916 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:49.587502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48690)
0619 18:45:50.556492 (+968990us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:50.556548 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:50.556895 (+ 347us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:50.561651 (+ 4756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:50.563549 (+ 1898us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:50.572044 (+ 8495us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:52.643493 (+2071449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.643573 (+ 80us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.926907 (+1283334us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":938149,"mutex_wait_us":3128863,"thread_start_us":109340,"threads_started":1}
I20260619 18:45:54.429562 12605 scanner-internal.cc:172] Scan of tablet d63b7834d93346288748391962132228 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:54.430042 12605 scanner-internal.cc:458] Time spent opening tablet: real 5.053s user 0.016s sys 0.015s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:54.092882 12713 scanner-internal.cc:458] Time spent opening tablet: real 5.343s user 0.021s sys 0.040s
W20260619 18:45:54.100437 12491 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.180566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51546 (local address 127.6.120.254:36501)
0619 18:45:48.095835 (+915269us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.095881 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.095942 (+ 61us) server_negotiation.cc:407] Connection header received
0619 18:45:48.098288 (+ 2346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.099623 (+ 1335us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.118461 (+ 18838us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.123440 (+ 4979us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:49.900206 (+1776766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.519906 (+2619700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:53.898236 (+1378330us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51546: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":4109505,"server-negotiator.queue_time_us":898685}
W20260619 18:45:54.459473 12732 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.657152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48562 (local address 127.6.120.193:37901)
0619 18:45:47.672307 (+ 15155us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:47.672348 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:47.679607 (+ 7259us) server_negotiation.cc:407] Connection header received
0619 18:45:47.680379 (+ 772us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:47.680409 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:47.687538 (+ 7129us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b4800081e18. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f138cd02aa0 00007f138cceb061 00007f1388974dbb 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:47.687876 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:47.688124 (+ 248us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:48.137417 (+449293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.771549 (+634132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.812157 (+ 40608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.212457 (+3400300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:53.144657 (+932200us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48562: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":5264276,"server-negotiator.queue_time_us":6057,"spinlock_wait_cycles":3752704}
W20260619 18:45:54.465088 12742 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.012456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48620 (local address 127.6.120.193:37901)
0619 18:45:48.058411 (+ 45955us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.060822 (+ 2411us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.274692 (+213870us) server_negotiation.cc:407] Connection header received
0619 18:45:48.275128 (+ 436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.275166 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.275549 (+ 383us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.275717 (+ 168us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:48.567900 (+292183us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b4800081e18. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:48.856945 (+289045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:52.028284 (+3171339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:53.646566 (+1618282us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48620: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":4432376,"server-negotiator.queue_time_us":8740,"spinlock_wait_cycles":2754816,"thread_start_us":107790,"threads_started":1}
W20260619 18:45:54.466064 12894 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.652387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51844)
0619 18:45:48.835998 (+183611us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:48.836056 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:48.937263 (+101207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:49.623614 (+686351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:49.623654 (+ 40us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:49.623791 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:51.915941 (+2292150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:51.921077 (+ 5136us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.655262 (+1734185us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":182146,"mutex_wait_us":3103192,"thread_start_us":99503,"threads_started":1}
I20260619 18:45:54.466346 12119 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:54.466578 12854 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.995065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48604)
0619 18:45:48.460192 (+465127us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:48.460265 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:48.460667 (+ 402us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.579018 (+118351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.579052 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.579104 (+ 52us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:52.948406 (+4369302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.948468 (+ 62us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.622850 (+674382us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":320978,"mutex_wait_us":3912507,"thread_start_us":262239,"threads_started":1}
W20260619 18:45:54.466830 12119 scanner-internal.cc:458] Time spent opening tablet: real 6.673s user 0.014s sys 0.017s
W20260619 18:45:54.466836 12917 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:49.589048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48684 (local address 127.6.120.193:37901)
0619 18:45:50.519980 (+930932us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:50.520029 (+ 49us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:50.581180 (+ 61151us) server_negotiation.cc:407] Connection header received
0619 18:45:50.581376 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:50.581412 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:50.581837 (+ 425us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:50.582032 (+ 195us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:53.247357 (+2665325us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48684: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1245538,"server-negotiator.queue_time_us":908356,"thread_start_us":117459,"threads_started":1}
W20260619 18:45:54.465345 12932 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:49.856523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48724)
0619 18:45:51.042090 (+1185567us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.042153 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.042522 (+ 369us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.069985 (+ 27463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.071615 (+ 1630us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.075306 (+ 3691us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:52.644166 (+1568860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.644240 (+ 74us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.176793 (+532553us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1125816,"mutex_wait_us":1651156,"thread_start_us":161805,"threads_started":1}
I20260619 18:45:54.505414 12683 scanner-internal.cc:172] Scan of tablet d63b7834d93346288748391962132228 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:54.509996 12683 scanner-internal.cc:458] Time spent opening tablet: real 5.684s user 0.007s sys 0.005s
W20260619 18:45:54.503621 12857 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.072015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51828)
0619 18:45:48.382212 (+310197us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:48.382285 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:48.403218 (+ 20933us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:49.781390 (+1378172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:49.781435 (+ 45us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:49.781615 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:52.487542 (+2705927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.505368 (+ 17826us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.860306 (+1354938us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":261885,"mutex_wait_us":3786529,"thread_start_us":193458,"threads_started":1}
W20260619 18:45:54.511585 12466 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.351590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52010 (local address 127.6.120.254:36501)
0619 18:45:51.355974 (+ 4384us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.356028 (+ 54us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:52.433134 (+1077106us) server_negotiation.cc:407] Connection header received
0619 18:45:52.676577 (+243443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:52.676613 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:52.676888 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:52.677096 (+ 208us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:54.510227 (+1833131us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52010: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":76201,"server-negotiator.queue_time_us":3832}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:54.523614 12058 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.308402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51994 (local address 127.6.120.254:36501)
0619 18:45:51.312764 (+ 4362us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.312795 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.312848 (+ 53us) server_negotiation.cc:407] Connection header received
0619 18:45:51.319755 (+ 6907us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.321208 (+ 1453us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.357404 (+ 36196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.364422 (+ 7018us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:54.508607 (+3144185us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51994: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1489611,"server-negotiator.queue_time_us":3964}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:45:54.541734 12087 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:50.904531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51928 (local address 127.6.120.254:36501)
0619 18:45:51.068135 (+163604us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.069522 (+ 1387us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.428172 (+358650us) server_negotiation.cc:407] Connection header received
0619 18:45:51.437830 (+ 9658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.438377 (+ 547us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.452016 (+ 13639us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.479637 (+ 27621us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:54.049802 (+2570165us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51928: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1162988,"server-negotiator.queue_time_us":127058}
W20260619 18:45:54.604560 12610 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 3.55613e+06us
I20260619 18:45:54.607177 12540 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:54.607677 12540 scanner-internal.cc:458] Time spent opening tablet: real 6.928s user 0.003s sys 0.005s
W20260619 18:45:54.611434 12878 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.526969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48660 (local address 127.6.120.193:37901)
0619 18:45:48.636027 (+109058us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.636936 (+ 909us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.782219 (+145283us) server_negotiation.cc:407] Connection header received
0619 18:45:48.782418 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.782448 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.782802 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.783013 (+ 211us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:51.422045 (+2639032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.608568 (+3186523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:54.609269 (+ 701us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48660: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":5158351,"server-negotiator.queue_time_us":81350,"thread_start_us":42259,"threads_started":1}
W20260619 18:45:54.612763 12490 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.412198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52034 (local address 127.6.120.254:36501)
0619 18:45:51.495198 (+ 83000us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.496960 (+ 1762us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.501227 (+ 4267us) server_negotiation.cc:407] Connection header received
0619 18:45:51.503615 (+ 2388us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.506150 (+ 2535us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.522102 (+ 15952us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.551102 (+ 29000us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:54.611486 (+3060384us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52034: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1216295,"server-negotiator.queue_time_us":82577}
W20260619 18:45:54.613489 12866 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.180810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51830)
0619 18:45:48.541826 (+361016us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:48.541892 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:48.550685 (+ 8793us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:49.695321 (+1144636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:49.697283 (+ 1962us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:49.698308 (+ 1025us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:53.139312 (+3441004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:53.144145 (+ 4833us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.066532 (+922387us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":319443,"mutex_wait_us":4030018,"thread_start_us":51934,"threads_started":1}
W20260619 18:45:54.593571 12928 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:49.772599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48710)
0619 18:45:50.848037 (+1075438us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:50.848164 (+ 127us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:50.848704 (+ 540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:50.853001 (+ 4297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:50.853564 (+ 563us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:50.864729 (+ 11165us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:52.486882 (+1622153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.486973 (+ 91us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.888234 (+1401261us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":866206,"mutex_wait_us":2394839,"thread_start_us":64994,"threads_started":1}
I20260619 18:45:54.634871 12177 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:54.636142 12462 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:50.967236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51940)
0619 18:45:50.968771 (+ 1535us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:50.968821 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:50.969076 (+ 255us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.049692 (+ 80616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.051116 (+ 1424us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.062220 (+ 11104us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:54.497963 (+3435743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:54.505814 (+ 7851us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.616055 (+110241us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1097,"mutex_wait_us":3491104}
W20260619 18:45:54.640221 12620 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.751908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51884 (local address 127.6.120.254:36501)
0619 18:45:50.596455 (+1844547us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:50.596489 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:50.596547 (+ 58us) server_negotiation.cc:407] Connection header received
0619 18:45:50.596690 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:50.596716 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:50.596970 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:50.597182 (+ 212us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:51.695810 (+1098628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.052702 (+2356892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:54.638622 (+585920us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51884: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":3492915,"server-negotiator.queue_time_us":1809575}
W20260619 18:45:54.635950 12177 scanner-internal.cc:458] Time spent opening tablet: real 5.262s user 0.004s sys 0.047s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:54.729797 12863 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.358661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48764 (local address 127.6.120.193:37901)
0619 18:45:52.166343 (+807682us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:52.167468 (+ 1125us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:52.168535 (+ 1067us) server_negotiation.cc:407] Connection header received
0619 18:45:52.172284 (+ 3749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:52.174971 (+ 2687us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:52.214658 (+ 39687us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:52.214869 (+ 211us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:54.510999 (+2296130us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48764: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1532634,"server-negotiator.queue_time_us":675500,"thread_start_us":1497635,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:45:54.727715 12877 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.508571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48650 (local address 127.6.120.193:37901)
0619 18:45:48.571313 (+ 62742us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:48.571377 (+ 64us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:48.571436 (+ 59us) server_negotiation.cc:407] Connection header received
0619 18:45:48.599082 (+ 27646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:48.601254 (+ 2172us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:48.618150 (+ 16896us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:48.634223 (+ 16073us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:51.428580 (+2794357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:53.897486 (+2468906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:54.049533 (+152047us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48650: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":4036289,"server-negotiator.queue_time_us":61477,"thread_start_us":51985,"threads_started":1}
W20260619 18:45:54.737046 12532 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.705241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48580)
0619 18:45:47.736117 (+ 30876us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.736193 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.736607 (+ 414us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:48.035016 (+298409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:48.036380 (+ 1364us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:48.042626 (+ 6246us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:48.089653 (+ 47027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.089728 (+ 75us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.935668 (+845940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.935718 (+ 50us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:53.714784 (+4779066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:53.725277 (+ 10493us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.071148 (+345871us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":2509,"mutex_wait_us":4920683}
W20260619 18:45:54.749527 12913 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:49.577414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48684)
0619 18:45:50.580370 (+1002956us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:50.580464 (+ 94us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:50.580889 (+ 425us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:50.618482 (+ 37593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:50.623998 (+ 5516us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:50.626709 (+ 2711us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:53.681237 (+3054528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:53.698563 (+ 17326us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.075874 (+377311us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":922358,"mutex_wait_us":3033454,"thread_start_us":21250,"threads_started":1}
W20260619 18:45:54.745416 12905 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:48.856236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48678)
0619 18:45:49.628970 (+772734us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:49.675816 (+ 46846us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:49.710277 (+ 34461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:49.775146 (+ 64869us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:49.775192 (+ 46us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:49.775259 (+ 67us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:53.741986 (+3966727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:53.752036 (+ 10050us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.052473 (+300437us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":691912,"mutex_wait_us":3941768,"thread_start_us":670981,"threads_started":1}
W20260619 18:45:54.751382 12563 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:50.601244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51914 (local address 127.6.120.254:36501)
0619 18:45:50.942990 (+341746us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:50.943041 (+ 51us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:50.943123 (+ 82us) server_negotiation.cc:407] Connection header received
0619 18:45:50.943275 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:50.943302 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:50.943579 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:50.944176 (+ 597us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:52.521626 (+1577450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.433036 (+1911410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:54.641752 (+208716us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51914: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1670822,"server-negotiator.queue_time_us":328755}
W20260619 18:45:54.753661 12455 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.043992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51962)
0619 18:45:51.084122 (+ 40130us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.085229 (+ 1107us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.115031 (+ 29802us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.161609 (+ 46578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.163046 (+ 1437us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.165166 (+ 2120us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:52.508940 (+1343774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.509013 (+ 73us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.457692 (+1948679us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1633,"mutex_wait_us":1679088}
W20260619 18:45:54.755579 12437 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.043790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51948)
0619 18:45:51.074756 (+ 30966us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.083333 (+ 8577us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.102507 (+ 19174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.147289 (+ 44782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.148022 (+ 733us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.165253 (+ 17231us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:52.436430 (+1271177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.436523 (+ 93us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.464490 (+2027967us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1741,"mutex_wait_us":1505002}
W20260619 18:45:54.757261 12942 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:50.978075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48732)
0619 18:45:51.246451 (+268376us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.246534 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.246888 (+ 354us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.352195 (+105307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.353251 (+ 1056us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.356795 (+ 3544us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:53.855322 (+2498527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:53.860515 (+ 5193us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.422588 (+562073us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":250740,"mutex_wait_us":1866111,"thread_start_us":134143,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:54.759378 12614 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.050133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51962 (local address 127.6.120.254:36501)
0619 18:45:51.058908 (+ 8775us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.058957 (+ 49us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.094361 (+ 35404us) server_negotiation.cc:407] Connection header received
0619 18:45:51.123353 (+ 28992us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.129218 (+ 5865us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.144563 (+ 15345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.148201 (+ 3638us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:52.509376 (+1361175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.612337 (+2102961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:54.614973 (+ 2636us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51962: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2462324,"server-negotiator.queue_time_us":8358,"spinlock_wait_cycles":1323264}
I20260619 18:45:54.759110 12159 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
I20260619 18:45:54.783900 12132 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:54.765645 12814 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.041293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51946)
0619 18:45:51.074735 (+ 33442us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.083258 (+ 8523us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.103263 (+ 20005us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.189741 (+ 86478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.189777 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.189912 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:52.485874 (+1295962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.485960 (+ 86us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.606614 (+2120654us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":4413,"mutex_wait_us":1788756}
I20260619 18:45:54.761623 12676 scanner-internal.cc:172] Scan of tablet d63b7834d93346288748391962132228 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:54.779996 12595 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.049670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51948 (local address 127.6.120.254:36501)
0619 18:45:51.059669 (+ 9999us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.059706 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.084918 (+ 25212us) server_negotiation.cc:407] Connection header received
0619 18:45:51.120324 (+ 35406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.123527 (+ 3203us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.139457 (+ 15930us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.146701 (+ 7244us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:52.519346 (+1372645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.638432 (+2119086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:54.639179 (+ 747us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51948: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":3405596,"server-negotiator.queue_time_us":6576}
W20260619 18:45:54.789423 12608 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.151957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51972 (local address 127.6.120.254:36501)
0619 18:45:51.247183 (+ 95226us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.247222 (+ 39us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.247274 (+ 52us) server_negotiation.cc:407] Connection header received
0619 18:45:51.247403 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.247453 (+ 50us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.252318 (+ 4865us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.252532 (+ 214us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:53.988724 (+2736192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.608839 (+620115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:54.609385 (+ 546us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51972: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2137667,"server-negotiator.queue_time_us":94784,"spinlock_wait_cycles":22656}
W20260619 18:45:54.834110 12132 scanner-internal.cc:458] Time spent opening tablet: real 4.286s user 0.003s sys 0.006s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:45:54.843248 12413 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.427874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52048 (local address 127.6.120.254:36501)
0619 18:45:51.960231 (+532357us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.960267 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:52.487486 (+527219us) server_negotiation.cc:407] Connection header received
0619 18:45:52.608275 (+120789us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:52.608314 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:52.608654 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:52.611956 (+ 3302us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:54.552826 (+1940870us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52048: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":934142,"server-negotiator.queue_time_us":531882}
W20260619 18:45:54.847501 12926 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:49.882738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48724 (local address 127.6.120.193:37901)
0619 18:45:50.547810 (+665072us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:50.547852 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.046020 (+498168us) server_negotiation.cc:407] Connection header received
0619 18:45:51.054886 (+ 8866us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.055932 (+ 1046us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.065560 (+ 9628us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.067781 (+ 2221us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:52.677516 (+1609735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.641921 (+1964405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:54.642654 (+ 733us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48724: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":3156138,"server-negotiator.queue_time_us":664504,"thread_start_us":464521,"threads_started":1}
W20260619 18:45:54.848956 12547 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.166547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51972)
0619 18:45:51.167189 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.167255 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.167566 (+ 311us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.252863 (+ 85297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.252897 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.253031 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:53.971845 (+2718814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:53.978248 (+ 6403us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.783493 (+805245us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":118,"mutex_wait_us":2984248}
I20260619 18:45:54.777508 12692 scanner-internal.cc:172] Scan of tablet d63b7834d93346288748391962132228 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:54.790778 12907 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:49.257325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51910)
0619 18:45:50.565697 (+1308372us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:50.572341 (+ 6644us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:50.635996 (+ 63655us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:50.800619 (+164623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:50.802158 (+ 1539us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:50.837232 (+ 35074us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:53.999885 (+3162653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:53.999958 (+ 73us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.518110 (+518152us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1235246,"mutex_wait_us":2895537,"thread_start_us":337942,"threads_started":1}
W20260619 18:45:54.852437 12676 scanner-internal.cc:458] Time spent opening tablet: real 6.280s user 0.010s sys 0.010s
W20260619 18:45:54.857707 12692 scanner-internal.cc:458] Time spent opening tablet: real 6.155s user 0.006s sys 0.017s
W20260619 18:45:54.858273 12159 scanner-internal.cc:458] Time spent opening tablet: real 7.256s user 0.004s sys 0.021s
W20260619 18:45:54.888984 12908 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.635s user 0.000s sys 0.003s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:45:54.887183 12781 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.180s user 0.019s sys 0.016s
W20260619 18:45:54.922811 12554 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.393802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52018)
0619 18:45:51.428493 (+ 34691us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.428554 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.428816 (+ 262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.489060 (+ 60244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.489108 (+ 48us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.489286 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:52.522567 (+1033281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.522641 (+ 74us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.565289 (+2042648us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1949,"mutex_wait_us":1105099}
W20260619 18:45:54.950876 12780 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.191s user 0.006s sys 0.035s
W20260619 18:45:54.951339 12780 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.200s user 0.006s sys 0.035s
W20260619 18:45:54.927845 12961 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.263s user 0.016s sys 0.025s
W20260619 18:45:54.929519 12908 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.682s user 0.000s sys 0.004s
W20260619 18:45:54.948688 12582 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:47.007919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51490)
0619 18:45:47.037502 (+ 29583us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:47.037560 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:47.037894 (+ 334us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:47.664190 (+626296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:47.664246 (+ 56us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:47.664443 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:48.049938 (+385495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:48.053407 (+ 3469us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:48.761186 (+707779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:48.762350 (+ 1164us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:53.922243 (+5159893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:53.931439 (+ 9196us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.496786 (+565347us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":16582,"mutex_wait_us":5453944,"thread_start_us":113737,"threads_started":1}
W20260619 18:45:54.953727 12574 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.132866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51970)
0619 18:45:51.165948 (+ 33082us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.166042 (+ 94us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.166350 (+ 308us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.237131 (+ 70781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.247884 (+ 10753us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.296789 (+ 48905us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:52.841067 (+1544278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.849957 (+ 8890us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.601170 (+1751213us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":408,"mutex_wait_us":1549767}
W20260619 18:45:54.956614 12910 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.258s user 0.016s sys 0.025s
W20260619 18:45:54.998188 12910 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.311s user 0.016s sys 0.026s
W20260619 18:45:54.945365 12781 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.248s user 0.020s sys 0.016s
W20260619 18:45:55.000588 12903 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.377s user 0.006s sys 0.036s
W20260619 18:45:55.001616 12903 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.393s user 0.006s sys 0.037s
W20260619 18:45:55.002904 12836 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.254867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51986)
0619 18:45:51.305291 (+ 50424us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.305344 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.305656 (+ 312us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.415060 (+109404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.415115 (+ 55us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.415283 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:53.992260 (+2576977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:54.000612 (+ 8352us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.001316 (+1000704us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":406,"mutex_wait_us":3045949}
W20260619 18:45:55.005398 12853 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:49.909661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48718 (local address 127.6.120.193:37901)
0619 18:45:51.060018 (+1150357us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.060054 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.060148 (+ 94us) server_negotiation.cc:407] Connection header received
0619 18:45:51.060314 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.060352 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.060701 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.060898 (+ 197us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:52.170893 (+1109995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.636902 (+2466009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:55.003796 (+366894us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48718: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":3528934,"server-negotiator.queue_time_us":1149625,"thread_start_us":53810,"threads_started":1}
W20260619 18:45:55.007282 12544 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.046849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51946 (local address 127.6.120.254:36501)
0619 18:45:51.060003 (+ 13154us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.060034 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.086963 (+ 26929us) server_negotiation.cc:407] Connection header received
0619 18:45:51.120262 (+ 33299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.123472 (+ 3210us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.188885 (+ 65413us) spinlock_profiling.cc:243] Waited 7.38 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:51.189218 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.189658 (+ 440us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:52.486326 (+1296668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.861777 (+2375451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:54.999864 (+138087us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51946: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2850948,"server-negotiator.queue_time_us":6144,"spinlock_wait_cycles":16966016}
W20260619 18:45:54.955539 12961 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.291s user 0.016s sys 0.026s
W20260619 18:45:54.952687 12765 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.193s user 0.011s sys 0.030s
W20260619 18:45:55.015013 12715 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.971s user 0.004s sys 0.008s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:55.017844 12531 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.057915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51966)
0619 18:45:51.067921 (+ 10006us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.067974 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.072887 (+ 4913us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.165044 (+ 92157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.165088 (+ 44us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.165224 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:52.431711 (+1266487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.431802 (+ 91us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.729047 (+2297245us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":847,"mutex_wait_us":1376652}
W20260619 18:45:55.026968 12715 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.983s user 0.004s sys 0.009s
W20260619 18:45:55.019520 12765 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.267s user 0.012s sys 0.030s
W20260619 18:45:55.012751 12947 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 2.557s user 0.008s sys 0.043s
W20260619 18:45:55.061239 12823 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.306213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51994)
0619 18:45:51.312617 (+ 6404us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.312671 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.312957 (+ 286us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.377608 (+ 64651us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.385315 (+ 7707us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.412423 (+ 27108us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:54.645678 (+3233255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:54.675059 (+ 29381us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.860767 (+185708us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1791,"mutex_wait_us":3194619}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:55.050843 12956 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.088s user 0.002s sys 0.012s
W20260619 18:45:55.059474 12947 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 2.604s user 0.008s sys 0.044s
W20260619 18:45:55.063177 12957 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.235380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48746 (local address 127.6.120.193:37901)
0619 18:45:51.590964 (+355584us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.937654 (+346690us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.937733 (+ 79us) server_negotiation.cc:407] Connection header received
0619 18:45:51.951014 (+ 13281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.953999 (+ 2985us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.992676 (+ 38677us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:52.005054 (+ 12378us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:54.775858 (+2770804us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48746: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":871793,"server-negotiator.queue_time_us":353528,"thread_start_us":146182,"threads_started":1}
W20260619 18:45:55.076542 12583 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.024946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52104)
0619 18:45:52.160578 (+135632us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:52.165080 (+ 4502us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:52.171639 (+ 6559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:52.809948 (+638309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:52.809989 (+ 41us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:52.810124 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:53.916521 (+1106397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:53.925690 (+ 9169us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.073725 (+1148035us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":2062,"mutex_wait_us":1060432}
W20260619 18:45:55.077623 12585 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.028019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52108 (local address 127.6.120.254:36501)
0619 18:45:52.552248 (+524229us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:52.606802 (+ 54554us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:52.692355 (+ 85553us) server_negotiation.cc:407] Connection header received
0619 18:45:52.800903 (+108548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:52.826576 (+ 25673us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:52.840975 (+ 14399us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:52.851133 (+ 10158us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.076276 (+2225143us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52108: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":996557,"server-negotiator.queue_time_us":340275}
W20260619 18:45:55.078338 12691 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.421050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52034)
0619 18:45:51.451914 (+ 30864us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.453218 (+ 1304us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.485710 (+ 32492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.556317 (+ 70607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.574029 (+ 17712us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.657437 (+ 83408us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:54.730850 (+3073413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:54.734780 (+ 3930us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.923054 (+188274us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":740,"mutex_wait_us":3042377}
W20260619 18:45:55.087652 12632 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.393699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52018 (local address 127.6.120.254:36501)
0619 18:45:51.487901 (+ 94202us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.487946 (+ 45us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.488023 (+ 77us) server_negotiation.cc:407] Connection header received
0619 18:45:51.488272 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.488311 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.488650 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.489388 (+ 738us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:52.641591 (+1152203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.964879 (+2323288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:55.065744 (+100865us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52018: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":3343073,"server-negotiator.queue_time_us":93609}
W20260619 18:45:55.094651 12591 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.028515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52118 (local address 127.6.120.254:36501)
0619 18:45:52.677301 (+648786us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:52.677328 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:52.677390 (+ 62us) server_negotiation.cc:407] Connection header received
0619 18:45:52.677519 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:52.677546 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:52.734440 (+ 56894us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:52.868337 (+133897us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.093608 (+2225271us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52118: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2155159,"server-negotiator.queue_time_us":648125}
W20260619 18:45:55.099359 12636 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.011861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52104 (local address 127.6.120.254:36501)
0619 18:45:52.482680 (+470819us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:52.503111 (+ 20431us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:52.506450 (+ 3339us) server_negotiation.cc:407] Connection header received
0619 18:45:52.530993 (+ 24543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:52.586840 (+ 55847us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:52.697210 (+110370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:52.809549 (+112339us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:52.983033 (+173484us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:54.615371 (+1632338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.097580 (+482209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:55.098062 (+ 482us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52104: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2092236,"server-negotiator.queue_time_us":317464,"spinlock_wait_cycles":40666496}
W20260619 18:45:55.101820 12492 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.032834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52118)
0619 18:45:52.159675 (+126841us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:52.161126 (+ 1451us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:52.169888 (+ 8762us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:52.872279 (+702391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:52.877002 (+ 4723us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:52.940451 (+ 63449us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.100214 (+2159763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.100269 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.100732 (+ 463us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":2026,"mutex_wait_us":1409383}
W20260619 18:45:55.073879 12956 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.111s user 0.002s sys 0.012s
W20260619 18:45:55.116212 12920 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.030s user 0.042s sys 0.051s
W20260619 18:45:55.116662 12920 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.035s user 0.042s sys 0.051s
W20260619 18:45:55.106593 12960 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.039s user 0.005s sys 0.008s
W20260619 18:45:55.112208 12931 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.057s user 0.070s sys 0.049s
W20260619 18:45:55.117592 12953 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.189870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48754)
0619 18:45:51.589081 (+399211us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.589171 (+ 90us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.589635 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.653113 (+ 63478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.658097 (+ 4984us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.665030 (+ 6933us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:52.982594 (+1317564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:53.016125 (+ 33531us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.949703 (+1933578us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":398432,"mutex_wait_us":1546611,"thread_start_us":229518,"threads_started":1}
W20260619 18:45:55.118741 12969 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 1.040s user 0.007s sys 0.007s
W20260619 18:45:55.141196 12940 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:50.884410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51918)
0619 18:45:51.216060 (+331650us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.216164 (+ 104us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.216582 (+ 418us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.283285 (+ 66703us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.283792 (+ 507us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.297580 (+ 13788us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:54.472853 (+3175273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:54.495501 (+ 22648us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.960409 (+464908us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":330919,"mutex_wait_us":3089962,"thread_start_us":316712,"threads_started":1}
W20260619 18:45:55.143555 12931 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.116s user 0.071s sys 0.050s
W20260619 18:45:55.118852 12951 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.077s user 0.003s sys 0.011s
W20260619 18:45:55.143493 12960 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.086s user 0.005s sys 0.009s
W20260619 18:45:55.146744 12969 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 1.072s user 0.007s sys 0.008s
W20260619 18:45:55.145407 12949 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:50.905773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:51928)
0619 18:45:51.063165 (+157392us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b4400023f4c. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383d68a95 00007f1383d694b2 00007f138a346511 00007f138a341e1a 00007f1383e385fe 00007f138cc63a39 00007f1383e558bb 00007f1383e53cbf 00007f1383e55e22 00007f138892cc48
0619 18:45:51.424656 (+361491us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.426869 (+ 2213us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.433045 (+ 6176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:51.485455 (+ 52410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:51.486495 (+ 1040us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:51.492548 (+ 6053us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:54.637509 (+3144961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:54.637576 (+ 67us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:54.961423 (+323847us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":446394,"mutex_wait_us":2879776,"spinlock_wait_cycles":27723648,"thread_start_us":209456,"threads_started":1}
W20260619 18:45:55.118608 12975 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.467s user 0.003s sys 0.013s
W20260619 18:45:55.163857 12950 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.054311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48746)
0619 18:45:51.246898 (+192587us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.246954 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.247285 (+ 331us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:52.006298 (+759013us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:52.008191 (+ 1893us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:52.008251 (+ 60us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:54.957150 (+2948899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:54.965443 (+ 8293us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.067234 (+101791us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":184768,"mutex_wait_us":2392042,"thread_start_us":63369,"threads_started":1}
W20260619 18:45:55.157191 12681 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.018761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52092)
0619 18:45:52.158749 (+139988us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:52.160038 (+ 1289us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:52.168861 (+ 8823us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:52.187897 (+ 19036us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:52.187939 (+ 42us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:52.188195 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:54.673984 (+2485789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:54.728487 (+ 54503us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.053187 (+324700us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1677,"mutex_wait_us":2444658}
W20260619 18:45:55.156397 12975 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.505s user 0.003s sys 0.013s
W20260619 18:45:55.151116 12951 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.109s user 0.003s sys 0.012s
W20260619 18:45:55.162468 12970 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.530399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48780 (local address 127.6.120.193:37901)
0619 18:45:52.506178 (+975779us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:52.506228 (+ 50us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:52.970576 (+464348us) server_negotiation.cc:407] Connection header received
0619 18:45:52.982113 (+ 11537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:52.982151 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:53.082023 (+ 99872us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:53.113781 (+ 31758us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:55.044225 (+1930444us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48780: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1171872,"server-negotiator.queue_time_us":865020,"thread_start_us":1575766,"threads_started":1}
W20260619 18:45:55.178407 12933 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:50.971920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48732 (local address 127.6.120.193:37901)
0619 18:45:51.227884 (+255964us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.229065 (+ 1181us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.247762 (+ 18697us) server_negotiation.cc:407] Connection header received
0619 18:45:51.291590 (+ 43828us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.298627 (+ 7037us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.321494 (+ 22867us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.331352 (+ 9858us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:55.065789 (+3734437us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48732: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":3132184,"server-negotiator.queue_time_us":168908,"thread_start_us":240801,"threads_started":1}
W20260619 18:45:55.258267 10948 thread.cc:636] server-negotiator [worker] (thread pool) Time spent creating pthread: real 1.423s user 0.008s sys 0.003s
W20260619 18:45:55.259262 10948 thread.cc:602] server-negotiator [worker] (thread pool) Time spent starting thread: real 1.430s user 0.008s sys 0.004s
W20260619 18:45:55.286670 12141 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.209s user 0.009s sys 0.003s
W20260619 18:45:55.287293 12141 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.209s user 0.009s sys 0.004s
W20260619 18:45:55.288442 12165 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.225s user 0.005s sys 0.008s
W20260619 18:45:55.288992 12165 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.226s user 0.005s sys 0.009s
W20260619 18:45:55.289721 12135 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.859s user 0.021s sys 0.022s
W20260619 18:45:55.290218 12135 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.859s user 0.021s sys 0.022s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:55.294567 12229 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 256956us
W20260619 18:45:55.296679 12234 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.513s user 0.007s sys 0.007s
W20260619 18:45:55.297137 12234 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.513s user 0.007s sys 0.007s
W20260619 18:45:55.045460 12248 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.943s user 0.004s sys 0.009s
W20260619 18:45:55.299932 12248 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.197s user 0.005s sys 0.009s
W20260619 18:45:55.309581 12317 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 2.072s user 0.004s sys 0.010s
W20260619 18:45:55.310158 12317 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 2.072s user 0.004s sys 0.010s
I20260619 18:45:55.311211 12149 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:55.314456 12369 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.556s user 0.002s sys 0.012s
W20260619 18:45:55.314939 12369 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.557s user 0.002s sys 0.012s
W20260619 18:45:55.322063 12444 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.972117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52076)
0619 18:45:52.032457 (+ 60340us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:52.034023 (+ 1566us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:52.066330 (+ 32307us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:52.220399 (+154069us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:52.296461 (+ 76062us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:52.316444 (+ 19983us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:52.891003 (+574559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:52.911544 (+ 20541us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.320167 (+2408623us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":5886,"mutex_wait_us":516406}
I20260619 18:45:55.321717 12153 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:55.323686 12153 scanner-internal.cc:458] Time spent opening tablet: real 4.769s user 0.004s sys 0.011s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:55.329540 12485 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.971930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52064)
0619 18:45:51.972557 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.977559 (+ 5002us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.989281 (+ 11722us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:52.164834 (+175553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:52.165757 (+ 923us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:52.165922 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:54.600617 (+2434695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:54.604426 (+ 3809us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.046738 (+442312us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":88,"mutex_wait_us":2371783}
W20260619 18:45:55.333122 12507 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.021478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52090)
0619 18:45:52.164207 (+142729us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:52.164288 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:52.164586 (+ 298us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:52.211536 (+ 46950us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:52.296264 (+ 84728us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:52.311528 (+ 15264us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:53.903900 (+1592372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:53.918480 (+ 14580us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.063383 (+1144903us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":2089,"mutex_wait_us":1544744}
W20260619 18:45:55.337844 12558 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.007970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52090 (local address 127.6.120.254:36501)
0619 18:45:52.137347 (+129377us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:52.138448 (+ 1101us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:52.164410 (+ 25962us) server_negotiation.cc:407] Connection header received
0619 18:45:52.166534 (+ 2124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:52.167693 (+ 1159us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:52.189351 (+ 21658us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:52.210681 (+ 21330us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:53.939221 (+1728540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.091725 (+1152504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:55.109459 (+ 17734us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52090: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1645204,"server-negotiator.queue_time_us":7905}
W20260619 18:45:55.342526 12149 scanner-internal.cc:458] Time spent opening tablet: real 5.564s user 0.028s sys 0.041s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:45:55.345522 12431 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.030966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52120)
0619 18:45:52.156901 (+125935us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:52.156957 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:52.159141 (+ 2184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:53.026901 (+867760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:53.026941 (+ 40us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:53.033447 (+ 6506us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:54.638150 (+1604703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:54.638213 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.319985 (+681772us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":513,"mutex_wait_us":1563966}
W20260619 18:45:55.346668 12628 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.501s user 0.008s sys 0.008s
W20260619 18:45:55.347079 12628 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.502s user 0.008s sys 0.008s
W20260619 18:45:55.347608 12619 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.291995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51986 (local address 127.6.120.254:36501)
0619 18:45:51.357281 (+ 65286us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.358895 (+ 1614us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.359892 (+ 997us) server_negotiation.cc:407] Connection header received
0619 18:45:51.376646 (+ 16754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.383414 (+ 6768us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.414244 (+ 30830us) spinlock_profiling.cc:243] Waited 961 us on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:51.414523 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.414776 (+ 253us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:54.027192 (+2612416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.091438 (+1064246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:55.091964 (+ 526us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51986: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2163128,"server-negotiator.queue_time_us":102,"spinlock_wait_cycles":2210048}
W20260619 18:45:55.367241 12187 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.138947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51970 (local address 127.6.120.254:36501)
0619 18:45:51.232979 (+ 94032us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.233015 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.233077 (+ 62us) server_negotiation.cc:407] Connection header received
0619 18:45:51.233218 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.233253 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.233522 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.235914 (+ 2392us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:51.305031 (+ 69117us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:52.850266 (+1545235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.291093 (+2440827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:55.365428 (+ 74335us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51970: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":3350617,"server-negotiator.queue_time_us":93570,"spinlock_wait_cycles":5273984}
W20260619 18:45:55.592900 12568 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 2.501s user 0.027s sys 0.038s
W20260619 18:45:55.593405 12568 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 2.553s user 0.027s sys 0.038s
W20260619 18:45:55.630565 12981 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.513s user 0.011s sys 0.011s
W20260619 18:45:55.605225 12903 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.541s user 0.007s sys 0.028s
W20260619 18:45:55.623499 12910 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.545s user 0.026s sys 0.009s
W20260619 18:45:55.632263 12991 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.686s user 0.005s sys 0.032s
W20260619 18:45:55.650995 12180 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.722s user 0.013s sys 0.003s
W20260619 18:45:55.651134 12903 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.647s user 0.008s sys 0.029s
W20260619 18:45:55.653177 12947 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.535s user 0.003s sys 0.033s
W20260619 18:45:55.656323 12180 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.810s user 0.014s sys 0.004s
W20260619 18:45:55.653528 12910 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.655s user 0.026s sys 0.010s
W20260619 18:45:55.666186 12549 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.028489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52108)
0619 18:45:52.160549 (+132060us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:52.165055 (+ 4506us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:52.173823 (+ 8768us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:52.849833 (+676010us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:52.849880 (+ 47us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:52.850017 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.338103 (+2488086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.338201 (+ 98us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.664726 (+326525us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1755,"mutex_wait_us":2776235}
W20260619 18:45:55.655479 12991 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.799s user 0.005s sys 0.033s
W20260619 18:45:55.676095 12947 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.585s user 0.003s sys 0.034s
W20260619 18:45:55.707865 12993 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.504s user 0.007s sys 0.009s
W20260619 18:45:55.819947 12992 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.516s user 0.010s sys 0.054s
W20260619 18:45:55.987355 12983 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.205441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48798)
0619 18:45:53.764721 (+1559280us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.775174 (+ 10453us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.849520 (+ 74346us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:53.981809 (+132289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:53.985459 (+ 3650us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:53.996958 (+ 11499us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:55.099783 (+1102825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.099842 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.950363 (+850521us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":941696,"mutex_wait_us":1794774,"thread_start_us":1584537,"threads_started":1}
I20260619 18:45:55.990449 12694 scanner-internal.cc:172] Scan of tablet d63b7834d93346288748391962132228 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:55.991155 12694 scanner-internal.cc:458] Time spent opening tablet: real 4.755s user 0.008s sys 0.019s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:45:56.020664 12967 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.481370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52048)
0619 18:45:52.475657 (+994287us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:52.483464 (+ 7807us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:52.574040 (+ 90576us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:52.625950 (+ 51910us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:52.631186 (+ 5236us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:52.830298 (+199112us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.170727 (+2340429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.171763 (+ 1036us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.917931 (+746168us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":965536,"mutex_wait_us":2475224,"thread_start_us":1636171,"threads_started":1}
W20260619 18:45:56.030503 12604 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.026206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52174 (local address 127.6.120.254:36501)
0619 18:45:53.241105 (+214899us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.247069 (+ 5964us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:53.249053 (+ 1984us) server_negotiation.cc:407] Connection header received
0619 18:45:53.607933 (+358880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:53.622558 (+ 14625us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:53.709365 (+ 86807us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:53.738691 (+ 29326us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:53.992925 (+254234us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:55.021393 (+1028468us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:56.028785 (+1007392us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52174: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1624228,"server-negotiator.queue_time_us":90148,"spinlock_wait_cycles":62796416}
W20260619 18:45:56.034260 12966 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.412330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52010)
0619 18:45:52.431969 (+1019639us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:52.432054 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:52.676250 (+244196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:52.801835 (+125585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:52.812166 (+ 10331us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:52.863117 (+ 50951us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.026088 (+3162971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.026168 (+ 80us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.026812 (+ 644us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":969204,"mutex_wait_us":2925954,"thread_start_us":1459278,"threads_started":1}
W20260619 18:45:56.050570 12977 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.007956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48784)
0619 18:45:53.088546 (+1080590us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.088648 (+ 102us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.089157 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:53.774463 (+685306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:53.784232 (+ 9769us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:53.825873 (+ 41641us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:55.092593 (+1266720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.092651 (+ 58us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.882297 (+789646us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1079925,"mutex_wait_us":1932622,"thread_start_us":387535,"threads_started":1}
I20260619 18:45:56.051789 12714 scanner-internal.cc:172] Scan of tablet d63b7834d93346288748391962132228 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:56.052597 12714 scanner-internal.cc:458] Time spent opening tablet: real 4.805s user 0.011s sys 0.056s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:56.491889 12621 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.531s user 0.017s sys 0.097s
W20260619 18:45:56.506569 11040 thread.cc:636] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.501s user 0.055s sys 0.052s
W20260619 18:45:56.506965 11040 thread.cc:602] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.509s user 0.055s sys 0.052s
W20260619 18:45:56.495893 12621 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.566s user 0.018s sys 0.098s
W20260619 18:45:56.522701 12634 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.062001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51966 (local address 127.6.120.254:36501)
0619 18:45:51.161181 (+ 99180us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.161228 (+ 47us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.161302 (+ 74us) server_negotiation.cc:407] Connection header received
0619 18:45:51.161497 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.163014 (+ 1517us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.164657 (+ 1643us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.164949 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:51.254228 (+ 89279us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:52.485410 (+1231182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.349817 (+2864407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.521240 (+1171423us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:51966: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":4773772,"server-negotiator.queue_time_us":77604,"spinlock_wait_cycles":6605184}
W20260619 18:45:56.539043 12480 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.139695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48784 (local address 127.6.120.193:37901)
0619 18:45:53.247798 (+108103us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.249390 (+ 1592us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:53.256638 (+ 7248us) server_negotiation.cc:407] Connection header received
0619 18:45:53.640849 (+384211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:53.653581 (+ 12732us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:53.743850 (+ 90269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:53.772082 (+ 28232us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:56.537568 (+2765486us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48784: BlockingRecv error: recv got EOF from 127.0.0.1:48784 (error 108)
Metrics: {"mutex_wait_us":1439680,"server-negotiator.queue_time_us":85000,"thread_start_us":68985,"threads_started":1}
W20260619 18:45:56.545835 12918 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:49.754144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48710 (local address 127.6.120.193:37901)
0619 18:45:50.516851 (+762707us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:50.516886 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:50.848969 (+332083us) server_negotiation.cc:407] Connection header received
0619 18:45:50.849180 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:50.849217 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:50.849681 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:50.849883 (+ 202us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:52.506044 (+1656161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.148271 (+2642227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.542758 (+1394487us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48710: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":4293794,"server-negotiator.queue_time_us":762229,"thread_start_us":127942,"threads_started":1}
W20260619 18:45:56.542203 12535 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.661157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52222 (local address 127.6.120.254:36501)
0619 18:45:53.879793 (+218636us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.884772 (+ 4979us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:55.096157 (+1211385us) server_negotiation.cc:407] Connection header received
0619 18:45:55.096287 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:55.096312 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.096560 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.096739 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.534031 (+1437292us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52222: received 0 of 154 requested bytes
Metrics: {"mutex_wait_us":88914,"server-negotiator.queue_time_us":53408}
W20260619 18:45:56.576856 12722 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.907840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52130)
0619 18:45:53.113936 (+206096us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.117477 (+ 3541us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.139263 (+ 21786us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:53.661828 (+522565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:53.665829 (+ 4001us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:53.737705 (+ 71876us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.163746 (+1426041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.163811 (+ 65us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.575326 (+1411515us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1165,"mutex_wait_us":1480688}
W20260619 18:45:56.580634 12897 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.229838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52194)
0619 18:45:53.770293 (+540455us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.775730 (+ 5437us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.828473 (+ 52743us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:53.944211 (+115738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:53.949821 (+ 5610us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:53.982097 (+ 32276us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.594817 (+1612720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.594885 (+ 68us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.566753 (+971868us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":11971,"mutex_wait_us":1632674}
W20260619 18:45:56.584689 12441 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.952624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52156)
0619 18:45:53.241730 (+289106us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.247635 (+ 5905us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.622953 (+375318us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:53.803085 (+180132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:53.825573 (+ 22488us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:53.855906 (+ 30333us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.904332 (+2048426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.904439 (+ 107us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.583219 (+678780us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":159737,"mutex_wait_us":2240382}
W20260619 18:45:56.587595 12596 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.234321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52210 (local address 127.6.120.254:36501)
0619 18:45:53.234834 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.234868 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:53.790639 (+555771us) server_negotiation.cc:407] Connection header received
0619 18:45:53.851913 (+ 61274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:53.856843 (+ 4930us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:54.438906 (+582063us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:54.999509 (+560603us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:54.999736 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.000391 (+ 655us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.095691 (+ 95300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.664592 (+568901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.585800 (+921208us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52210: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":749776,"server-negotiator.queue_time_us":90,"spinlock_wait_cycles":55373568}
W20260619 18:45:56.605453 12569 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.026181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52150 (local address 127.6.120.254:36501)
0619 18:45:53.246668 (+220487us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.248470 (+ 1802us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:53.250475 (+ 2005us) server_negotiation.cc:407] Connection header received
0619 18:45:53.623183 (+372708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:53.645965 (+ 22782us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:53.945817 (+299852us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:54.460900 (+515083us) spinlock_profiling.cc:243] Waited 5.17 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:54.477063 (+ 16163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:54.506793 (+ 29730us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.539541 (+2032748us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52150: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1658338,"server-negotiator.queue_time_us":95021,"spinlock_wait_cycles":48769536}
W20260619 18:45:56.606827 12557 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.031355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52120 (local address 127.6.120.254:36501)
0619 18:45:52.966370 (+935015us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:52.966411 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:52.966482 (+ 71us) server_negotiation.cc:407] Connection header received
0619 18:45:52.966638 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:52.966663 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:52.982466 (+ 15803us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:53.029290 (+ 46824us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.515430 (+3486140us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52120: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":3393700,"server-negotiator.queue_time_us":832032}
W20260619 18:45:56.631691 13020 thread.cc:636] rpc reactor (reactor) Time spent creating pthread: real 0.535s user 0.014s sys 0.035s
W20260619 18:45:56.632133 13020 thread.cc:602] rpc reactor (reactor) Time spent starting thread: real 0.575s user 0.014s sys 0.036s
W20260619 18:45:56.633582 12979 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.576s user 0.030s sys 0.047s
W20260619 18:45:56.633957 12979 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.600s user 0.030s sys 0.047s
W20260619 18:45:56.634414 12560 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.223886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52182 (local address 127.6.120.254:36501)
0619 18:45:53.226290 (+ 2404us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.226321 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:53.226379 (+ 58us) server_negotiation.cc:407] Connection header received
0619 18:45:53.226518 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:53.226542 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:53.226795 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:53.226999 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:54.089322 (+862323us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1ec6c 00007f1383e1ebd6 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:55.341551 (+1252229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.757998 (+416447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.630713 (+872715us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52182: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1935529,"server-negotiator.queue_time_us":1965,"spinlock_wait_cycles":16205696}
W20260619 18:45:56.637876 12972 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.527786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48780)
0619 18:45:52.951421 (+1423635us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:52.953204 (+ 1783us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:52.972034 (+ 18830us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:53.117310 (+145276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:53.120709 (+ 3399us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:53.130205 (+ 9496us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:56.029447 (+2899242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.029521 (+ 74us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.607357 (+577836us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":979308,"mutex_wait_us":3376574,"thread_start_us":1348621,"threads_started":1}
I20260619 18:45:56.649049 12145 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:56.649641 12145 scanner-internal.cc:458] Time spent opening tablet: real 5.586s user 0.011s sys 0.016s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:56.651010 12516 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.231360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52194 (local address 127.6.120.254:36501)
0619 18:45:53.231940 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.231971 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:53.783546 (+551575us) server_negotiation.cc:407] Connection header received
0619 18:45:53.851691 (+ 68145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:53.856727 (+ 5036us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:53.919759 (+ 63032us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:53.941410 (+ 21651us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.062199 (+1120789us) spinlock_profiling.cc:243] Waited 33 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:55.623283 (+561084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.487087 (+863804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.649142 (+162055us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52194: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2152723,"server-negotiator.queue_time_us":94,"spinlock_wait_cycles":75816832}
W20260619 18:45:56.654584 12974 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.860930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48798 (local address 127.6.120.193:37901)
0619 18:45:53.696719 (+835789us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.706628 (+ 9909us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:53.790133 (+ 83505us) server_negotiation.cc:407] Connection header received
0619 18:45:53.887693 (+ 97560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:53.904665 (+ 16972us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:53.969955 (+ 65290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:53.983413 (+ 13458us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:55.104419 (+1121006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.541968 (+1437549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.652806 (+110838us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48798: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2272947,"server-negotiator.queue_time_us":282713}
W20260619 18:45:56.656452 12577 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.972298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52160 (local address 127.6.120.254:36501)
0619 18:45:53.239236 (+266938us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.241056 (+ 1820us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:53.247626 (+ 6570us) server_negotiation.cc:407] Connection header received
0619 18:45:53.264309 (+ 16683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:53.609136 (+344827us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:53.969792 (+360656us) spinlock_profiling.cc:243] Waited 8.05 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:53.987149 (+ 17357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:54.002476 (+ 15327us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:54.923196 (+920720us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:55.667111 (+743915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.913686 (+246575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.653189 (+739503us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52160: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1893287,"server-negotiator.queue_time_us":141728,"spinlock_wait_cycles":29371008}
W20260619 18:45:56.670179 12941 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.116736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48754 (local address 127.6.120.193:37901)
0619 18:45:51.417382 (+300646us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:51.419421 (+ 2039us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:51.591299 (+171878us) server_negotiation.cc:407] Connection header received
0619 18:45:51.591576 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:51.591618 (+ 42us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:51.592074 (+ 456us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:51.646070 (+ 53996us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:53.106078 (+1460008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.182277 (+2076199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.650236 (+1467959us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48754: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":4256353,"server-negotiator.queue_time_us":186845}
W20260619 18:45:56.672441 13000 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.709777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52242)
0619 18:45:54.951740 (+1241963us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:54.951838 (+ 98us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:54.952258 (+ 420us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.545884 (+593626us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.565798 (+ 19914us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.570043 (+ 4245us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.632481 (+1062438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.632549 (+ 68us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.670882 (+ 38333us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1230799,"mutex_wait_us":966471,"thread_start_us":1210155,"threads_started":1}
W20260619 18:45:56.674376 12962 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.362297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48764)
0619 18:45:51.591291 (+228994us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:51.591374 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:51.591760 (+ 386us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:52.215309 (+623549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:52.215381 (+ 72us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:52.215474 (+ 93us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:55.112485 (+2897011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.114425 (+ 1940us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.606649 (+1492224us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":228213,"mutex_wait_us":3895443,"thread_start_us":87943,"threads_started":1}
W20260619 18:45:56.674700 12463 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.234186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52210)
0619 18:45:53.771259 (+537073us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.776741 (+ 5482us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.834186 (+ 57445us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.000143 (+1165957us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.000181 (+ 38us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.000313 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.095005 (+ 94692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.095060 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.668604 (+573544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:55.668664 (+ 60us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:56.569662 (+900998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.573792 (+ 4130us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.651185 (+ 77393us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":12812,"mutex_wait_us":963461}
W20260619 18:45:56.676542 12185 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.908308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52136)
0619 18:45:53.116559 (+208251us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.120578 (+ 4019us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.141461 (+ 20883us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:54.466043 (+1324582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:54.466083 (+ 40us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:54.466207 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:54.614929 (+148722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:54.614997 (+ 68us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.886620 (+1271623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:55.886716 (+ 96us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:56.052872 (+166156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.052925 (+ 53us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.674974 (+622049us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":672,"mutex_wait_us":904671}
W20260619 18:45:56.676774 12537 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.950078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52150)
0619 18:45:53.136332 (+186254us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.139154 (+ 2822us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.150443 (+ 11289us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:54.511917 (+1361474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:54.514426 (+ 2509us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:54.562594 (+ 48168us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.476724 (+1914130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.476793 (+ 69us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.626693 (+149900us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":999,"mutex_wait_us":1970889}
I20260619 18:45:56.677310 12615 scanner-internal.cc:172] Scan of tablet d63b7834d93346288748391962132228 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:56.677986 12615 scanner-internal.cc:458] Time spent opening tablet: real 5.664s user 0.009s sys 0.009s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:56.679181 12410 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.093712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52174)
0619 18:45:53.149752 (+ 56040us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.149803 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.168928 (+ 19125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:53.738818 (+569890us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:53.738861 (+ 43us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:53.740325 (+ 1464us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.644407 (+2904082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.653015 (+ 8608us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.653743 (+ 728us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":11730,"mutex_wait_us":2839119}
W20260619 18:45:56.682425 13001 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.709898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52238)
0619 18:45:55.187061 (+1477163us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.187128 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.187435 (+ 307us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.540325 (+352890us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.544340 (+ 4015us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.571268 (+ 26928us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.028453 (+457185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.028514 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.676718 (+648204us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1422323,"mutex_wait_us":314094,"thread_start_us":1305127,"threads_started":1}
W20260619 18:45:56.682574 13014 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.725234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52244)
0619 18:45:55.904718 (+2179484us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.904817 (+ 99us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.905186 (+ 369us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.910696 (+ 5510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.914769 (+ 4073us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.919445 (+ 4676us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.635684 (+716239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.635746 (+ 62us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.677166 (+ 41420us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":2153459,"mutex_wait_us":707388,"thread_start_us":1557200,"threads_started":1}
W20260619 18:45:56.683831 12603 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.949984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52136 (local address 127.6.120.254:36501)
0619 18:45:53.238943 (+288959us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.240973 (+ 2030us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:53.247505 (+ 6532us) server_negotiation.cc:407] Connection header received
0619 18:45:53.606574 (+359069us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:53.616488 (+ 9914us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:53.884188 (+267700us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:54.443262 (+559074us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:54.456692 (+ 13430us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:54.465104 (+ 8412us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.089144 (+624040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.835968 (+746824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.665996 (+830028us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52136: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":2105269,"server-negotiator.queue_time_us":164284,"spinlock_wait_cycles":75455104}
W20260619 18:45:56.685948 12998 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.661224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52222)
0619 18:45:55.095575 (+1434351us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.095652 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.095943 (+ 291us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.108291 (+ 12348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.110944 (+ 2653us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.133960 (+ 23016us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.054784 (+920824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.054878 (+ 94us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.669499 (+614621us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1397020,"mutex_wait_us":1058928,"thread_start_us":1311390,"threads_started":1}
W20260619 18:45:56.680698 12570 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.995225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52076 (local address 127.6.120.254:36501)
0619 18:45:52.121709 (+126484us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:52.131029 (+ 9320us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:52.133506 (+ 2477us) server_negotiation.cc:407] Connection header received
0619 18:45:52.158531 (+ 25025us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:52.161449 (+ 2918us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:52.173684 (+ 12235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:52.189499 (+ 15815us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:54.675469 (+2485970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.631528 (+1956059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.671372 (+ 39844us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52076: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":4247875,"server-negotiator.queue_time_us":14440}
W20260619 18:45:56.688985 12752 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.658118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48808 (local address 127.6.120.193:37901)
0619 18:45:53.842959 (+184841us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.848362 (+ 5403us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:55.836945 (+1988583us) server_negotiation.cc:407] Connection header received
0619 18:45:55.880216 (+ 43271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:55.881429 (+ 1213us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.898929 (+ 17500us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.906992 (+ 8063us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:56.667281 (+760289us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48808: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":732272,"server-negotiator.queue_time_us":5969}
W20260619 18:45:56.692740 12613 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.120040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52156 (local address 127.6.120.254:36501)
0619 18:45:53.650997 (+530957us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.654199 (+ 3202us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:53.659714 (+ 5515us) server_negotiation.cc:407] Connection header received
0619 18:45:53.682952 (+ 23238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:53.697467 (+ 14515us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:53.766249 (+ 68782us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:53.797157 (+ 30908us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.904965 (+2107808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.688666 (+783701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.689268 (+ 602us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52156: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1892521,"server-negotiator.queue_time_us":22477}
W20260619 18:45:56.696198 12194 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.665477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52266)
0619 18:45:53.850661 (+185184us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.856040 (+ 5379us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.887990 (+ 31950us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:54.034253 (+146263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:54.044617 (+ 10364us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:54.066594 (+ 21977us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.340303 (+1273709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.340396 (+ 93us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.677484 (+1337088us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":184,"mutex_wait_us":1233314}
W20260619 18:45:56.699582 13004 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.237555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48808)
0619 18:45:55.817142 (+2579587us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.818948 (+ 1806us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.833212 (+ 14264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.910258 (+ 77046us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.911111 (+ 853us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.915809 (+ 4698us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:56.697485 (+781676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.697539 (+ 54us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.698129 (+ 590us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":2541934,"mutex_wait_us":741363,"thread_start_us":2072722,"threads_started":1}
W20260619 18:45:56.701120 12612 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.006689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52092 (local address 127.6.120.254:36501)
0619 18:45:52.018099 (+ 11410us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:52.018132 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:52.160510 (+142378us) server_negotiation.cc:407] Connection header received
0619 18:45:52.173971 (+ 13461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:52.174016 (+ 45us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:52.187119 (+ 13103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:52.187330 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:54.736737 (+2549407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.695067 (+1958330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.695746 (+ 679us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52092: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2187008,"server-negotiator.queue_time_us":11003,"spinlock_wait_cycles":1878400}
I20260619 18:45:56.701619 12143 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:56.702229 12143 scanner-internal.cc:458] Time spent opening tablet: real 5.345s user 0.017s sys 0.034s
W20260619 18:45:56.702486 12523 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.653396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52236 (local address 127.6.120.254:36501)
0619 18:45:53.857153 (+203757us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.862623 (+ 5470us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:55.593925 (+1731302us) server_negotiation.cc:407] Connection header received
0619 18:45:55.594196 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:55.594249 (+ 53us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.594612 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.594878 (+ 266us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.680133 (+1085255us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52236: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":463846,"server-negotiator.queue_time_us":45202}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:56.704583 13005 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.651563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52236)
0619 18:45:53.997270 (+345707us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b4400023f4c. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383d68a95 00007f1383d694b2 00007f138a346511 00007f138a341e1a 00007f1383e385fe 00007f138cc63a39 00007f1383e558bb 00007f1383e53cbf 00007f1383e55e22 00007f138892cc48
0619 18:45:55.593011 (+1595741us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.593123 (+ 112us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.593489 (+ 366us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.599079 (+ 5590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.602781 (+ 3702us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.635234 (+ 32453us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.685504 (+1050270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.685562 (+ 58us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.686154 (+ 592us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1940611,"mutex_wait_us":905208,"spinlock_wait_cycles":4868352,"thread_start_us":1515741,"threads_started":1}
W20260619 18:45:56.748452 12014 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:51.973398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52064 (local address 127.6.120.254:36501)
0619 18:45:52.034504 (+ 61106us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:52.036664 (+ 2160us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:52.058215 (+ 21551us) server_negotiation.cc:407] Connection header received
0619 18:45:52.065619 (+ 7404us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:52.068953 (+ 3334us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:52.138617 (+ 69664us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:52.159987 (+ 21370us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:54.604805 (+2444818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.700232 (+2095427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.724718 (+ 24486us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52064: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2521502,"server-negotiator.queue_time_us":9602}
W20260619 18:45:56.750998 12645 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.751002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52266 (local address 127.6.120.254:36501)
0619 18:45:53.933403 (+182401us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.940346 (+ 6943us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:53.951856 (+ 11510us) server_negotiation.cc:407] Connection header received
0619 18:45:53.969824 (+ 17968us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:53.973743 (+ 3919us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:54.002101 (+ 28358us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:54.028898 (+ 26797us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.045100 (+2016202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.714034 (+668934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.714824 (+ 790us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52266: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":2619405,"server-negotiator.queue_time_us":40695}
W20260619 18:45:56.770038 12182 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.768887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52252 (local address 127.6.120.254:36501)
0619 18:45:53.875650 (+106763us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.875686 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:55.296407 (+1420721us) server_negotiation.cc:407] Connection header received
0619 18:45:55.296754 (+ 347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:55.296791 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.297287 (+ 496us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.297606 (+ 319us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.768734 (+1471128us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52252: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":746459,"server-negotiator.queue_time_us":33666}
W20260619 18:45:56.771832 12536 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.941539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52130 (local address 127.6.120.254:36501)
0619 18:45:53.147497 (+205958us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.150021 (+ 2524us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:53.153230 (+ 3209us) server_negotiation.cc:407] Connection header received
0619 18:45:53.162675 (+ 9445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:53.168730 (+ 6055us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:53.262321 (+ 93591us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:53.654742 (+392421us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.428164 (+1773422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.734652 (+1306488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.753514 (+ 18862us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52130: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2746953,"server-negotiator.queue_time_us":74629}
W20260619 18:45:56.783835 12573 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.665102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52270)
0619 18:45:53.900383 (+235281us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.906111 (+ 5728us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.941819 (+ 35708us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:54.840833 (+899014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:54.840874 (+ 41us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:54.841010 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.094226 (+253216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.094281 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.476861 (+1382580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.476924 (+ 63us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:56.744128 (+267204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.744208 (+ 80us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.782243 (+ 38035us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":71526,"mutex_wait_us":506039}
W20260619 18:45:56.789382 12081 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.919845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52270 (local address 127.6.120.254:36501)
0619 18:45:54.029546 (+109701us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:54.032688 (+ 3142us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:54.042402 (+ 9714us) server_negotiation.cc:407] Connection header received
0619 18:45:54.042584 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:54.042612 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:54.757355 (+714743us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:54.777518 (+ 20163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:54.788337 (+ 10819us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.329799 (+541462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.476409 (+1146610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.787754 (+311345us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52270: BlockingRecv error: recv got EOF from 127.0.0.1:52270 (error 108)
Metrics: {"mutex_wait_us":1578886,"server-negotiator.queue_time_us":76903,"spinlock_wait_cycles":5324160}
W20260619 18:45:56.797379 12592 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.793112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52282)
0619 18:45:53.955370 (+162258us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.963299 (+ 7929us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.985995 (+ 22696us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.023129 (+1037134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.026940 (+ 3811us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.040132 (+ 13192us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.639035 (+1598903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.639116 (+ 81us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.768461 (+129345us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":98,"mutex_wait_us":1514669}
W20260619 18:45:56.791867 13002 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.733451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52252)
0619 18:45:55.182741 (+1449290us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.182855 (+ 114us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.183246 (+ 391us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.533247 (+350001us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.540587 (+ 7340us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.565597 (+ 25010us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.789549 (+1223952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.789625 (+ 76us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.790326 (+ 701us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1440921,"mutex_wait_us":1161974,"thread_start_us":1528257,"threads_started":1}
W20260619 18:45:56.817904 12584 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:52.966638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52160)
0619 18:45:53.141314 (+174676us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.143942 (+ 2628us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.161092 (+ 17150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:54.011438 (+850346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:54.024736 (+ 13298us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:54.052881 (+ 28145us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:54.613881 (+561000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:54.613954 (+ 73us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.916744 (+1302790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:55.916816 (+ 72us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:56.788788 (+871972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.788871 (+ 83us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.815393 (+ 26522us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":4626,"mutex_wait_us":1353573}
W20260619 18:45:56.829066 12556 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.783633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52244 (local address 127.6.120.254:36501)
0619 18:45:53.952564 (+168931us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.957739 (+ 5175us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:55.905029 (+1947290us) server_negotiation.cc:407] Connection header received
0619 18:45:55.905472 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:55.905515 (+ 43us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.905820 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.906072 (+ 252us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.647674 (+741602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.826447 (+178773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.827306 (+ 859us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52244: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":159273,"server-negotiator.queue_time_us":43834}
W20260619 18:45:56.860229 12631 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.855237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52306)
0619 18:45:53.860641 (+ 5404us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.860695 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.860965 (+ 270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:54.428836 (+567871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:54.428873 (+ 37us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:54.429012 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.023187 (+1594175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.023272 (+ 85us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.858873 (+835601us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":472,"mutex_wait_us":1425504}
W20260619 18:45:56.862975 12899 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.868864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52322)
0619 18:45:53.903611 (+ 34747us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.903674 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.909487 (+ 5813us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.426679 (+1517192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.426743 (+ 64us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.426915 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.007345 (+580430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.015828 (+ 8483us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.055727 (+ 39899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.055782 (+ 55us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:56.783456 (+727674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.783515 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.828996 (+ 45481us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":9046,"mutex_wait_us":1158533}
W20260619 18:45:56.890362 12777 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.780245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52298)
0619 18:45:53.939353 (+159108us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.945173 (+ 5820us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.973029 (+ 27856us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:53.999929 (+ 26900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:53.999970 (+ 41us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:54.000093 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.905308 (+1905215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.905383 (+ 75us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.538110 (+632727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.538163 (+ 53us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:56.689459 (+151296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.689532 (+ 73us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.873747 (+184215us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":4336,"mutex_wait_us":2059363}
W20260619 18:45:56.929075 12411 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.681218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52242 (local address 127.6.120.254:36501)
0619 18:45:53.918776 (+237558us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.922589 (+ 3813us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:54.953599 (+1031010us) server_negotiation.cc:407] Connection header received
0619 18:45:54.964961 (+ 11362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:54.994903 (+ 29942us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.066840 (+ 71937us) spinlock_profiling.cc:243] Waited 3.87 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:55.324037 (+257197us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:55.353040 (+ 29003us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.353308 (+ 268us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.633544 (+1280236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.880093 (+246549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.925128 (+ 45035us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52242: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1435291,"server-negotiator.queue_time_us":88095,"spinlock_wait_cycles":586263168}
W20260619 18:45:56.936407 12590 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.826902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52284)
0619 18:45:53.973047 (+146145us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.977348 (+ 4301us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.992864 (+ 15516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:54.560079 (+567215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:54.562288 (+ 2209us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:54.610522 (+ 48234us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:54.611063 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:54.611126 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.872759 (+2261633us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 1179 requested bytes
Metrics: {"client-negotiator.queue_time_us":6804}
W20260619 18:45:56.947311 12502 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.958401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52350 (local address 127.6.120.254:36501)
0619 18:45:54.433258 (+474857us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:54.439404 (+ 6146us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:54.443375 (+ 3971us) server_negotiation.cc:407] Connection header received
0619 18:45:54.453465 (+ 10090us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:54.457609 (+ 4144us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:54.507252 (+ 49643us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:54.522939 (+ 15687us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.349494 (+826555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.595282 (+1245788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.945611 (+350329us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52350: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1336700,"server-negotiator.queue_time_us":60793}
W20260619 18:45:56.952185 12546 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.979676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52284 (local address 127.6.120.254:36501)
0619 18:45:54.446274 (+466598us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:54.449630 (+ 3356us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:54.452828 (+ 3198us) server_negotiation.cc:407] Connection header received
0619 18:45:54.464540 (+ 11712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:54.473556 (+ 9016us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:54.518433 (+ 44877us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:54.553872 (+ 35439us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.057647 (+503775us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:55.898677 (+841030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.868019 (+969342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.950631 (+ 82612us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52284: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"mutex_wait_us":2082263,"server-negotiator.queue_time_us":60571,"spinlock_wait_cycles":12424448}
W20260619 18:45:56.954355 13011 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.983283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52382)
0619 18:45:55.598758 (+1615475us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.611727 (+ 12969us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.626993 (+ 15266us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.650051 (+ 23058us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.651842 (+ 1791us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.683384 (+ 31542us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.475164 (+791780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.475260 (+ 96us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.953003 (+477743us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1582974,"mutex_wait_us":760287,"thread_start_us":1122990,"threads_started":1}
W20260619 18:45:56.960021 13007 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.041245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52398)
0619 18:45:55.581355 (+1540110us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.581438 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.584763 (+ 3325us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.598273 (+ 13510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.598813 (+ 540us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.632232 (+ 33419us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.698856 (+1066624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.698926 (+ 70us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.958604 (+259678us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1532552,"mutex_wait_us":1001778,"thread_start_us":1128801,"threads_started":1}
W20260619 18:45:56.961928 12652 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.911142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52364 (local address 127.6.120.254:36501)
0619 18:45:53.996098 (+ 84956us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.996150 (+ 52us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:54.034642 (+ 38492us) server_negotiation.cc:407] Connection header received
0619 18:45:54.071935 (+ 37293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:54.076055 (+ 4120us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:54.929303 (+853248us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:55.038153 (+108850us) spinlock_profiling.cc:243] Waited 5.15 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:55.046887 (+ 8734us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.058741 (+ 11854us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.643428 (+1584687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.715529 (+ 72101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.960270 (+244741us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52364: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":892627,"server-negotiator.queue_time_us":73698,"spinlock_wait_cycles":22223488}
W20260619 18:45:56.980026 12653 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.838888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52306 (local address 127.6.120.254:36501)
0619 18:45:54.051317 (+212429us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:54.054304 (+ 2987us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:54.055749 (+ 1445us) server_negotiation.cc:407] Connection header received
0619 18:45:54.072948 (+ 17199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:54.076916 (+ 3968us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:54.099320 (+ 22404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:54.427887 (+328567us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:54.947432 (+519545us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:55.041887 (+ 94455us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:55.092727 (+ 50840us) spinlock_profiling.cc:243] Waited 9.47 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:56.029119 (+936392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.889445 (+860326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.943229 (+ 53784us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52306: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1258357,"server-negotiator.queue_time_us":108268,"spinlock_wait_cycles":32816128}
W20260619 18:45:56.991794 12459 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.902236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52372)
0619 18:45:54.025509 (+123273us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:54.027351 (+ 1842us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:54.049042 (+ 21691us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:54.476204 (+427162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:54.495217 (+ 19013us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:54.521174 (+ 25957us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.093170 (+571996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.093227 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.748693 (+1655466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.748767 (+ 74us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:56.863290 (+114523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.863353 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.989156 (+125803us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":3145,"mutex_wait_us":685182}
W20260619 18:45:57.003434 12518 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.896088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52364)
0619 18:45:54.026189 (+130101us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:54.027970 (+ 1781us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:54.054424 (+ 26454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.063178 (+1008754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.064735 (+ 1557us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.068605 (+ 3870us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.641839 (+1573234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.641927 (+ 88us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.715965 (+ 74038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.716008 (+ 43us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.000558 (+284550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.000615 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.001651 (+ 1036us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":9558,"mutex_wait_us":1775760}
W20260619 18:45:57.007426 12719 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.849825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52290)
0619 18:45:53.860720 (+ 10895us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.860793 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.875765 (+ 14972us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:54.604546 (+728781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:54.604591 (+ 45us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:54.604717 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.044053 (+1439336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.044176 (+ 123us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.697668 (+653492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.697711 (+ 43us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.004365 (+306654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.004427 (+ 62us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.005633 (+ 1206us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":5056,"mutex_wait_us":1633583}
W20260619 18:45:57.010286 12551 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.888550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52298 (local address 127.6.120.254:36501)
0619 18:45:53.995363 (+106813us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.995393 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:53.995452 (+ 59us) server_negotiation.cc:407] Connection header received
0619 18:45:53.995592 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:53.995616 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:53.995881 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:53.996076 (+ 195us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.905969 (+1909893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.537777 (+631808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.691325 (+153548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.998003 (+306678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.008385 (+ 10382us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52298: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":2741978,"server-negotiator.queue_time_us":78780}
W20260619 18:45:57.042249 12624 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.806094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52282 (local address 127.6.120.254:36501)
0619 18:45:53.896875 (+ 90781us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.896908 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:53.968416 (+ 71508us) server_negotiation.cc:407] Connection header received
0619 18:45:54.001304 (+ 32888us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:54.006210 (+ 4906us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:54.881209 (+874999us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:54.948359 (+ 67150us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:54.965896 (+ 17537us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.017986 (+ 52090us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.066138 (+ 48152us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:56.639352 (+1573214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.012143 (+372791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.018296 (+ 6153us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52282: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":897669,"server-negotiator.queue_time_us":90388,"spinlock_wait_cycles":93618560,"thread_start_us":1430537,"threads_started":1}
W20260619 18:45:57.017613 12533 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.223766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52182)
0619 18:45:53.224527 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:53.224581 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:53.224873 (+ 292us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:53.230095 (+ 5222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:53.230129 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:53.230261 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.341027 (+2110766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.341098 (+ 71us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:55.758540 (+417442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:55.758606 (+ 66us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.001014 (+1242408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.001073 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.001818 (+ 745us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":3223120}
W20260619 18:45:57.022925 12497 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.047854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52372 (local address 127.6.120.254:36501)
0619 18:45:54.430511 (+382657us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:54.430565 (+ 54us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:54.430640 (+ 75us) server_negotiation.cc:407] Connection header received
0619 18:45:54.430807 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:54.430849 (+ 42us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:54.458362 (+ 27513us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:54.474028 (+ 15666us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:54.949819 (+475791us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:55.052891 (+103072us) spinlock_profiling.cc:243] Waited 6.09 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:55.076098 (+ 23207us) spinlock_profiling.cc:243] Waited 4.59 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f13888caca0 00007f138897f49c 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:55.343218 (+267120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.747550 (+1404332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.869509 (+121959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.008002 (+138493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.008612 (+ 610us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52372: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1729520,"server-negotiator.queue_time_us":27407,"spinlock_wait_cycles":66355840}
W20260619 18:45:57.046372 12816 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.047495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52408)
0619 18:45:54.461498 (+414003us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:54.463802 (+ 2304us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:54.503274 (+ 39472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.423254 (+919980us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.423323 (+ 69us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.423529 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.817923 (+394394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.819351 (+ 1428us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.044740 (+1225389us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":2975,"mutex_wait_us":382873}
W20260619 18:45:57.027628 12591 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.261754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52398 (local address 127.6.120.254:36501)
0619 18:45:55.338445 (+ 76691us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:55.338489 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:55.582870 (+244381us) server_negotiation.cc:407] Connection header received
0619 18:45:55.590890 (+ 8020us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:55.590929 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.591259 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.591539 (+ 280us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.712047 (+120508us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:56.700612 (+988565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.012519 (+311907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.025632 (+ 13113us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52398: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1255212,"server-negotiator.queue_time_us":76102,"spinlock_wait_cycles":8309504}
W20260619 18:45:57.033946 12904 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.064769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48812 (local address 127.6.120.193:37901)
0619 18:45:54.473227 (+408458us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:54.477253 (+ 4026us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:55.185748 (+708495us) server_negotiation.cc:407] Connection header received
0619 18:45:55.185941 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:55.185990 (+ 49us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.186407 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.186593 (+ 186us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:56.925179 (+1738586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.007112 (+ 81933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.032751 (+ 25639us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48812: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1493596,"server-negotiator.queue_time_us":3081}
W20260619 18:45:57.013624 12091 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.035061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52290 (local address 127.6.120.254:36501)
0619 18:45:54.476384 (+441323us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:54.495271 (+ 18887us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:54.499297 (+ 4026us) server_negotiation.cc:407] Connection header received
0619 18:45:54.512251 (+ 12954us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:54.517964 (+ 5713us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:54.581714 (+ 63750us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:54.603830 (+ 22116us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.045136 (+1441306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.697289 (+652153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.007019 (+309730us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52290: BlockingRecv error: recv got EOF from 127.0.0.1:52290 (error 108)
Metrics: {"mutex_wait_us":1239603,"server-negotiator.queue_time_us":33216}
W20260619 18:45:57.055970 12648 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.729504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52238 (local address 127.6.120.254:36501)
0619 18:45:53.939078 (+209574us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:53.944581 (+ 5503us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:55.348568 (+1403987us) server_negotiation.cc:407] Connection header received
0619 18:45:55.348734 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:55.348758 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.349019 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.349186 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.031276 (+682090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.053499 (+1022223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.054417 (+ 918us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52238: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1672960,"server-negotiator.queue_time_us":58011}
W20260619 18:45:57.080147 12491 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.067195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52418 (local address 127.6.120.254:36501)
0619 18:45:54.599548 (+532353us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:54.601342 (+ 1794us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:54.603909 (+ 2567us) server_negotiation.cc:407] Connection header received
0619 18:45:54.643765 (+ 39856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:54.646504 (+ 2739us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:54.742201 (+ 95697us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:54.751150 (+ 8949us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.844952 (+1093802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.637371 (+792419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.772946 (+135575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.893123 (+120177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.032880 (+139757us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:57.070216 (+ 37336us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52418: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1298289,"server-negotiator.queue_time_us":395372}
W20260619 18:45:57.126780 13012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.102503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48812)
0619 18:45:55.185017 (+1082514us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.185092 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.185509 (+ 417us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.192324 (+ 6815us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.192367 (+ 43us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.192441 (+ 74us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:56.924587 (+1732146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.924665 (+ 78us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.008264 (+ 83599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.008297 (+ 33us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.075413 (+ 67116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.075472 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.124664 (+ 49192us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1068403,"mutex_wait_us":1787632,"thread_start_us":1197506,"threads_started":1}
W20260619 18:45:57.138057 12432 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.923857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52350)
0619 18:45:54.046466 (+122609us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:54.049556 (+ 3090us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:54.071621 (+ 22065us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:54.526115 (+454494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:54.540579 (+ 14464us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:54.598545 (+ 57966us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.345592 (+747047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.345665 (+ 73us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.603866 (+1258201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.604582 (+ 716us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.036345 (+431763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.036431 (+ 86us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.126511 (+ 90080us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1922,"mutex_wait_us":1172463}
I20260619 18:45:57.139415 12146 scanner-internal.cc:172] Scan of tablet 4161914b7a5e40a888261cedc6398a73 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:57.140187 12146 scanner-internal.cc:458] Time spent opening tablet: real 4.732s user 0.006s sys 0.016s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:45:57.143713 12544 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.260641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52322 (local address 127.6.120.254:36501)
0619 18:45:55.333070 (+ 72429us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:55.333115 (+ 45us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:55.333163 (+ 48us) server_negotiation.cc:407] Connection header received
0619 18:45:55.333329 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:55.333360 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.333713 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.333922 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.025302 (+691380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.047298 (+ 21996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.784252 (+736954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.070093 (+285841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.141622 (+ 71529us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52322: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":819321,"server-negotiator.queue_time_us":71630}
W20260619 18:45:57.159505 12792 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.071573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52424)
0619 18:45:54.499348 (+427775us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:54.502821 (+ 3473us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:54.527499 (+ 24678us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:54.856358 (+328859us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:54.858926 (+ 2568us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:54.928368 (+ 69442us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.478292 (+1549924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.478375 (+ 83us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.772218 (+293843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.772257 (+ 39us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.026918 (+254661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.026987 (+ 69us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.037874 (+ 10887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.037911 (+ 37us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.061994 (+ 24083us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:57.106596 (+ 44602us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:57.106639 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:57.106712 (+ 73us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:57.106920 (+ 208us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:57.145373 (+ 38453us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":3879,"mutex_wait_us":1786030}
W20260619 18:45:57.172214 12242 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 249449us
W20260619 18:45:57.176070 12585 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.261289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52382 (local address 127.6.120.254:36501)
0619 18:45:55.337581 (+ 76292us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:55.337637 (+ 56us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:55.622009 (+284372us) server_negotiation.cc:407] Connection header received
0619 18:45:55.630938 (+ 8929us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:55.630989 (+ 51us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.631320 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.631612 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.642464 (+1010852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.097787 (+455323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.125030 (+ 27243us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52382: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1356925,"server-negotiator.queue_time_us":75736}
W20260619 18:45:57.203956 12524 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:53.959992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52406)
0619 18:45:54.042574 (+ 82582us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:54.042625 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:54.042860 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:54.845453 (+802593us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:54.845490 (+ 37us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:54.845620 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.443346 (+597726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.471127 (+ 27781us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.056191 (+585064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.056237 (+ 46us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:56.826685 (+770448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.826770 (+ 85us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.829280 (+ 2510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.829313 (+ 33us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:56.869750 (+ 40437us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:57.036712 (+166962us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:57.036740 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:57.036796 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:57.036910 (+ 114us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:57.201786 (+164876us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":5820,"mutex_wait_us":1594723}
W20260619 18:45:57.242290 12636 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.262672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52408 (local address 127.6.120.254:36501)
0619 18:45:55.346320 (+ 83648us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:55.346380 (+ 60us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:55.346458 (+ 78us) server_negotiation.cc:407] Connection header received
0619 18:45:55.346663 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:55.346698 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.347004 (+ 306us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.347201 (+ 197us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.025171 (+677970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.163744 (+1138573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.240556 (+ 76812us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52408: BlockingWrite error: write error: Broken pipe (error 32)
Metrics: {"mutex_wait_us":1714513,"server-negotiator.queue_time_us":82996}
W20260619 18:45:57.264164 12087 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.429986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52424 (local address 127.6.120.254:36501)
0619 18:45:54.762142 (+332156us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:54.763514 (+ 1372us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:54.779007 (+ 15493us) server_negotiation.cc:407] Connection header received
0619 18:45:54.784839 (+ 5832us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:54.788914 (+ 4075us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:54.847450 (+ 58536us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:54.847671 (+ 221us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.484518 (+1636847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.768360 (+283842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.028908 (+260548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.030549 (+ 1641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.030933 (+ 384us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:57.220724 (+189791us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52424: BlockingRecv error: recv got EOF from 127.0.0.1:52424 (error 108)
Metrics: {"mutex_wait_us":1265741,"server-negotiator.queue_time_us":189097}
W20260619 18:45:57.274173 12058 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.429425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52406 (local address 127.6.120.254:36501)
0619 18:45:54.757225 (+327800us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:54.759504 (+ 2279us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:54.761714 (+ 2210us) server_negotiation.cc:407] Connection header received
0619 18:45:54.778838 (+ 17124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:54.780695 (+ 1857us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:54.844899 (+ 64204us) spinlock_profiling.cc:243] Waited 53.7 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:54.845143 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:54.845375 (+ 232us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.525332 (+679957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.049023 (+523691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.827064 (+778041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.828362 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.828695 (+ 333us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:57.270149 (+441454us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52406: BlockingRecv error: recv got EOF from 127.0.0.1:52406 (error 108)
Metrics: {"mutex_wait_us":941526,"server-negotiator.queue_time_us":170566,"spinlock_wait_cycles":123567104}
W20260619 18:45:57.275741 12195 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 237153us
W20260619 18:45:57.278232 12896 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.092491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52428)
0619 18:45:54.527284 (+434793us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:54.541238 (+ 13954us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:54.593818 (+ 52580us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.534736 (+940918us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.540421 (+ 5685us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.557181 (+ 16760us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.807303 (+1250122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.807367 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.016905 (+209538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.016955 (+ 50us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.173569 (+156614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.173638 (+ 69us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.276713 (+103075us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":4616,"mutex_wait_us":1372272}
W20260619 18:45:57.315696 12828 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.057244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52418)
0619 18:45:54.465451 (+408207us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:54.465499 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:54.465714 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:54.755271 (+289557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:54.757431 (+ 2160us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:54.782210 (+ 24779us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:55.831815 (+1049605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:55.835360 (+ 3545us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.640292 (+804932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.640336 (+ 44us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:56.772613 (+132277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.772665 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.896725 (+124060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.896775 (+ 50us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.177047 (+280272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:57.190778 (+ 13731us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:57.190815 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:57.190870 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:57.190991 (+ 121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:57.313059 (+122068us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":7794,"mutex_wait_us":1456258}
W20260619 18:45:57.354056 12632 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.263106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52428 (local address 127.6.120.254:36501)
0619 18:45:55.348094 (+ 84988us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:55.348148 (+ 54us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:55.348209 (+ 61us) server_negotiation.cc:407] Connection header received
0619 18:45:55.348369 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:55.348407 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.348708 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.348871 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.808245 (+1459374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.016505 (+208260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.352416 (+335911us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52428: BlockingRecv error: recv got EOF from 127.0.0.1:52428 (error 108)
Metrics: {"mutex_wait_us":1405223,"server-negotiator.queue_time_us":84450,"spinlock_wait_cycles":19840}
W20260619 18:45:57.580322 12405 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.428396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52434)
0619 18:45:54.429018 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:54.429072 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:54.429328 (+ 256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:54.848279 (+418951us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:54.848318 (+ 39us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:54.848463 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.630256 (+1781793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.630352 (+ 96us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.924986 (+294634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.925035 (+ 49us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.232612 (+307577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.243639 (+ 11027us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.471568 (+227929us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":2063119}
W20260619 18:45:57.585381 12241 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 186017us
W20260619 18:45:57.640982 12528 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 150055us
W20260619 18:45:57.701833 12490 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.463550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52434 (local address 127.6.120.254:36501)
0619 18:45:54.778727 (+315177us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:54.778771 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:54.782159 (+ 3388us) server_negotiation.cc:407] Connection header received
0619 18:45:54.790675 (+ 8516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:54.846516 (+ 55841us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:54.846778 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:54.847011 (+ 233us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.059790 (+212779us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:55.093113 (+ 33323us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1ec6c 00007f1383e1ebd6 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:56.630782 (+1537669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.924719 (+293937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.249590 (+324871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.641547 (+391957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.697936 (+ 56389us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52434: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":798588,"server-negotiator.queue_time_us":175178,"spinlock_wait_cycles":8444544}
W20260619 18:45:57.728456 12825 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 125435us
W20260619 18:45:57.850801 12826 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 187207us
W20260619 18:45:57.861567 12245 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 198362us
W20260619 18:45:57.861934 12191 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 72780.2us
W20260619 18:45:58.001084 12568 scanner-internal.cc:458] Time spent opening tablet: real 5.053s user 0.029s sys 0.039s
W20260619 18:45:58.018008 12455 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.994586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52540)
0619 18:45:55.071127 (+ 76541us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.072927 (+ 1800us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.084428 (+ 11501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.343974 (+259546us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.344047 (+ 73us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.344248 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.573022 (+1228774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.577646 (+ 4624us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.012964 (+435318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.013017 (+ 53us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.239782 (+226765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.239841 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.641184 (+401343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.641225 (+ 41us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.822131 (+180906us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:57.987381 (+165250us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:57.987412 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:57.987474 (+ 62us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:57.987620 (+ 146us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:58.016066 (+ 28446us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":6732,"mutex_wait_us":1599554}
W20260619 18:45:58.079793 12233 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 61050.9us
W20260619 18:45:58.106667 12558 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.262069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52540 (local address 127.6.120.254:36501)
0619 18:45:55.338907 (+ 76838us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:55.338935 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:55.339001 (+ 66us) server_negotiation.cc:407] Connection header received
0619 18:45:55.339183 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:55.339214 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.342244 (+ 3030us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.344681 (+ 2437us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.578334 (+1233653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.011892 (+433558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.240238 (+228346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.640225 (+399987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.640583 (+ 358us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:58.105132 (+464549us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52540: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1999324,"server-negotiator.queue_time_us":76309}
W20260619 18:45:58.109102 12628 scanner-internal.cc:458] Time spent opening tablet: real 3.265s user 0.010s sys 0.010s
W20260619 18:45:58.172501 12135 scanner-internal.cc:458] Time spent opening tablet: real 3.742s user 0.022s sys 0.023s
W20260619 18:45:58.213531 12814 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.846709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52514)
0619 18:45:54.847671 (+ 962us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:54.847739 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:54.848020 (+ 281us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.531525 (+683505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.536386 (+ 4861us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.567604 (+ 31218us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.636979 (+1069375us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.637040 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.910235 (+273195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.910273 (+ 38us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.734330 (+824057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.734405 (+ 75us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.991785 (+257380us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":379,"mutex_wait_us":1919101}
W20260619 18:45:58.214216 12976 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 309058us
W20260619 18:45:58.214622 12715 scanner-internal.cc:458] Time spent opening tablet: real 4.129s user 0.007s sys 0.010s
W20260619 18:45:58.200886 12663 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 281097us
W20260619 18:45:58.286805 12619 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.263718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52514 (local address 127.6.120.254:36501)
0619 18:45:55.349004 (+ 85286us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:55.349048 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:55.349108 (+ 60us) server_negotiation.cc:407] Connection header received
0619 18:45:55.349295 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:55.349339 (+ 44us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.349707 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.349986 (+ 279us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:55.623984 (+273998us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1ec6c 00007f1383e1ebd6 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:56.639433 (+1015449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.898697 (+259264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.735630 (+836933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.865510 (+129880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.109889 (+244379us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:58.280474 (+170585us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52514: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"mutex_wait_us":1321337,"server-negotiator.queue_time_us":84700,"spinlock_wait_cycles":8242560}
W20260619 18:45:58.300125 12675 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 522435us
W20260619 18:45:58.321110 12880 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 241067us
W20260619 18:45:58.350360 12851 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 476909us
W20260619 18:45:58.365375 12823 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.133289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52602)
0619 18:45:55.147529 (+ 14240us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.147593 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.154397 (+ 6804us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:56.652437 (+1498040us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:56.652493 (+ 56us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:56.652629 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:57.099037 (+446408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.099112 (+ 75us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.535902 (+436790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.535938 (+ 36us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.844380 (+308442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.844444 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.210748 (+366304us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":705204}
W20260619 18:45:58.373175 12596 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.273128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52602 (local address 127.6.120.254:36501)
0619 18:45:56.632727 (+1359599us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:56.632760 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:56.632809 (+ 49us) server_negotiation.cc:407] Connection header received
0619 18:45:56.632930 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:56.632956 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:56.648920 (+ 15964us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:56.649183 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:56.649412 (+ 229us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:57.100238 (+450826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.534505 (+434267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.846848 (+312343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.349957 (+503109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.350559 (+ 602us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52602: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1179239,"server-negotiator.queue_time_us":1318027,"spinlock_wait_cycles":33527040}
W20260619 18:45:58.374670 12121 meta_cache.cc:1097] Time spent processing table locations response: real 0.065s user 0.000s sys 0.001s
W20260619 18:45:58.378059 12437 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:54.995095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52528)
0619 18:45:55.030035 (+ 34940us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.032545 (+ 2510us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.037054 (+ 4509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:55.589892 (+552838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:55.589983 (+ 91us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:55.590208 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.693912 (+1103704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.693973 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.039143 (+345170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.039194 (+ 51us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.269689 (+230495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.269740 (+ 51us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.833113 (+563373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.833168 (+ 55us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.847888 (+ 14720us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:58.161217 (+313329us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:58.161252 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:58.161324 (+ 72us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:58.165369 (+ 4045us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:58.304465 (+139096us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":6870,"mutex_wait_us":1623874}
W20260619 18:45:58.380182 12485 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.340856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52656)
0619 18:45:55.341869 (+ 1013us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.341920 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.342235 (+ 315us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:56.720248 (+1378013us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:56.720283 (+ 35us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:56.720435 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:57.083283 (+362848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.083340 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.450748 (+367408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.451349 (+ 601us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:58.180416 (+729067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:58.181674 (+ 1258us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.378767 (+197093us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":463,"mutex_wait_us":1002775}
W20260619 18:45:58.381726 12535 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.272709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52586 (local address 127.6.120.254:36501)
0619 18:45:56.603050 (+1330341us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:56.603090 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:56.603153 (+ 63us) server_negotiation.cc:407] Connection header received
0619 18:45:56.604475 (+ 1322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:56.605331 (+ 856us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:56.606060 (+ 729us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:56.609004 (+ 2944us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.672691 (+ 63687us) spinlock_profiling.cc:243] Waited 8.66 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:56.774178 (+101487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.862330 (+ 88152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.070543 (+208213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.631430 (+560887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.706919 (+ 75489us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:58.379834 (+672915us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52586: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":918944,"server-negotiator.queue_time_us":1289614,"spinlock_wait_cycles":19910528}
W20260619 18:45:58.383091 12552 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 751332us
W20260619 18:45:58.385346 12569 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.274726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52556 (local address 127.6.120.254:36501)
0619 18:45:56.606483 (+1331757us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:56.606520 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:56.607829 (+ 1309us) server_negotiation.cc:407] Connection header received
0619 18:45:56.623394 (+ 15565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:56.625249 (+ 1855us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:56.667112 (+ 41863us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:56.667323 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.989148 (+321825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.022306 (+ 33158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.650478 (+628172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.848046 (+197568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.848454 (+ 408us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:58.383861 (+535407us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52556: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":669311,"server-negotiator.queue_time_us":1331302}
W20260619 18:45:58.444602 12907 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.051288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52586)
0619 18:45:55.104310 (+ 53022us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.104361 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.104587 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:56.630716 (+1526129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:56.630760 (+ 44us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:56.630917 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.703460 (+ 72543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.703533 (+ 73us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.866714 (+163181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.866757 (+ 43us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.070196 (+203439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.070255 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.635125 (+564870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.635168 (+ 43us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:58.110865 (+475697us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:58.183552 (+ 72687us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:58.184720 (+ 1168us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:58.189476 (+ 4756us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:58.196547 (+ 7071us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:58.372909 (+176362us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":4661,"mutex_wait_us":847009}
W20260619 18:45:58.467962 12187 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.264040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52528 (local address 127.6.120.254:36501)
0619 18:45:55.529759 (+265719us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:55.531459 (+ 1700us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:55.534252 (+ 2793us) server_negotiation.cc:407] Connection header received
0619 18:45:55.540456 (+ 6204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:55.542881 (+ 2425us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:55.575397 (+ 32516us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:55.583368 (+ 7971us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.694281 (+1110913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.038755 (+344474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.271891 (+233136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.830287 (+558396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.830783 (+ 496us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:58.366874 (+536091us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52528: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1326742,"server-negotiator.queue_time_us":143703}
W20260619 18:45:58.499960 12226 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 368770us
W20260619 18:45:58.501531 12225 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 108510us
W20260619 18:45:58.507210 12554 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.324818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52654)
0619 18:45:55.339323 (+ 14505us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.339393 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.339863 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:56.723216 (+1383353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:56.723260 (+ 44us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:56.732013 (+ 8753us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:57.048770 (+316757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.048842 (+ 72us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.419195 (+370353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.419249 (+ 54us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:58.504910 (+1085661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:58.504969 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.505743 (+ 774us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":11176,"mutex_wait_us":1234806}
W20260619 18:45:58.515802 12444 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.399008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52712)
0619 18:45:55.540243 (+141235us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.542607 (+ 2364us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.574482 (+ 31875us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:56.778389 (+1203907us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:56.779236 (+ 847us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:56.781749 (+ 2513us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.889847 (+108098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.889941 (+ 94us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.639152 (+749211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.641433 (+ 2281us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:58.461648 (+820215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:58.461745 (+ 97us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.514169 (+ 52424us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":35501,"mutex_wait_us":828638}
W20260619 18:45:58.627735 12906 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 159338us
W20260619 18:45:58.632854 12235 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 397007us
W20260619 18:45:58.844537 12182 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.549768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52712 (local address 127.6.120.254:36501)
0619 18:45:56.770985 (+1221217us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:56.771025 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:56.771082 (+ 57us) server_negotiation.cc:407] Connection header received
0619 18:45:56.771206 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:56.771240 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:56.771500 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:56.777281 (+ 5781us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.995168 (+217887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.635124 (+639956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.605497 (+970373us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52712: BlockingRecv error: recv got EOF from 127.0.0.1:52712 (error 108)
Metrics: {"mutex_wait_us":734367,"server-negotiator.queue_time_us":1213734}
W20260619 18:45:58.885290 12613 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.394302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52654 (local address 127.6.120.254:36501)
0619 18:45:56.720352 (+1326050us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:56.720383 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:56.720429 (+ 46us) server_negotiation.cc:407] Connection header received
0619 18:45:56.720555 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:56.720583 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:56.720862 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:56.721074 (+ 212us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.773336 (+ 52262us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:57.049101 (+275765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.418540 (+369439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.479591 (+1061051us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52654: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":475455,"server-negotiator.queue_time_us":1324294,"spinlock_wait_cycles":4684160}
W20260619 18:45:58.929463 12141 scanner-internal.cc:458] Time spent opening tablet: real 4.879s user 0.010s sys 0.006s
W20260619 18:45:58.935573 12523 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.442383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52670 (local address 127.6.120.254:36501)
0619 18:45:56.740210 (+1297827us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:56.740245 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:56.740307 (+ 62us) server_negotiation.cc:407] Connection header received
0619 18:45:56.740468 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:56.740497 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:56.740752 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:56.741033 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:57.138136 (+397103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.305217 (+167081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.832299 (+527082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.323808 (+491509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.440165 (+116357us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:58.933600 (+493435us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52670: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1176193,"server-negotiator.queue_time_us":1289993}
W20260619 18:45:59.020588 13070 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.889110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52730)
0619 18:45:56.051488 (+162378us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:56.051542 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:56.051842 (+ 300us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:56.791498 (+739656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:56.791540 (+ 42us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:56.791692 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.813674 (+ 21982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.813746 (+ 72us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.116221 (+302475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.116278 (+ 57us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.735181 (+618903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.735253 (+ 72us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.174841 (+439588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.177930 (+ 3089us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:58.494302 (+316372us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:58.947147 (+452845us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:58.947899 (+ 752us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:58.949192 (+ 1293us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:58.953845 (+ 4653us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:59.018264 (+ 64419us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":92757,"mutex_wait_us":1277676,"thread_start_us":52164,"threads_started":1}
W20260619 18:45:59.023397 12180 scanner-internal.cc:458] Time spent opening tablet: real 4.178s user 0.015s sys 0.005s
W20260619 18:45:59.044504 12620 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.883487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52730 (local address 127.6.120.254:36501)
0619 18:45:56.785967 (+902480us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:56.786001 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:56.786051 (+ 50us) server_negotiation.cc:407] Connection header received
0619 18:45:56.786172 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:56.786196 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:56.786453 (+ 257us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:56.786644 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:56.996695 (+210051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.107579 (+110884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.737655 (+630076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.165450 (+427795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.247759 (+ 82309us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:58.929153 (+681394us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52730: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1037290,"server-negotiator.queue_time_us":901048}
W20260619 18:45:59.053118 12556 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.956880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52752 (local address 127.6.120.254:36501)
0619 18:45:56.872425 (+915545us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:56.872461 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:56.872508 (+ 47us) server_negotiation.cc:407] Connection header received
0619 18:45:56.872646 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:56.872678 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:56.872941 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:56.873144 (+ 203us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:57.167819 (+294675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.501709 (+333890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.274784 (+773075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.854000 (+579216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.854334 (+ 334us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:58.981363 (+127029us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52752: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1152492,"server-negotiator.queue_time_us":888855}
W20260619 18:45:59.068941 12570 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.389438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52656 (local address 127.6.120.254:36501)
0619 18:45:56.719289 (+1329851us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:56.719333 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:56.719416 (+ 83us) server_negotiation.cc:407] Connection header received
0619 18:45:56.719586 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:56.719612 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:56.719883 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:56.720510 (+ 627us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:57.083673 (+363163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.423852 (+340179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.186454 (+762602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.032612 (+846158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.067564 (+ 34952us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52656: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1447274,"server-negotiator.queue_time_us":1328359}
W20260619 18:45:59.101408 12507 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.343213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52670)
0619 18:45:55.352216 (+ 9003us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.352291 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.352693 (+ 402us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:56.741825 (+1389132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:56.741863 (+ 38us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:56.742021 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:57.135064 (+393043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.137552 (+ 2488us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.306401 (+168849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.308736 (+ 2335us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.831116 (+522380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.831187 (+ 71us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.346087 (+514900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.351852 (+ 5765us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:58.466810 (+114958us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:58.997741 (+530931us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:58.997773 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:58.997848 (+ 75us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:58.997987 (+ 139us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:59.099206 (+101219us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":8291,"mutex_wait_us":1521451}
W20260619 18:45:59.098294 13074 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.987810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48892 (local address 127.6.120.193:37901)
0619 18:45:56.538548 (+550738us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:56.538583 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:56.538634 (+ 51us) server_negotiation.cc:407] Connection header received
0619 18:45:56.538793 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:56.538819 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:56.539160 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:56.540093 (+ 933us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:56.696485 (+156392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.802994 (+106509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.836778 (+1033784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.281702 (+444924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.427160 (+145458us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:58.848552 (+421392us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 18:45:59.021641 (+173089us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 18:45:59.096628 (+ 74987us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:48892: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1407219,"server-negotiator.queue_time_us":539145,"thread_start_us":518492,"threads_started":1}
W20260619 18:45:59.135761 12536 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.782526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52718 (local address 127.6.120.254:36501)
0619 18:45:56.780487 (+997961us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:56.780517 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:56.780572 (+ 55us) server_negotiation.cc:407] Connection header received
0619 18:45:56.780695 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:56.780721 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:56.781009 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:56.781217 (+ 208us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:57.032249 (+251032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.276549 (+244300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.869184 (+592635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.440486 (+571302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.928271 (+487785us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.129958 (+201687us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52718: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1365108,"server-negotiator.queue_time_us":984394}
W20260619 18:45:59.175921 13071 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.952744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52752)
0619 18:45:56.023538 (+ 70794us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:56.023601 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:56.023907 (+ 306us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:56.880148 (+856241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:56.882309 (+ 2161us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:56.882470 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:57.159836 (+277366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.162995 (+ 3159us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.507852 (+344857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.508829 (+ 977us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:58.273525 (+764696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:58.273629 (+ 104us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.855318 (+581689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.855366 (+ 48us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.098006 (+242640us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.115448 (+ 17442us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:59.119229 (+ 3781us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:59.121262 (+ 2033us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:59.131161 (+ 9899us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:59.144393 (+ 13232us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":70258,"mutex_wait_us":1148217,"thread_start_us":27867,"threads_started":1}
W20260619 18:45:59.176136 12836 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.006926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52556)
0619 18:45:55.007765 (+ 839us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.007834 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.008099 (+ 265us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:56.667717 (+1659618us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:56.667767 (+ 50us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:56.667960 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:56.986409 (+318449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.986478 (+ 69us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.035892 (+ 49414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.035929 (+ 37us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.647703 (+611774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.649038 (+ 1335us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.860171 (+211133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.860213 (+ 42us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:58.502922 (+642709us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.063180 (+560258us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:59.066168 (+ 2988us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:59.069909 (+ 3741us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:59.078608 (+ 8699us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:59.148311 (+ 69703us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":378,"mutex_wait_us":2040653}
W20260619 18:45:59.187799 12502 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.058293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52774 (local address 127.6.120.254:36501)
0619 18:45:56.949291 (+890998us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:56.949324 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:56.949386 (+ 62us) server_negotiation.cc:407] Connection header received
0619 18:45:56.949538 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:56.949563 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:56.977686 (+ 28123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:56.978870 (+ 1184us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:57.127835 (+148965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.628458 (+500623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.863721 (+235263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.436020 (+572299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.436402 (+ 382us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.121672 (+685270us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52774: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":994634,"server-negotiator.queue_time_us":890103}
W20260619 18:45:59.201018 13072 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.955086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:48892)
0619 18:45:56.057047 (+101961us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:56.057112 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:56.057433 (+ 321us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:56.542295 (+484862us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:56.542331 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:56.542393 (+ 62us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:56.549201 (+ 6808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:56.553916 (+ 4715us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:56.804075 (+250159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:56.804156 (+ 81us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.836348 (+1032192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.836545 (+ 197us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.299093 (+462548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.301744 (+ 2651us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:58.441805 (+140061us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:58.441989 (+ 184us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 18:45:59.080941 (+638952us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":86867,"mutex_wait_us":1165904,"thread_start_us":62541,"threads_started":1}
I20260619 18:45:59.208330 12587 scanner-internal.cc:172] Scan of tablet d63b7834d93346288748391962132228 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:45:59.208601 12978 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 701731us
W20260619 18:45:59.208935 12587 scanner-internal.cc:458] Time spent opening tablet: real 4.107s user 0.007s sys 0.014s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:45:59.204286 13081 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.036767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52774)
0619 18:45:56.631076 (+594309us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:56.631126 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:56.631393 (+ 267us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:56.978993 (+347600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:56.979035 (+ 42us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:56.979174 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:57.125621 (+146447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.125669 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.629376 (+503707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.629413 (+ 37us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.861463 (+232050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.861549 (+ 86us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.439820 (+578271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.439855 (+ 35us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.068706 (+628851us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.182700 (+113994us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:59.182742 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:59.182811 (+ 69us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:59.182985 (+ 174us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:59.186861 (+ 3876us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":531361,"mutex_wait_us":913355,"thread_start_us":492812,"threads_started":1}
W20260619 18:45:59.303579 12165 scanner-internal.cc:458] Time spent opening tablet: real 5.242s user 0.006s sys 0.010s
W20260619 18:45:59.314366 12549 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:55.761046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52718)
0619 18:45:55.834251 (+ 73205us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:55.834327 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:55.834742 (+ 415us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:56.781421 (+946679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:56.781455 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:56.781580 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:57.031502 (+249922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.031563 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.276885 (+245322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.276927 (+ 42us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:57.868891 (+591964us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.868940 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.440840 (+571900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.440876 (+ 36us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.052451 (+611575us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.238955 (+186504us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:59.239017 (+ 62us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:59.239104 (+ 87us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:59.239259 (+ 155us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:59.301444 (+ 62185us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":26511,"mutex_wait_us":1466435}
W20260619 18:45:59.322041 12975 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 95249.4us
W20260619 18:45:59.347620 12973 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 127628us
W20260619 18:45:59.477794 12925 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 132740us
W20260619 18:45:59.502691 13083 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.474487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52790)
0619 18:45:56.630979 (+156492us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:56.631058 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:56.631338 (+ 280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:56.981352 (+350014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:56.981397 (+ 45us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:56.982313 (+ 916us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:57.208635 (+226322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.211759 (+ 3124us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.835064 (+623305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.835100 (+ 36us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.095398 (+1260298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.097060 (+ 1662us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.491232 (+394172us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":155899,"mutex_wait_us":1313224,"thread_start_us":130460,"threads_started":1}
W20260619 18:45:59.487334 12204 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 283005us
W20260619 18:45:59.638876 12652 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.475797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52790 (local address 127.6.120.254:36501)
0619 18:45:56.962807 (+487010us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:56.963115 (+ 308us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:56.963173 (+ 58us) server_negotiation.cc:407] Connection header received
0619 18:45:56.963323 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:56.963349 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:56.979204 (+ 15855us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:56.979454 (+ 250us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:56.979701 (+ 247us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:57.220769 (+241068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.831629 (+610860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.097408 (+1265779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.636176 (+538768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.636686 (+ 510us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52790: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1211398,"server-negotiator.queue_time_us":486601,"spinlock_wait_cycles":29315840}
W20260619 18:45:59.647398 12980 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 74579us
W20260619 18:45:59.682886 12551 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.517029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52810 (local address 127.6.120.254:36501)
0619 18:45:57.041788 (+524759us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:57.041832 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:57.041902 (+ 70us) server_negotiation.cc:407] Connection header received
0619 18:45:57.042056 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:57.042093 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:57.042389 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:57.048313 (+ 5924us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:57.087962 (+ 39649us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:57.275056 (+187094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.830565 (+555509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.131793 (+1301228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.403990 (+272197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.614036 (+210046us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.679447 (+ 65411us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52810: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1190467,"server-negotiator.queue_time_us":524196,"spinlock_wait_cycles":3525760}
W20260619 18:45:59.690083 13026 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 285729us
W20260619 18:45:59.711845 12091 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.566717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52854 (local address 127.6.120.254:36501)
0619 18:45:57.053872 (+487155us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:57.053906 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:57.053958 (+ 52us) server_negotiation.cc:407] Connection header received
0619 18:45:57.054101 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:57.054126 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:57.054371 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:57.054594 (+ 223us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:57.248378 (+193784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.797724 (+549346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.167086 (+1369362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.386107 (+219021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.636932 (+250825us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.710415 (+ 73483us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52854: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1096658,"server-negotiator.queue_time_us":484647}
W20260619 18:45:59.755070 12087 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.715849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52930 (local address 127.6.120.254:36501)
0619 18:45:57.265157 (+549308us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:57.265201 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:57.265254 (+ 53us) server_negotiation.cc:407] Connection header received
0619 18:45:57.265401 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:57.265431 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:57.331637 (+ 66206us) spinlock_profiling.cc:243] Waited 5.22 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:57.348524 (+ 16887us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:57.358730 (+ 10206us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:57.397099 (+ 38369us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:57.412979 (+ 15880us) spinlock_profiling.cc:243] Waited 8.32 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1eb7c 00007f1383e1e73b 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:57.534646 (+121667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.786132 (+251486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.347070 (+560938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.860073 (+513003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.036834 (+176761us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.752884 (+716050us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52930: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":952437,"server-negotiator.queue_time_us":548854,"spinlock_wait_cycles":54615424}
W20260619 18:45:59.794836 13092 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.547492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52854)
0619 18:45:56.603226 (+ 55734us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b4400023f4c. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383d68a95 00007f1383d694b2 00007f138a346511 00007f138a341e1a 00007f1383e385fe 00007f138cc63a39 00007f1383e558bb 00007f1383e53cbf 00007f1383e55e22 00007f138892cc48
0619 18:45:56.835497 (+232271us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:56.836372 (+ 875us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:56.838184 (+ 1812us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:57.054864 (+216680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:57.054900 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:57.055022 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:57.242604 (+187582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.242668 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.798139 (+555471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.798178 (+ 39us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.159603 (+1361425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.159658 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.387993 (+228335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.392185 (+ 4192us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.769388 (+377203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.774281 (+ 4893us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:59.774324 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:59.774400 (+ 76us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:59.774579 (+ 179us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:59.785046 (+ 10467us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":281351,"mutex_wait_us":1728357,"spinlock_wait_cycles":7659776,"thread_start_us":202483,"threads_started":1}
W20260619 18:45:59.813617 12985 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 132536us
W20260619 18:45:59.818861 12410 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.693925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52930)
0619 18:45:56.710819 (+ 16894us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:56.710882 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:56.711192 (+ 310us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:57.361265 (+650073us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:57.362239 (+ 974us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:57.362367 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:57.510434 (+148067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.512340 (+ 1906us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.788193 (+275853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.788231 (+ 38us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:58.329937 (+541706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:58.331855 (+ 1918us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.886616 (+554761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.886674 (+ 58us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.671794 (+785120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.784662 (+112868us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:59.784966 (+ 304us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:59.785509 (+ 543us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:59.791090 (+ 5581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:59.791843 (+ 753us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":12081,"mutex_wait_us":1451157}
W20260619 18:45:59.825495 12369 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 156436us
W20260619 18:45:59.838348 12780 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 199621us
W20260619 18:45:59.863170 12604 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.808569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52998 (local address 127.6.120.254:36501)
0619 18:45:57.651714 (+843145us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:57.651759 (+ 45us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:57.651817 (+ 58us) server_negotiation.cc:407] Connection header received
0619 18:45:57.651953 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:57.651983 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:57.652332 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:57.652509 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:57.771823 (+119314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.319614 (+547791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.133396 (+813782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.315740 (+182344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.316855 (+ 1115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.857210 (+540355us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:52998: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":751697,"server-negotiator.queue_time_us":816297}
W20260619 18:45:59.885432 12979 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 845813us
W20260619 18:45:59.904484 12847 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 267630us
W20260619 18:45:59.918526 12966 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.519455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52810)
0619 18:45:56.538793 (+ 19338us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:56.538842 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:56.539088 (+ 246us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:57.043403 (+504315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:57.043454 (+ 51us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:57.043624 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:57.086441 (+ 42817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.086518 (+ 77us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:57.831144 (+744626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:57.831195 (+ 51us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.130315 (+1299120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.130378 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.410685 (+280307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.410734 (+ 49us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.736496 (+325762us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.874538 (+138042us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:59.874569 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:59.874634 (+ 65us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:59.874754 (+ 120us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:45:59.896258 (+ 21504us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":7393,"mutex_wait_us":1579804}
W20260619 18:45:59.931892 12014 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.897721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53024 (local address 127.6.120.254:36501)
0619 18:45:57.762057 (+864336us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:57.762093 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:57.762152 (+ 59us) server_negotiation.cc:407] Connection header received
0619 18:45:57.762290 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:57.762321 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:57.762572 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:57.762807 (+ 235us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:57.868896 (+106089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.068943 (+1200047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.519918 (+450975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.774800 (+254882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.775242 (+ 442us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.929174 (+153932us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53024: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1512707,"server-negotiator.queue_time_us":863301}
W20260619 18:45:59.933185 12855 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 74807.7us
W20260619 18:45:59.980813 12128 scanner-internal.cc:458] Time spent opening tablet: real 2.574s user 0.009s sys 0.006s
W20260619 18:45:59.996454 13114 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.918629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53040)
0619 18:45:57.114641 (+196012us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.114720 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.115065 (+ 345us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:57.859733 (+744668us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:57.859780 (+ 47us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:57.859909 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:58.377049 (+517140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:58.377119 (+ 70us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.245606 (+868487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.248858 (+ 3252us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.692863 (+444005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.692919 (+ 56us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.994670 (+301751us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":195238,"mutex_wait_us":903563,"thread_start_us":193176,"threads_started":1}
W20260619 18:46:00.010119 12687 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 398763us
W20260619 18:46:00.011611 12765 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 286455us
W20260619 18:46:00.025537 12100 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 348288us
W20260619 18:46:00.037930 12759 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 240278us
W20260619 18:46:00.040504 12631 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.909254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53024)
0619 18:45:56.910784 (+ 1530us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:56.910835 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:56.911112 (+ 277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:57.764338 (+853226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:57.764370 (+ 32us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:57.764494 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:57.868317 (+103823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.868392 (+ 75us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.076991 (+1208599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.078639 (+ 1648us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.519081 (+440442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.519133 (+ 52us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.775178 (+256045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.775225 (+ 47us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.917837 (+142612us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.922589 (+ 4752us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:59.922639 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:59.922705 (+ 66us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:59.930907 (+ 8202us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:46:00.006407 (+ 75500us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1031,"mutex_wait_us":684038}
W20260619 18:46:00.113958 12573 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.807770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:52998)
0619 18:45:56.814838 (+ 7068us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:56.814891 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:56.815159 (+ 268us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:57.661526 (+846367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:57.662113 (+ 587us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:57.679900 (+ 17787us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:57.769215 (+ 89315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:57.769280 (+ 65us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.319968 (+550688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.320009 (+ 41us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.130683 (+810674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.130738 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.318734 (+187996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.319107 (+ 373us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.717476 (+398369us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.913421 (+195945us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:59.914089 (+ 668us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:59.916587 (+ 2498us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:59.921579 (+ 4992us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:46:00.050750 (+129171us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":6570,"mutex_wait_us":1509406}
W20260619 18:46:00.120081 12781 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 716691us
W20260619 18:46:00.135767 12645 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.014175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53108 (local address 127.6.120.254:36501)
0619 18:45:58.197324 (+1183149us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:58.197366 (+ 42us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:58.201829 (+ 4463us) server_negotiation.cc:407] Connection header received
0619 18:45:58.216623 (+ 14794us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:58.220857 (+ 4234us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:58.248688 (+ 27831us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:58.266867 (+ 18179us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.046186 (+779319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.719411 (+673225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.844360 (+124949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.031315 (+186955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.133794 (+102479us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53108: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1047456,"server-negotiator.queue_time_us":1181584}
W20260619 18:46:00.139618 12558 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.968703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53082 (local address 127.6.120.254:36501)
0619 18:45:58.107673 (+1138970us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:58.107710 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:58.107772 (+ 62us) server_negotiation.cc:407] Connection header received
0619 18:45:58.107926 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:58.107958 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:58.126440 (+ 18482us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:58.140257 (+ 13817us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:58.517802 (+377545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.300306 (+782504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.484533 (+184227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.672964 (+188431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.847834 (+174870us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.111079 (+263245us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53082: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1658711,"server-negotiator.queue_time_us":1138482}
W20260619 18:46:00.160980 12079 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 441541us
W20260619 18:46:00.162079 12577 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.941351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53040 (local address 127.6.120.254:36501)
0619 18:45:57.858724 (+917373us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:57.858767 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:57.858823 (+ 56us) server_negotiation.cc:407] Connection header received
0619 18:45:57.858976 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:57.859013 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:57.859381 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:57.859610 (+ 229us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:58.383863 (+524253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.236726 (+852863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.693148 (+456422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.054666 (+361518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.115239 (+ 60573us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53040: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1677534,"server-negotiator.queue_time_us":885145}
W20260619 18:46:00.178745 12560 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.968277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53068 (local address 127.6.120.254:36501)
0619 18:45:57.848618 (+880341us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:57.848662 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:57.848735 (+ 73us) server_negotiation.cc:407] Connection header received
0619 18:45:57.848896 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:57.848937 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:57.855113 (+ 6176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:57.859896 (+ 4783us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:57.966620 (+106724us) spinlock_profiling.cc:243] Waited 872 us on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:58.382454 (+415834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.384163 (+ 1709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.379726 (+995563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.738272 (+358546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.820007 (+ 81735us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.119698 (+299691us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53068: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":617174,"server-negotiator.queue_time_us":879877,"spinlock_wait_cycles":2004736}
W20260619 18:46:00.184460 13011 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.963630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53082)
0619 18:45:56.964667 (+ 1037us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:56.964737 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:56.964984 (+ 247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:58.145696 (+1180712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:58.148484 (+ 2788us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:58.162029 (+ 13545us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:58.509196 (+347167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:58.509252 (+ 56us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.304241 (+794989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.307632 (+ 3391us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.483703 (+176071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.483764 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.675408 (+191644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.675460 (+ 52us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.851349 (+175889us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:45:59.859920 (+ 8571us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:45:59.859952 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:45:59.860010 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:45:59.860205 (+ 195us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:46:00.106111 (+245906us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":570,"mutex_wait_us":762233}
W20260619 18:46:00.179782 12173 scanner-internal.cc:458] Time spent opening tablet: real 2.891s user 0.006s sys 0.007s
W20260619 18:46:00.182143 12590 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.965048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53092)
0619 18:45:56.966698 (+ 1650us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:56.966747 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:56.967076 (+ 329us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:57.862597 (+895521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:57.862639 (+ 42us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:57.863709 (+ 1070us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:58.853052 (+989343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:58.853114 (+ 62us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.344752 (+491638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.344795 (+ 43us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.860505 (+515710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.861641 (+ 1136us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.138093 (+276452us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1224,"mutex_wait_us":1508201}
W20260619 18:46:00.194573 12619 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.046352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53116 (local address 127.6.120.254:36501)
0619 18:45:58.299784 (+1253432us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:58.299825 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:58.299907 (+ 82us) server_negotiation.cc:407] Connection header received
0619 18:45:58.300139 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:58.300167 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:58.300443 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:58.300654 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:58.936841 (+636187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.605291 (+668450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.793197 (+187906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.945032 (+151835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.945376 (+ 344us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.176028 (+230652us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53116: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1350392,"server-negotiator.queue_time_us":1241002}
W20260619 18:46:00.205525 12243 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 407750us
W20260619 18:46:00.209113 12466 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.056524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53120 (local address 127.6.120.254:36501)
0619 18:45:58.372613 (+1316089us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:58.372654 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:58.372721 (+ 67us) server_negotiation.cc:407] Connection header received
0619 18:45:58.372895 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:58.372926 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:58.373190 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:58.373406 (+ 216us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.132499 (+759093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.672261 (+539762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.201595 (+529334us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53120: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1214537,"server-negotiator.queue_time_us":1312272}
W20260619 18:46:00.210752 12182 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.183407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53148 (local address 127.6.120.254:36501)
0619 18:45:58.886243 (+1702836us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:58.886293 (+ 50us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:58.887197 (+ 904us) server_negotiation.cc:407] Connection header received
0619 18:45:58.887318 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:58.887342 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:58.887579 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:58.890214 (+ 2635us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.372177 (+481963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.640636 (+268459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.657474 (+ 16838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.884284 (+226810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.911292 (+ 27008us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.209345 (+298053us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53148: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":983576,"server-negotiator.queue_time_us":1691822}
W20260619 18:46:00.218880 12634 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.968930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53096 (local address 127.6.120.254:36501)
0619 18:45:58.245997 (+1277067us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:58.248031 (+ 2034us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:58.263190 (+ 15159us) server_negotiation.cc:407] Connection header received
0619 18:45:58.271014 (+ 7824us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:58.277060 (+ 6046us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:58.301080 (+ 24020us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:58.307520 (+ 6440us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.197488 (+889968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.734258 (+536770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.174875 (+440617us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53096: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":832140,"server-negotiator.queue_time_us":1213924}
W20260619 18:46:00.220402 12545 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 387850us
W20260619 18:46:00.223398 12459 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.013337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53108)
0619 18:45:57.019207 (+ 5870us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.019259 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.019507 (+ 248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:58.270687 (+1251180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:58.274867 (+ 4180us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:58.275048 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.044860 (+769812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.044941 (+ 81us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.720821 (+675880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.721191 (+ 370us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.839327 (+118136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.839384 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.185853 (+346469us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":5391,"mutex_wait_us":1011677}
W20260619 18:46:00.291584 12523 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.253463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53186 (local address 127.6.120.254:36501)
0619 18:45:58.989099 (+1735636us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:58.997473 (+ 8374us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:58.999563 (+ 2090us) server_negotiation.cc:407] Connection header received
0619 18:45:58.999751 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:58.999791 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.001687 (+ 1896us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.008773 (+ 7086us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.719244 (+710471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.925787 (+206543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.289854 (+364067us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53186: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":293622,"server-negotiator.queue_time_us":1690287}
W20260619 18:46:00.291713 12535 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.066004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53132 (local address 127.6.120.254:36501)
0619 18:45:58.382618 (+1316614us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:58.382654 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:58.382706 (+ 52us) server_negotiation.cc:407] Connection header received
0619 18:45:58.382826 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:58.382849 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:58.383087 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:58.383288 (+ 201us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.017944 (+634656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.664285 (+646341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.920343 (+256058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.034646 (+114303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.165314 (+130668us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.275072 (+109758us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53132: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":937562,"server-negotiator.queue_time_us":1316135}
W20260619 18:46:00.298627 12792 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.172626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53162)
0619 18:45:57.179492 (+ 6866us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.179538 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.179798 (+ 260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:58.472365 (+1292567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:58.472414 (+ 49us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:58.472604 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.509718 (+1037114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.509787 (+ 69us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.822508 (+312721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.822566 (+ 58us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.985874 (+163308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.986583 (+ 709us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.290827 (+304244us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":1572,"mutex_wait_us":1030836}
W20260619 18:46:00.291409 13082 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 43985.2us
W20260619 18:46:00.311815 13019 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 396865us
W20260619 18:46:00.325986 12612 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.965871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53092 (local address 127.6.120.254:36501)
0619 18:45:57.857656 (+891785us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:57.857712 (+ 56us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:57.857787 (+ 75us) server_negotiation.cc:407] Connection header received
0619 18:45:57.857958 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:57.857990 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:57.858267 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:57.858506 (+ 239us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:58.854619 (+996113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.344308 (+489689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.862126 (+517818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.142301 (+280175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.260369 (+118068us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53092: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1125674,"server-negotiator.queue_time_us":880624}
W20260619 18:46:00.401845 12569 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.151618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53142 (local address 127.6.120.254:36501)
0619 18:45:58.386218 (+1234600us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:58.386253 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:58.386299 (+ 46us) server_negotiation.cc:407] Connection header received
0619 18:45:58.386421 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:58.386447 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:58.386700 (+ 253us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:58.386881 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.071189 (+684308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.594427 (+523238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.940351 (+345924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.285800 (+345449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.335916 (+ 50116us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53142: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":877713,"server-negotiator.queue_time_us":1234185}
W20260619 18:46:00.469347 12183 scanner-internal.cc:458] Time spent opening tablet: real 2.359s user 0.001s sys 0.014s
W20260619 18:46:00.486603 13136 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.256274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53190)
0619 18:45:57.398380 (+142106us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.398429 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.398681 (+ 252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.096808 (+1698127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.096847 (+ 39us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.096967 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.373078 (+276111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.373125 (+ 47us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.669016 (+295891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.669049 (+ 33us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.173655 (+504606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:00.173721 (+ 66us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.485163 (+311442us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":108591,"mutex_wait_us":962162,"thread_start_us":19581,"threads_started":1}
W20260619 18:46:00.492617 13116 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.931485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53068)
0619 18:45:57.004808 (+ 73323us) spinlock_profiling.cc:243] Waited 7.01 ms on lock 0x7b18003bc680. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f138cce98b1 00007f138ccf6661 00007f1383e56638 00007f1383e59b11 00007f1383e59ac9 00007f1383e59a59 00007f1383e59a21 00007f1383e58d1d 00007f138d0ae204 00007f138d0ae039 00007f1383e38dc6
0619 18:45:57.005217 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.005282 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.005552 (+ 270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:57.866184 (+860632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:57.866231 (+ 47us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:57.866365 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:58.376533 (+510168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:58.376591 (+ 58us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:58.392829 (+ 16238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:58.392877 (+ 48us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.379359 (+986482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.379449 (+ 90us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.740508 (+361059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.740554 (+ 46us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.973153 (+232599us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.251163 (+278010us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:46:00.251206 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:46:00.253474 (+ 2268us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:46:00.260345 (+ 6871us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:46:00.483344 (+222999us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":65334,"mutex_wait_us":2062637,"spinlock_wait_cycles":16125184,"thread_start_us":59461,"threads_started":1}
W20260619 18:46:00.496459 12719 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.045535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53116)
0619 18:45:57.060873 (+ 15338us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.060919 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.061135 (+ 216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:58.305361 (+1244226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:58.307385 (+ 2024us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:58.317218 (+ 9833us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:58.934289 (+617071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:58.934357 (+ 68us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.605562 (+671205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.605609 (+ 47us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.792482 (+186873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.792545 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.947961 (+155416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.948991 (+ 1030us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.315952 (+366961us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.326308 (+ 10356us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:46:00.326337 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:46:00.326395 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:46:00.326512 (+ 117us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:46:00.494323 (+167811us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1988,"mutex_wait_us":1300478}
W20260619 18:46:00.496827 12413 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.424996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35012 (local address 127.6.120.254:36501)
0619 18:45:59.139992 (+1714996us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.140044 (+ 52us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.140087 (+ 43us) server_negotiation.cc:407] Connection header received
0619 18:45:59.140236 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.140260 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.140534 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.140723 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.619930 (+479207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.709698 (+ 89768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.495312 (+785614us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35012: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":593059,"server-negotiator.queue_time_us":1712895}
W20260619 18:46:00.501590 12411 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.211489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53170 (local address 127.6.120.254:36501)
0619 18:45:58.880048 (+1668559us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:58.880088 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:58.880159 (+ 71us) server_negotiation.cc:407] Connection header received
0619 18:45:58.880306 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:58.880329 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:58.880608 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:58.880821 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.249164 (+368343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.952493 (+703329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.329369 (+376876us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53170: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1014335,"server-negotiator.queue_time_us":1668118}
W20260619 18:46:00.512351 12432 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.177888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53148)
0619 18:45:57.178666 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.178729 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.179043 (+ 314us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:58.889894 (+1710851us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:58.889949 (+ 55us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:58.890117 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.344872 (+454755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.345580 (+ 708us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.643465 (+297885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.643509 (+ 44us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.646071 (+ 2562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.646143 (+ 72us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.886431 (+240288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.886480 (+ 49us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.075144 (+188664us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.267992 (+192848us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:46:00.268025 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:46:00.268083 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:46:00.268249 (+ 166us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:46:00.316156 (+ 47907us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":347,"mutex_wait_us":825792}
W20260619 18:46:00.522732 12620 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.259119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53190 (local address 127.6.120.254:36501)
0619 18:45:59.092850 (+1833731us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.093897 (+ 1047us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.093942 (+ 45us) server_negotiation.cc:407] Connection header received
0619 18:45:59.094643 (+ 701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.095374 (+ 731us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.096302 (+ 928us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.096568 (+ 266us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.392298 (+295730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.666375 (+274077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.175409 (+509034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.506020 (+330611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.520955 (+ 14935us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53190: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":884722,"server-negotiator.queue_time_us":1785870,"spinlock_wait_cycles":29440}
W20260619 18:46:00.564615 12216 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 514266us
W20260619 18:46:00.572328 12809 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 79509.7us
W20260619 18:46:00.574535 13007 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:56.966031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53096)
0619 18:45:56.967083 (+ 1052us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:56.967126 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:56.967322 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:58.309934 (+1342612us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:58.315791 (+ 5857us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:58.339784 (+ 23993us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.196708 (+856924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.196794 (+ 86us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.736160 (+539366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.736201 (+ 41us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.464753 (+728552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:00.467226 (+ 2473us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.530626 (+ 63400us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":527,"mutex_wait_us":1561102}
W20260619 18:46:00.582439 12187 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.177549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53162 (local address 127.6.120.254:36501)
0619 18:45:58.469290 (+1291741us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:58.469335 (+ 45us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:58.469401 (+ 66us) server_negotiation.cc:407] Connection header received
0619 18:45:58.469599 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:58.469635 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:58.469952 (+ 317us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:58.474308 (+ 4356us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:58.624245 (+149937us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:59.510194 (+885949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.821966 (+311772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.988071 (+166105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.490554 (+502483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.567349 (+ 76795us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:53162: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1315641,"server-negotiator.queue_time_us":1291164,"spinlock_wait_cycles":6996352}
W20260619 18:46:00.580163 13125 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.151514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53142)
0619 18:45:57.210123 (+ 58609us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.210172 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.223052 (+ 12880us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:58.387371 (+1164319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:58.387406 (+ 35us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:58.389139 (+ 1733us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.069475 (+680336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.069540 (+ 65us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.596089 (+526549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.596163 (+ 74us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.940032 (+343869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.940093 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.436269 (+496176us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":58071,"mutex_wait_us":1176608,"thread_start_us":42923,"threads_started":1}
W20260619 18:46:00.586500 13152 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.420879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35020)
0619 18:45:57.446131 (+ 25252us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.446199 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.446459 (+ 260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.138433 (+1691974us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.138467 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.138602 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.368602 (+230000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.368678 (+ 76us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.677861 (+309183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.677902 (+ 41us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.486251 (+808349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:00.486327 (+ 76us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.584951 (+ 98624us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":5720,"mutex_wait_us":1076931,"thread_start_us":2098,"threads_started":1}
W20260619 18:46:00.590029 12896 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.397072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35010)
0619 18:45:57.464659 (+ 67587us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.466455 (+ 1796us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.472715 (+ 6260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.131891 (+1659176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.132611 (+ 720us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.135166 (+ 2555us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.686712 (+551546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.686768 (+ 56us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.927079 (+240311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.927115 (+ 36us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.173947 (+246832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:00.174001 (+ 54us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.588718 (+414717us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":12170,"mutex_wait_us":971552}
W20260619 18:46:00.603847 12536 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.421091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35020 (local address 127.6.120.254:36501)
0619 18:45:59.137384 (+1716293us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.137416 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.137464 (+ 48us) server_negotiation.cc:407] Connection header received
0619 18:45:59.137592 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.137616 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.137858 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.138176 (+ 318us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.369415 (+231239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.676057 (+306642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.530650 (+854593us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35020: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":515389,"server-negotiator.queue_time_us":1715886}
W20260619 18:46:00.606446 12570 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.383115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35010 (local address 127.6.120.254:36501)
0619 18:45:59.091807 (+1708692us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.092709 (+ 902us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.094473 (+ 1764us) server_negotiation.cc:407] Connection header received
0619 18:45:59.102121 (+ 7648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.108863 (+ 6742us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.119889 (+ 11026us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.129245 (+ 9356us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.688311 (+559066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.926828 (+238517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.174839 (+248011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.500878 (+326039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.564241 (+ 63363us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35010: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":801041,"server-negotiator.queue_time_us":1686327}
W20260619 18:46:00.608421 12524 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.256244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53186)
0619 18:45:57.266796 (+ 10552us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.266849 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.267128 (+ 279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.004845 (+1737717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.004880 (+ 35us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.005026 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.718125 (+713099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.718409 (+ 284us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.926113 (+207704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.926152 (+ 39us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.499319 (+573167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:00.499379 (+ 60us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.567672 (+ 68293us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":5831,"mutex_wait_us":1286633}
W20260619 18:46:00.726698 13146 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.383111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35012)
0619 18:45:57.446962 (+ 63851us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.447010 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.447244 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.140947 (+1693703us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.140981 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.141105 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.480254 (+339149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.481085 (+ 831us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.710576 (+229491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.710630 (+ 54us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.497716 (+787086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:00.497773 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.568214 (+ 70441us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":40719,"mutex_wait_us":1083589,"thread_start_us":18343,"threads_started":1}
W20260619 18:46:00.749627 12405 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.642396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35040)
0619 18:45:57.644698 (+ 2302us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.644754 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.645059 (+ 305us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.142810 (+1497751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.142847 (+ 37us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.142970 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.605809 (+462839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.605887 (+ 78us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.794408 (+188521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.794449 (+ 41us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.313233 (+518784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:00.313296 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.497252 (+183956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.497289 (+ 37us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.604777 (+107488us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.635534 (+ 30757us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:46:00.635564 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:46:00.635640 (+ 76us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:46:00.635799 (+ 159us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:46:00.696144 (+ 60345us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":466,"mutex_wait_us":1066668}
W20260619 18:46:00.753140 12653 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.628502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35024 (local address 127.6.120.254:36501)
0619 18:45:59.140981 (+1512479us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.141028 (+ 47us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.141076 (+ 48us) server_negotiation.cc:407] Connection header received
0619 18:45:59.141192 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.141220 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.141448 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.141642 (+ 194us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.265984 (+124342us) spinlock_profiling.cc:243] Waited 7.94 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:59.274708 (+ 8724us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1ec6c 00007f1383e1ebd6 0000000000620c99 00007f1383fad640 00007f1383fac954 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:59.511441 (+236733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.701518 (+190077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.095167 (+393649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.270962 (+175795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.311991 (+ 41029us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.737447 (+425456us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35024: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":699992,"server-negotiator.queue_time_us":1512085,"spinlock_wait_cycles":24128512}
W20260619 18:46:00.755496 12490 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.645371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35040 (local address 127.6.120.254:36501)
0619 18:45:59.141900 (+1496529us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.141936 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.141979 (+ 43us) server_negotiation.cc:407] Connection header received
0619 18:45:59.142110 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.142141 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.142387 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.142592 (+ 205us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.608396 (+465804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.793746 (+185350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.314198 (+520452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.495533 (+181335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.495854 (+ 321us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.636616 (+140762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 18:46:00.636698 (+ 82us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 18:46:00.637940 (+ 1242us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 18:46:00.671966 (+ 34026us) server_negotiation.cc:922] calling sasl_server_start()
0619 18:46:00.676797 (+ 4831us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 18:46:00.680200 (+ 3403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 18:46:00.721192 (+ 40992us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35040: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":577583,"server-negotiator.queue_time_us":1496138}
W20260619 18:46:00.797279 12910 scanner-internal.cc:458] Time spent opening tablet: real 2.588s user 0.031s sys 0.019s
W20260619 18:46:01.307325 12546 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.662972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35048 (local address 127.6.120.254:36501)
0619 18:45:59.157945 (+1494973us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.157976 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.158024 (+ 48us) server_negotiation.cc:407] Connection header received
0619 18:45:59.158157 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.158185 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.158453 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.158653 (+ 200us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.506192 (+347539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.785549 (+279357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.483248 (+697699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.586260 (+103012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.586587 (+ 327us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.821964 (+235377us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35048: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":753823,"server-negotiator.queue_time_us":1494397}
W20260619 18:46:01.308058 12783 meta_cache.cc:1097] Time spent processing table locations response: real 0.324s user 0.000s sys 0.007s
W20260619 18:46:01.308892 12655 scanner-internal.cc:458] Time spent opening tablet: real 2.677s user 0.011s sys 0.007s
W20260619 18:46:01.311355 12148 meta_cache.cc:1097] Time spent processing table locations response: real 0.325s user 0.002s sys 0.005s
W20260619 18:46:01.321543 12655 client.cc:2034] Couldn't close scanner df14fd0916f14962b65b0fd16dfa5261: Aborted: reactor is shutting down (error 108)
W20260619 18:46:01.323977 12518 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.062430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53132)
0619 18:45:57.085023 (+ 22593us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.085087 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.085423 (+ 336us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:58.384729 (+1299306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:58.384775 (+ 46us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:58.384916 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.002934 (+618018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.014244 (+ 11310us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.666024 (+651780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.667266 (+ 1242us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.919387 (+252121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.919444 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.035515 (+116071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.035554 (+ 39us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.497232 (+461678us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.636073 (+138841us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:46:00.636131 (+ 58us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:46:00.636187 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:46:00.636301 (+ 114us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:46:01.321910 (+685609us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":572,"mutex_wait_us":2067163}
W20260619 18:46:01.328677 12502 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.706025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35056 (local address 127.6.120.254:36501)
0619 18:45:59.223232 (+1517207us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.223279 (+ 47us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.223341 (+ 62us) server_negotiation.cc:407] Connection header received
0619 18:45:59.223488 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.227239 (+ 3751us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.241380 (+ 14141us) spinlock_profiling.cc:243] Waited 1.34 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:59.249421 (+ 8041us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.259117 (+ 9696us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.967041 (+707924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.311738 (+344697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.327165 (+1015427us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35056: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":966416,"server-negotiator.queue_time_us":1497069,"spinlock_wait_cycles":3088128}
W20260619 18:46:01.374039 12500 scanner-internal.cc:458] Time spent opening tablet: real 3.608s user 0.011s sys 0.000s
W20260619 18:46:01.375577 13204 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.009810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:55498)
0619 18:45:58.255040 (+245230us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.255106 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.255548 (+ 442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:58.391832 (+136284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:58.399854 (+ 8022us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:58.404190 (+ 4336us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:58.508603 (+104413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:58.508663 (+ 60us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.578172 (+1069509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.581624 (+ 3452us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:45:59.818964 (+237340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.819044 (+ 80us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.193406 (+374362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.193443 (+ 37us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.518522 (+325079us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.518769 (+ 247us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 18:46:01.371661 (+852892us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":206717,"mutex_wait_us":952690,"thread_start_us":176860,"threads_started":1}
I20260619 18:46:01.376304 12161 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:46:01.377038 12161 scanner-internal.cc:458] Time spent opening tablet: real 3.619s user 0.011s sys 0.005s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: received 0 of 4 requested bytes
W20260619 18:46:01.384096 13059 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.278892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55498 (local address 127.6.120.193:37901)
0619 18:45:58.350172 (+ 71280us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:58.350213 (+ 41us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:58.350277 (+ 64us) server_negotiation.cc:407] Connection header received
0619 18:45:58.350435 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:58.350461 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:58.369844 (+ 19383us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:58.390196 (+ 20352us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:58.517430 (+127234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.576430 (+1059000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.819284 (+242854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.189397 (+370113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.313688 (+124291us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.519784 (+206096us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 18:46:01.331463 (+811679us) spinlock_profiling.cc:243] Waited 4.9 ms on lock 0x7b24002c79c8. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1ebce 0000000000620c99 00007f1383fad640 00007f1383fba81a 00007f13889765fc 00007f1388973a57 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:46:01.331599 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 18:46:01.382305 (+ 50706us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:55498: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1845934,"server-negotiator.queue_time_us":70845,"spinlock_wait_cycles":11271552,"thread_start_us":130240,"threads_started":1}
W20260619 18:46:01.387566 12614 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.173609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35100 (local address 127.6.120.254:36501)
0619 18:45:59.388406 (+1214797us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.392255 (+ 3849us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.392308 (+ 53us) server_negotiation.cc:407] Connection header received
0619 18:45:59.392435 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.392457 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.392702 (+ 245us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.392876 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.860485 (+467609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.194790 (+334305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.724857 (+530067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.385626 (+660769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.386160 (+ 534us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35100: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1260573,"server-negotiator.queue_time_us":1187969}
W20260619 18:46:01.428377 13205 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.037843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35070)
0619 18:45:58.277562 (+239719us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.279615 (+ 2053us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.302114 (+ 22499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.353537 (+1051423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.354359 (+ 822us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.354527 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.663857 (+309330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.663913 (+ 56us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.045690 (+381777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.045737 (+ 47us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.512882 (+467145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:00.514401 (+ 1519us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.426869 (+912468us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":197751,"mutex_wait_us":964451,"thread_start_us":153038,"threads_started":1}
W20260619 18:46:01.430964 13215 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.235765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35100)
0619 18:45:58.430021 (+194256us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.431294 (+ 1273us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.433938 (+ 2644us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.393121 (+959183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.393157 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.393293 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.856037 (+462744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.857363 (+ 1326us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.197472 (+340109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.197507 (+ 35us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.712631 (+515124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:00.717729 (+ 5098us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.429087 (+711358us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":90669,"mutex_wait_us":1061591,"thread_start_us":8681,"threads_started":1}
W20260619 18:46:01.436347 12819 scanner-internal.cc:458] Time spent opening tablet: real 3.286s user 0.008s sys 0.011s
W20260619 18:46:01.439353 12933 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.024628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55466 (local address 127.6.120.193:37901)
0619 18:45:58.146393 (+121765us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:58.148801 (+ 2408us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:58.314651 (+165850us) server_negotiation.cc:407] Connection header received
0619 18:45:58.365868 (+ 51217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:58.367216 (+ 1348us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:58.495111 (+127895us) spinlock_profiling.cc:243] Waited 8.12 ms on lock 0x7b4800081e18. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f1388974ec8 00007f13889735c8 00007f13889140e0 00007f1388913915 00007f1388932d3c
0619 18:45:58.524393 (+ 29282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:58.566354 (+ 41961us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:59.216502 (+650148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.721497 (+504995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.432592 (+1711095us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:55466: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1314063,"server-negotiator.queue_time_us":131,"spinlock_wait_cycles":18679680}
W20260619 18:46:01.447885 12817 scanner-internal.cc:458] Time spent opening tablet: real 3.621s user 0.001s sys 0.013s
W20260619 18:46:01.452941 12455 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.140198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35084)
0619 18:45:58.173329 (+ 33131us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.173385 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.173669 (+ 284us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.363734 (+1190065us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.363772 (+ 38us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.363923 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.901945 (+538022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.902008 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.275875 (+373867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.283142 (+ 7267us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.379198 (+1096056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.379265 (+ 67us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.416782 (+ 37517us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":18735,"mutex_wait_us":1542668}
W20260619 18:46:01.454676 13196 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.931413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35060)
0619 18:45:58.174422 (+243009us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.174492 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.187132 (+ 12640us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.323490 (+1136358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.323534 (+ 44us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.323713 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.670571 (+346858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.670935 (+ 364us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.783560 (+112625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.783808 (+ 248us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.390991 (+1607183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.391044 (+ 53us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.453086 (+ 62042us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":209595,"mutex_wait_us":1834401,"thread_start_us":63446,"threads_started":1}
W20260619 18:46:01.456166 13176 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.633677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35024)
0619 18:45:57.704528 (+ 70851us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.704596 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.704841 (+ 245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.142318 (+1437477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.142358 (+ 40us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.142475 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.510627 (+368152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.510698 (+ 71us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.701808 (+191110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.701856 (+ 48us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.087401 (+385545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:00.090266 (+ 2865us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.275722 (+185456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.280346 (+ 4624us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.590578 (+310232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:00.746549 (+155971us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:46:00.746581 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:46:00.746638 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:46:00.746781 (+ 143us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:46:01.409978 (+663197us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":61536,"mutex_wait_us":1795722,"thread_start_us":48382,"threads_started":1}
W20260619 18:46:01.462766 12585 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.399674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35170 (local address 127.6.120.254:36501)
0619 18:45:59.597360 (+1197686us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.597393 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.597441 (+ 48us) server_negotiation.cc:407] Connection header received
0619 18:45:59.597585 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.597615 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.597899 (+ 284us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.598074 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.717367 (+119293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.566926 (+849559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.452316 (+885390us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35170: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":899493,"server-negotiator.queue_time_us":1183186}
W20260619 18:46:01.468477 13202 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.000945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:55466)
0619 18:45:58.307504 (+306559us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.308979 (+ 1475us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.346375 (+ 37396us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:58.567023 (+220648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:58.597374 (+ 30351us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:58.607374 (+ 10000us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:59.216093 (+608719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.216194 (+ 101us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.722793 (+506599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.723208 (+ 415us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.387297 (+1664089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.387378 (+ 81us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.466373 (+ 78995us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":214827,"mutex_wait_us":2183714,"thread_start_us":169205,"threads_started":1}
I20260619 18:46:01.470880 12179 scanner-internal.cc:172] Scan of tablet 1f02be074be240fa8534ef577aa46f77 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:46:01.471356 12179 scanner-internal.cc:458] Time spent opening tablet: real 3.759s user 0.002s sys 0.003s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:46:01.475574 12563 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.931555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35060 (local address 127.6.120.254:36501)
0619 18:45:59.320735 (+1389180us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.320772 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.320819 (+ 47us) server_negotiation.cc:407] Connection header received
0619 18:45:59.320946 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.320971 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.321238 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.321416 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.671195 (+349779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.781448 (+110253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.466314 (+1684866us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35060: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":595021,"server-negotiator.queue_time_us":1388750}
W20260619 18:46:01.484687 13218 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.286779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35114)
0619 18:45:58.434506 (+147727us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.434559 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.434790 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.391231 (+956441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.391268 (+ 37us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.391388 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.689805 (+298417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.689867 (+ 62us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.732878 (+ 43011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.734924 (+ 2046us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.684724 (+949800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:00.687514 (+ 2790us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.465767 (+778253us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":140011,"mutex_wait_us":1264640,"thread_start_us":71576,"threads_started":1}
W20260619 18:46:01.502489 12636 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.323536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35130 (local address 127.6.120.254:36501)
0619 18:45:59.488766 (+1165230us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.488803 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.488848 (+ 45us) server_negotiation.cc:407] Connection header received
0619 18:45:59.493423 (+ 4575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.494473 (+ 1050us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.508197 (+ 13724us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.508410 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.761854 (+253444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.053178 (+291324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.491804 (+1438626us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35130: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":489699,"server-negotiator.queue_time_us":1162505}
W20260619 18:46:01.505931 12907 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.462355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35198)
0619 18:45:58.626157 (+163802us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.626219 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.626504 (+ 285us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.678078 (+1051574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.678113 (+ 35us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.678236 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.871145 (+192909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.871202 (+ 57us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.195311 (+324109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.195349 (+ 38us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.378811 (+1183462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.378875 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.504595 (+125720us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: received 0 of 4 requested bytes
Metrics: {"client-negotiator.queue_time_us":4237,"mutex_wait_us":1389580}
W20260619 18:46:01.499717 12831 client.cc:2034] Couldn't close scanner 7b3c2a400e9e4074bdee786a43da5d5a: Service unavailable: reactor is shutting down (error 108)
W20260619 18:46:01.527588 12516 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.447701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35178 (local address 127.6.120.254:36501)
0619 18:45:59.602656 (+1154955us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.602699 (+ 43us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.603584 (+ 885us) server_negotiation.cc:407] Connection header received
0619 18:45:59.604693 (+ 1109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.604721 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.604985 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.605170 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.959153 (+353983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.487747 (+528594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.526400 (+1038653us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35178: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":569934,"server-negotiator.queue_time_us":1152249}
W20260619 18:46:01.541977 12480 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.491436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55542 (local address 127.6.120.193:37901)
0619 18:45:58.885231 (+393795us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:58.885266 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:58.885314 (+ 48us) server_negotiation.cc:407] Connection header received
0619 18:45:58.885450 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:58.885478 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:58.885822 (+ 344us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:58.886074 (+ 252us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 18:45:59.614707 (+728633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.823145 (+208438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.489534 (+666389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.747653 (+258119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.396217 (+648564us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:01.518937 (+122720us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:55542: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1123820,"server-negotiator.queue_time_us":393381,"thread_start_us":276310,"threads_started":1}
W20260619 18:46:01.543175 12544 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.446452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35186 (local address 127.6.120.254:36501)
0619 18:45:59.598680 (+1152228us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.598720 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.599504 (+ 784us) server_negotiation.cc:407] Connection header received
0619 18:45:59.603602 (+ 4098us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.604197 (+ 595us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.606920 (+ 2723us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.610194 (+ 3274us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.969901 (+359707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.500569 (+530668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.528984 (+1028415us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35186: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":637268,"server-negotiator.queue_time_us":1149576}
W20260619 18:46:01.543632 12595 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.511443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35180 (local address 127.6.120.254:36501)
0619 18:45:59.633727 (+1122284us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.633767 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.633837 (+ 70us) server_negotiation.cc:407] Connection header received
0619 18:45:59.634006 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.634035 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.634298 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.634513 (+ 215us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.874638 (+240125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.449245 (+574607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.502093 (+1052848us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35180: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":631671,"server-negotiator.queue_time_us":1115996}
W20260619 18:46:01.545017 12824 scanner-internal.cc:458] Time spent opening tablet: real 3.106s user 0.029s sys 0.060s
W20260619 18:46:01.547112 12591 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.105629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35084 (local address 127.6.120.254:36501)
0619 18:45:59.347128 (+1241499us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.347164 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.347221 (+ 57us) server_negotiation.cc:407] Connection header received
0619 18:45:59.347369 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.347398 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.356736 (+ 9338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.366375 (+ 9639us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.902318 (+535943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.271164 (+368846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.485475 (+1214311us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35084: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":981456,"server-negotiator.queue_time_us":1241058}
W20260619 18:46:01.541283 12816 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.055838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53120)
0619 18:45:57.060305 (+ 4467us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.060360 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.060590 (+ 230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:58.373938 (+1313348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:58.373978 (+ 40us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:58.374114 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.122609 (+748495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.129170 (+ 6561us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.673430 (+544260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.673474 (+ 44us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.359507 (+1686033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.359586 (+ 79us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.465327 (+105741us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":3952,"mutex_wait_us":2453039,"thread_start_us":61050,"threads_started":1}
W20260619 18:46:01.551537 12648 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.038046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35070 (local address 127.6.120.254:36501)
0619 18:45:59.351151 (+1313105us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.351204 (+ 53us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.351296 (+ 92us) server_negotiation.cc:407] Connection header received
0619 18:45:59.351900 (+ 604us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.351950 (+ 50us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.352323 (+ 373us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.353457 (+ 1134us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.665914 (+312457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.043156 (+377242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.525399 (+482243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.549600 (+1024201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.550185 (+ 585us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35070: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1569858,"server-negotiator.queue_time_us":1305622}
W20260619 18:46:01.566533 13229 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.427761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35178)
0619 18:45:58.895484 (+467723us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.895553 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.895930 (+ 377us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.605716 (+709786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.605748 (+ 32us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.605906 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.957826 (+351920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.957887 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.488303 (+530416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.488338 (+ 35us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.479374 (+991036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.480924 (+ 1550us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.564675 (+ 83751us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":467044,"mutex_wait_us":1324129,"thread_start_us":136747,"threads_started":1}
W20260619 18:46:01.626538 13225 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.309890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35130)
0619 18:45:58.489690 (+179800us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.489760 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.490098 (+ 338us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.508509 (+1018411us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.508543 (+ 34us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.508685 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.761449 (+252764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.761542 (+ 93us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.061757 (+300215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.063476 (+ 1719us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.613701 (+1550225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.613756 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.614552 (+ 796us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":175686,"mutex_wait_us":1725148,"thread_start_us":140592,"threads_started":1}
W20260619 18:46:01.626179 12058 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.630079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35198 (local address 127.6.120.254:36501)
0619 18:45:59.673453 (+1043374us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.673487 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.674337 (+ 850us) server_negotiation.cc:407] Connection header received
0619 18:45:59.675958 (+ 1621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.676022 (+ 64us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.676679 (+ 657us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.677836 (+ 1157us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.871478 (+193642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.193734 (+322256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.379557 (+1185823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.602657 (+223100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.624511 (+ 21854us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35198: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":569978,"server-negotiator.queue_time_us":1042969}
W20260619 18:46:01.655573 11040 connection.cc:441] server connection from 127.0.0.1:55512 torn down before Call kudu.tserver.TabletServerService.Scan from 127.0.0.1:55512 (request call id 2) could send its response
W20260619 18:46:01.656509 12652 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.513833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35200 (local address 127.6.120.254:36501)
0619 18:45:59.639770 (+1125937us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.639794 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.639830 (+ 36us) server_negotiation.cc:407] Connection header received
0619 18:45:59.639957 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.639998 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.640242 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.640955 (+ 713us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:46:00.011358 (+370403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.314025 (+302667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.652909 (+1338884us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35200: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":405468,"server-negotiator.queue_time_us":1125554}
W20260619 18:46:01.660899 12222 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 46245.6us
W20260619 18:46:01.665306 13185 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.707075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35056)
0619 18:45:58.006849 (+299774us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.006913 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.007251 (+ 338us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.265355 (+1258104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.266285 (+ 930us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.274455 (+ 8170us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.963019 (+688564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.964729 (+ 1710us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.312667 (+347938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.312705 (+ 38us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.526207 (+1213502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.526268 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.663563 (+137295us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":263702,"mutex_wait_us":1909308,"thread_start_us":212598,"threads_started":1}
W20260619 18:46:01.671007 13134 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.232235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:53170)
0619 18:45:57.364777 (+132542us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.364839 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.365106 (+ 267us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:58.884287 (+1519181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:58.884323 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:58.884474 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.239913 (+355439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.239977 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.952806 (+712829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.952844 (+ 38us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.457024 (+1504180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.457086 (+ 62us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.669155 (+212069us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":131415,"mutex_wait_us":1952211,"thread_start_us":42486,"threads_started":1}
W20260619 18:46:01.672313 13163 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 217878us
W20260619 18:46:01.676371 12437 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.466854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35180)
0619 18:45:58.497067 (+ 30213us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.497116 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.497373 (+ 257us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.634749 (+1137376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.634789 (+ 40us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.634917 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.873416 (+238499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.873498 (+ 82us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.453554 (+580056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.456604 (+ 3050us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.532926 (+1076322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.534871 (+ 1945us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.674934 (+140063us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":16026,"mutex_wait_us":1367207}
W20260619 18:46:01.679901 13177 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:57.645545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35048)
0619 18:45:57.770170 (+124625us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:57.779041 (+ 8871us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:57.794127 (+ 15086us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.158741 (+1364614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.158777 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.158930 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.159736 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.159821 (+ 85us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.791813 (+631992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.791854 (+ 41us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.475887 (+684033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:00.475954 (+ 67us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.587062 (+111108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.587099 (+ 37us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.521228 (+934129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:01.538149 (+ 16921us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:46:01.538169 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:46:01.538234 (+ 65us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:46:01.538397 (+ 163us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:46:01.670046 (+131649us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":70222,"mutex_wait_us":1697978,"thread_start_us":37261,"threads_started":1}
W20260619 18:46:01.684487 12823 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.472020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35200)
0619 18:45:58.473636 (+ 1616us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.473703 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.474032 (+ 329us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.640547 (+1166515us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.640580 (+ 33us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.640711 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:46:00.008887 (+368176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:00.010465 (+ 1578us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.314485 (+304020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.314519 (+ 34us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.560597 (+1246078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.560655 (+ 58us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.683065 (+122410us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1009,"mutex_wait_us":1348194}
W20260619 18:46:01.688227 13231 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.444819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35186)
0619 18:45:58.490646 (+ 45827us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.490714 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.490978 (+ 264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.610535 (+1119557us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.610594 (+ 59us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.610795 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.968311 (+357516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.969562 (+ 1251us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.500883 (+531321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.500922 (+ 39us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.570602 (+1069680us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.572797 (+ 2195us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.686686 (+113889us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":45326,"mutex_wait_us":1469811,"thread_start_us":43309,"threads_started":1}
W20260619 18:46:01.742625 12624 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.309179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35114 (local address 127.6.120.254:36501)
0619 18:45:59.389691 (+1080512us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.389724 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.389773 (+ 49us) server_negotiation.cc:407] Connection header received
0619 18:45:59.389923 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.389952 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.390216 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.390401 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.600932 (+210531us) spinlock_profiling.cc:243] Waited 984 us on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f1383fad480 00007f1383fac911 00007f138897370c 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:59.713391 (+112459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.725994 (+ 12603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.691882 (+965888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.554476 (+862594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.714507 (+160031us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35114: sent 0 of 16 requested bytes
Metrics: {"mutex_wait_us":1317200,"server-negotiator.queue_time_us":1078326,"spinlock_wait_cycles":2263296}
W20260619 18:46:01.744408 12170 scanner-internal.cc:458] Time spent opening tablet: real 2.325s user 0.013s sys 0.001s
W20260619 18:46:01.744370 12162 scanner-internal.cc:458] Time spent opening tablet: real 2.655s user 0.003s sys 0.000s
W20260619 18:46:01.779081 13233 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.491300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.193:37901 (local address 127.0.0.1:55542)
0619 18:45:58.778006 (+286706us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.778113 (+ 107us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.778700 (+ 587us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:58.887026 (+108326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:58.887078 (+ 52us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:58.887149 (+ 71us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 18:45:59.612288 (+725139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.612366 (+ 78us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:45:59.825341 (+212975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:45:59.825403 (+ 62us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:00.488264 (+662861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:00.488317 (+ 53us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.821149 (+332832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.883892 (+ 62743us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.568436 (+684544us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:01.598172 (+ 29736us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 18:46:01.761409 (+163237us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":35921,"mutex_wait_us":2149710,"thread_start_us":561,"threads_started":1}
I20260619 18:46:01.804332 12642 scanner-internal.cc:172] Scan of tablet d63b7834d93346288748391962132228 at 67aa5c51d6d845d49abea1320970e12b (127.6.120.193:37901) deadline exceeded after 30.000s
W20260619 18:46:01.804841 12642 scanner-internal.cc:458] Time spent opening tablet: real 3.457s user 0.024s sys 0.049s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:457: Failure
Failed
Bad status: Timed out: exceeded configured scan timeout of 30.000s: Client connection negotiation failed: client connection to 127.6.120.193:37901: sent 0 of 16 requested bytes
W20260619 18:46:01.818928 12947 scanner-internal.cc:458] Time spent opening tablet: real 2.590s user 0.012s sys 0.006s
W20260619 18:46:01.825019 12121 scanner-internal.cc:458] Time spent opening tablet: real 3.394s user 0.028s sys 0.032s
W20260619 18:46:01.835263 12903 scanner-internal.cc:458] Time spent opening tablet: real 2.446s user 0.025s sys 0.019s
W20260619 18:46:01.835891 13190 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 223206us
W20260619 18:46:01.878750 12157 scanner-internal.cc:458] Time spent opening tablet: real 3.019s user 0.016s sys 0.033s
W20260619 18:46:01.898666 12869 scanner-internal.cc:458] Time spent opening tablet: real 2.779s user 0.021s sys 0.018s
W20260619 18:46:01.908521 12155 scanner-internal.cc:458] Time spent opening tablet: real 3.051s user 0.021s sys 0.023s
W20260619 18:46:01.909549 12474 scanner-internal.cc:458] Time spent opening tablet: real 2.969s user 0.013s sys 0.026s
W20260619 18:46:01.914377 12936 scanner-internal.cc:458] Time spent opening tablet: real 2.539s user 0.001s sys 0.008s
W20260619 18:46:01.936954 12485 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:58.424906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35170)
0619 18:45:58.434852 (+ 9946us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:58.434903 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:58.435116 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.600276 (+1165160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.600312 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.600436 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.716469 (+116033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.716533 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.575916 (+859383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.576969 (+ 1053us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.911654 (+1334685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.911713 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.929218 (+ 17505us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":1857,"mutex_wait_us":1404608}
W20260619 18:46:01.983678 12798 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 315017us
W20260619 18:46:01.988534 12240 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 114648us
W20260619 18:46:01.992623 12850 scanner-internal.cc:458] Time spent opening tablet: real 3.059s user 0.007s sys 0.015s
W20260619 18:46:02.093825 12086 scanner-internal.cc:458] Time spent opening tablet: real 1.956s user 0.014s sys 0.005s
W20260619 18:46:02.104362 12186 scanner-internal.cc:458] Time spent opening tablet: real 2.214s user 0.001s sys 0.005s
W20260619 18:46:02.112442 13030 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 137767us
W20260619 18:46:02.124945 13070 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:59.090753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35246)
0619 18:45:59.129331 (+ 38578us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:59.131251 (+ 1920us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:59.143801 (+ 12550us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.759387 (+615586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.759423 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.759582 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.934660 (+175078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.934720 (+ 60us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.503643 (+568923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.503689 (+ 46us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.652337 (+1148648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.652388 (+ 51us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.811260 (+158872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.811296 (+ 36us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:02.045249 (+233953us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:02.054615 (+ 9366us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:46:02.055554 (+ 939us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:46:02.056748 (+ 1194us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:46:02.059547 (+ 2799us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:46:02.068934 (+ 9387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 18:46:02.069302 (+ 368us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 18:46:02.070821 (+ 1519us) client_negotiation.cc:769] Sending connection context
0619 18:46:02.115051 (+ 44230us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":1534443}
W20260619 18:46:02.149168 12902 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 69356.6us
W20260619 18:46:02.174908 12960 scanner-internal.cc:458] Time spent opening tablet: real 2.205s user 0.002s sys 0.002s
W20260619 18:46:02.187062 12163 scanner-internal.cc:458] Time spent opening tablet: real 2.473s user 0.008s sys 0.000s
W20260619 18:46:02.194175 12081 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:59.068026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35246 (local address 127.6.120.254:36501)
0619 18:45:59.758258 (+690232us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.758303 (+ 45us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.758384 (+ 81us) server_negotiation.cc:407] Connection header received
0619 18:45:59.758568 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.758613 (+ 45us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.759007 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.759284 (+ 277us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.936944 (+177660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.496023 (+559079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.656587 (+1160564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.809997 (+153410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.838072 (+ 28075us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:02.065585 (+227513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 18:46:02.065640 (+ 55us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 18:46:02.065668 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 18:46:02.065730 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0619 18:46:02.065823 (+ 93us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 18:46:02.065897 (+ 74us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 18:46:02.066056 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0619 18:46:02.119641 (+ 53585us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35246: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":913311,"server-negotiator.queue_time_us":689564}
W20260619 18:46:02.194247 12137 scanner-internal.cc:458] Time spent opening tablet: real 2.581s user 0.005s sys 0.001s
W20260619 18:46:02.194800 12608 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:59.039959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35232 (local address 127.6.120.254:36501)
0619 18:45:59.740597 (+700638us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.740633 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.740684 (+ 51us) server_negotiation.cc:407] Connection header received
0619 18:45:59.740807 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.740831 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.741085 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.741265 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:46:00.143428 (+402163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.647966 (+504538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.689413 (+1041447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:02.002927 (+313514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:02.081115 (+ 78188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:02.120262 (+ 39147us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35232: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1051472,"server-negotiator.queue_time_us":688985}
W20260619 18:46:02.194561 13015 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:59.121940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35250 (local address 127.6.120.254:36501)
0619 18:45:59.765568 (+643628us) server_negotiation.cc:206] Beginning negotiation
0619 18:45:59.765614 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0619 18:45:59.765676 (+ 62us) server_negotiation.cc:407] Connection header received
0619 18:45:59.765854 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 18:45:59.765897 (+ 43us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 18:45:59.766399 (+ 502us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 18:45:59.769652 (+ 3253us) server_negotiation.cc:226] Negotiated authn=SASL
0619 18:45:59.779830 (+ 10178us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b4800082718. stack: 00007f1383e24033 00007f1383e23f30 00007f1383782534 000000000061e4a4 000000000061e439 00007f1383c9af11 00007f1383e1e851 00007f1383e1e702 0000000000632649 00007f13888cac20 00007f138897f481 00007f13889736a9 00007f13889140e0 00007f1388913915 00007f1388932d3c 00007f1388932cb9
0619 18:45:59.978024 (+198194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.506531 (+528507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.634603 (+1128072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.960948 (+326345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 18:46:02.011176 (+ 50228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:02.191013 (+179837us) negotiation.cc:327] Negotiation complete: Timed out: Server connection negotiation failed: server connection from 127.0.0.1:35250: received 0 of 4 requested bytes
Metrics: {"mutex_wait_us":1113794,"server-negotiator.queue_time_us":642990,"spinlock_wait_cycles":4909312}
W20260619 18:46:02.222476 12868 scanner-internal.cc:458] Time spent opening tablet: real 2.702s user 0.017s sys 0.032s
W20260619 18:46:02.246364 12773 scanner-internal.cc:458] Time spent opening tablet: real 2.351s user 0.001s sys 0.003s
W20260619 18:46:02.270345 12507 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:59.122298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35250)
0619 18:45:59.184867 (+ 62569us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:59.185582 (+ 715us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:59.189608 (+ 4026us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.768724 (+579116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.768760 (+ 36us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.768895 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:45:59.832903 (+ 64008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:45:59.832985 (+ 82us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.506848 (+673863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.506888 (+ 40us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.623655 (+1116767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.634299 (+ 10644us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:01.962850 (+328551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:01.962888 (+ 38us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:02.074746 (+111858us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:02.138111 (+ 63365us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:46:02.138140 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:46:02.138198 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:46:02.138320 (+ 122us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:46:02.208700 (+ 70380us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":414,"mutex_wait_us":1346567}
W20260619 18:46:02.272359 13251 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 18:45:59.022224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.6.120.254:36501 (local address 127.0.0.1:35232)
0619 18:45:59.157143 (+134919us) negotiation.cc:107] Waiting for socket to connect
0619 18:45:59.157192 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0619 18:45:59.157551 (+ 359us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 18:45:59.746906 (+589355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 18:45:59.746952 (+ 46us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 18:45:59.747086 (+ 134us) client_negotiation.cc:189] Negotiated authn=SASL
0619 18:46:00.133735 (+386649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:00.140445 (+ 6710us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:00.677517 (+537072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:00.678828 (+ 1311us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:01.689048 (+1010220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 18:46:01.689111 (+ 63us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 18:46:02.005489 (+316378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 18:46:02.006556 (+ 1067us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 18:46:02.131283 (+124727us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 18:46:02.138637 (+ 7354us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 18:46:02.139377 (+ 740us) client_negotiation.cc:656] calling sasl_client_start()
0619 18:46:02.140044 (+ 667us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 18:46:02.143856 (+ 3812us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 18:46:02.249509 (+105653us) negotiation.cc:327] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.6.120.254:36501: sent 0 of 16 requested bytes
Metrics: {"client-negotiator.queue_time_us":112734,"mutex_wait_us":1511278,"thread_start_us":72473,"threads_started":1}
W20260619 18:46:02.272851 13013 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 46562.7us
W20260619 18:46:02.286136 12133 scanner-internal.cc:458] Time spent opening tablet: real 2.911s user 0.008s sys 0.012s
W20260619 18:46:02.297443 12212 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 88096.6us
W20260619 18:46:02.298117 12991 scanner-internal.cc:458] Time spent opening tablet: real 2.585s user 0.000s sys 0.003s
W20260619 18:46:02.321272 12931 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 138425us
W20260619 18:46:02.367213 12829 scanner-internal.cc:458] Time spent opening tablet: real 2.360s user 0.001s sys 0.021s
W20260619 18:46:02.374517 12833 scanner-internal.cc:458] Time spent opening tablet: real 2.414s user 0.017s sys 0.013s
W20260619 18:46:02.445456 12198 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 82562.2us
W20260619 18:46:02.449011 13100 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 64834.3us
W20260619 18:46:02.527503 13089 scanner-internal.cc:458] Time spent opening tablet: real 2.053s user 0.003s sys 0.022s
W20260619 18:46:02.554453 12961 scanner-internal.cc:458] Time spent opening tablet: real 2.614s user 0.006s sys 0.007s
W20260619 18:46:02.561806 13162 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 108531us
W20260619 18:46:02.592054 13156 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 124073us
W20260619 18:46:02.624631 12801 scanner-internal.cc:458] Time spent opening tablet: real 1.229s user 0.010s sys 0.009s
W20260619 18:46:02.624789 13020 scanner-internal.cc:458] Time spent opening tablet: real 2.102s user 0.007s sys 0.037s
W20260619 18:46:02.624897 12237 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 149782us
W20260619 18:46:02.631681 12992 scanner-internal.cc:458] Time spent opening tablet: real 2.095s user 0.002s sys 0.005s
W20260619 18:46:02.639791 12920 scanner-internal.cc:458] Time spent opening tablet: real 2.832s user 0.004s sys 0.008s
W20260619 18:46:02.633064 12886 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 129037us
W20260619 18:46:02.695062 12951 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 177346us
W20260619 18:46:02.710259 13086 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 140533us
W20260619 18:46:02.770807 13137 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 44832.9us
W20260619 18:46:02.775449 12197 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 129986us
W20260619 18:46:02.753682 13097 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 108923us
W20260619 18:46:02.779629 13191 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 90526us
W20260619 18:46:02.802192 12060 scanner-internal.cc:458] Time spent opening tablet: real 2.407s user 0.011s sys 0.007s
W20260619 18:46:02.802946 13135 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 205827us
W20260619 18:46:02.817807 13085 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 61639.6us
W20260619 18:46:02.848964 12220 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 92043.6us
W20260619 18:46:02.866639 12207 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 259516us
W20260619 18:46:02.930025 12672 scanner-internal.cc:458] Time spent opening tablet: real 2.721s user 0.013s sys 0.022s
W20260619 18:46:02.976752 12156 scanner-internal.cc:458] Time spent opening tablet: real 2.402s user 0.006s sys 0.015s
W20260619 18:46:02.985278 12280 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 176819us
W20260619 18:46:02.987723 12767 scanner-internal.cc:458] Time spent opening tablet: real 2.791s user 0.005s sys 0.006s
W20260619 18:46:02.998129 12578 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 260075us
W20260619 18:46:03.035023 12859 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 327273us
W20260619 18:46:03.049872 12189 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 358433us
W20260619 18:46:03.046686 12514 scanner-internal.cc:458] Time spent opening tablet: real 2.459s user 0.042s sys 0.019s
W20260619 18:46:03.072419 12731 scanner-internal.cc:458] Time spent opening tablet: real 2.875s user 0.011s sys 0.024s
W20260619 18:46:03.072633 12745 scanner-internal.cc:458] Time spent opening tablet: real 2.876s user 0.009s sys 0.009s
W20260619 18:46:03.116083 12969 scanner-internal.cc:458] Time spent opening tablet: real 0.771s user 0.009s sys 0.001s
W20260619 18:46:03.116387 12206 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 251311us
W20260619 18:46:03.125262 12233 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 141132us
W20260619 18:46:03.144677 12783 scanner-internal.cc:458] Time spent opening tablet: real 1.769s user 0.001s sys 0.011s
W20260619 18:46:03.177753 13117 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 387524us
W20260619 18:46:03.224834 12789 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 148294us
W20260619 18:46:03.232326 13159 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 320619us
W20260619 18:46:03.256145 12689 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 432657us
W20260619 18:46:03.257493 12174 scanner-internal.cc:458] Time spent opening tablet: real 1.238s user 0.008s sys 0.013s
W20260619 18:46:03.259678 12211 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 150063us
W20260619 18:46:03.304600 12127 scanner-internal.cc:458] Time spent opening tablet: real 0.943s user 0.011s sys 0.005s
W20260619 18:46:03.323374 12788 scanner-internal.cc:458] Time spent opening tablet: real 1.312s user 0.009s sys 0.003s
W20260619 18:46:03.360152 12148 scanner-internal.cc:458] Time spent opening tablet: real 2.029s user 0.008s sys 0.005s
W20260619 18:46:03.386521 13128 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 332441us
W20260619 18:46:03.406448 13166 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 496166us
W20260619 18:46:03.437857 13096 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 348283us
W20260619 18:46:03.513428 12803 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 162861us
W20260619 18:46:03.521111 12152 scanner-internal.cc:458] Time spent opening tablet: real 1.777s user 0.003s sys 0.019s
W20260619 18:46:03.547542 13151 scanner-internal.cc:458] Time spent opening tablet: real 1.865s user 0.007s sys 0.004s
W20260619 18:46:03.597856 13169 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 225450us
W20260619 18:46:03.762169 12956 scanner-internal.cc:458] Time spent opening tablet: real 1.415s user 0.003s sys 0.002s
W20260619 18:46:03.765724 12251 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 232898us
W20260619 18:46:03.781483 12771 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 376974us
W20260619 18:46:03.866501 12968 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 253053us
W20260619 18:46:03.971501 12860 scanner-internal.cc:458] Time spent opening tablet: real 1.614s user 0.009s sys 0.004s
W20260619 18:46:04.007313 12875 scanner-internal.cc:458] Time spent opening tablet: real 1.736s user 0.013s sys 0.007s
W20260619 18:46:04.010100 12129 scanner-internal.cc:458] Time spent opening tablet: real 1.550s user 0.001s sys 0.007s
W20260619 18:46:04.017809 12993 scanner-internal.cc:458] Time spent opening tablet: real 1.795s user 0.016s sys 0.002s
W20260619 18:46:04.028967 12981 scanner-internal.cc:458] Time spent opening tablet: real 1.678s user 0.023s sys 0.006s
W20260619 18:46:04.059809 13155 scanner-internal.cc:458] Time spent opening tablet: real 1.186s user 0.007s sys 0.013s
W20260619 18:46:04.061364 13167 scanner-internal.cc:458] Time spent opening tablet: real 2.143s user 0.005s sys 0.008s
W20260619 18:46:04.088626 13170 scanner-internal.cc:458] Time spent opening tablet: real 1.568s user 0.002s sys 0.002s
W20260619 18:46:04.174047 12841 scanner-internal.cc:458] Time spent opening tablet: real 1.446s user 0.015s sys 0.015s
W20260619 18:46:04.186373 13127 scanner-internal.cc:458] Time spent opening tablet: real 1.583s user 0.005s sys 0.014s
W20260619 18:46:04.197918 13042 scanner-internal.cc:458] Time spent opening tablet: real 1.738s user 0.007s sys 0.012s
W20260619 18:46:04.209712 13230 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.ConnectToMaster -> {remote=127.6.120.254:36501, user_credentials={real_user=slave}} blocked reactor thread for 407484us
W20260619 18:46:04.255657 12172 scanner-internal.cc:458] Time spent opening tablet: real 1.542s user 0.009s sys 0.025s
W20260619 18:46:04.280877 13113 scanner-internal.cc:458] Time spent opening tablet: real 1.402s user 0.003s sys 0.009s
W20260619 18:46:04.282954 12126 scanner-internal.cc:458] Time spent opening tablet: real 1.636s user 0.012s sys 0.010s
W20260619 18:46:04.294473 13132 scanner-internal.cc:458] Time spent opening tablet: real 1.682s user 0.012s sys 0.008s
W20260619 18:46:04.312145 13047 scanner-internal.cc:458] Time spent opening tablet: real 1.329s user 0.041s sys 0.033s
W20260619 18:46:04.346256 12668 scanner-internal.cc:458] Time spent opening tablet: real 0.824s user 0.004s sys 0.012s
W20260619 18:46:04.374409 13130 scanner-internal.cc:458] Time spent opening tablet: real 1.543s user 0.005s sys 0.004s
W20260619 18:46:04.419595 12151 scanner-internal.cc:458] Time spent opening tablet: real 1.380s user 0.053s sys 0.009s
W20260619 18:46:04.423527 12130 scanner-internal.cc:458] Time spent opening tablet: real 1.487s user 0.004s sys 0.005s
W20260619 18:46:04.437445 13054 scanner-internal.cc:458] Time spent opening tablet: real 1.613s user 0.012s sys 0.015s
W20260619 18:46:04.446051 12465 scanner-internal.cc:458] Time spent opening tablet: real 1.237s user 0.013s sys 0.021s
W20260619 18:46:04.457394 12882 scanner-internal.cc:458] Time spent opening tablet: real 1.582s user 0.003s sys 0.012s
W20260619 18:46:04.480468 13148 scanner-internal.cc:458] Time spent opening tablet: real 0.988s user 0.011s sys 0.013s
W20260619 18:46:04.502683 12138 scanner-internal.cc:458] Time spent opening tablet: real 1.130s user 0.012s sys 0.020s
W20260619 18:46:04.518020 12117 scanner-internal.cc:458] Time spent opening tablet: real 1.212s user 0.004s sys 0.028s
W20260619 18:46:04.519985 13079 scanner-internal.cc:458] Time spent opening tablet: real 0.978s user 0.007s sys 0.042s
W20260619 18:46:04.541155 13171 scanner-internal.cc:458] Time spent opening tablet: real 1.605s user 0.001s sys 0.021s
W20260619 18:46:04.546574 12139 scanner-internal.cc:458] Time spent opening tablet: real 1.258s user 0.019s sys 0.006s
W20260619 18:46:04.573974 12167 scanner-internal.cc:458] Time spent opening tablet: real 1.236s user 0.013s sys 0.018s
W20260619 18:46:04.582521 12835 scanner-internal.cc:458] Time spent opening tablet: real 1.228s user 0.039s sys 0.013s
W20260619 18:46:04.583818 12779 scanner-internal.cc:458] Time spent opening tablet: real 1.049s user 0.004s sys 0.014s
W20260619 18:46:04.621649 12184 scanner-internal.cc:458] Time spent opening tablet: real 0.649s user 0.010s sys 0.007s
W20260619 18:46:04.640833 13109 scanner-internal.cc:458] Time spent opening tablet: real 1.244s user 0.003s sys 0.008s
W20260619 18:46:04.647011 13140 scanner-internal.cc:458] Time spent opening tablet: real 0.883s user 0.013s sys 0.005s
W20260619 18:46:04.671082 12169 scanner-internal.cc:458] Time spent opening tablet: real 1.084s user 0.019s sys 0.015s
W20260619 18:46:04.675485 12134 scanner-internal.cc:458] Time spent opening tablet: real 1.177s user 0.004s sys 0.011s
W20260619 18:46:04.676275 12761 scanner-internal.cc:458] Time spent opening tablet: real 0.707s user 0.008s sys 0.013s
W20260619 18:46:04.679025 13084 scanner-internal.cc:458] Time spent opening tablet: real 1.746s user 0.011s sys 0.016s
W20260619 18:46:04.682729 13149 scanner-internal.cc:458] Time spent opening tablet: real 0.944s user 0.013s sys 0.001s
W20260619 18:46:04.707201 12795 scanner-internal.cc:458] Time spent opening tablet: real 0.944s user 0.021s sys 0.008s
W20260619 18:46:04.728281 13102 scanner-internal.cc:458] Time spent opening tablet: real 1.158s user 0.014s sys 0.016s
W20260619 18:46:04.735358 12908 scanner-internal.cc:458] Time spent opening tablet: real 0.750s user 0.007s sys 0.000s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:9066: Failure
Expected equality of these values:
1000
CountRows(tokens)
Which is: 715
I20260619 18:46:04.814723 6627 tablet_server.cc:178] TabletServer@127.6.120.193:0 shutting down...
I20260619 18:46:04.868147 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:46:04.869688 6627 tablet_replica.cc:330] T 1f02be074be240fa8534ef577aa46f77 P 67aa5c51d6d845d49abea1320970e12b: stopping tablet replica
I20260619 18:46:04.870831 6627 raft_consensus.cc:2229] T 1f02be074be240fa8534ef577aa46f77 P 67aa5c51d6d845d49abea1320970e12b [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:04.872030 6627 raft_consensus.cc:2258] T 1f02be074be240fa8534ef577aa46f77 P 67aa5c51d6d845d49abea1320970e12b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:04.889951 6627 tablet_replica.cc:330] T c679675f7d9c42e9ad71c188c7a6c595 P 67aa5c51d6d845d49abea1320970e12b: stopping tablet replica
I20260619 18:46:04.891033 6627 raft_consensus.cc:2229] T c679675f7d9c42e9ad71c188c7a6c595 P 67aa5c51d6d845d49abea1320970e12b [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:04.891798 6627 raft_consensus.cc:2258] T c679675f7d9c42e9ad71c188c7a6c595 P 67aa5c51d6d845d49abea1320970e12b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:04.895174 6627 tablet_replica.cc:330] T ece711fecbcf44beae2a210da7b57926 P 67aa5c51d6d845d49abea1320970e12b: stopping tablet replica
I20260619 18:46:04.896040 6627 raft_consensus.cc:2229] T ece711fecbcf44beae2a210da7b57926 P 67aa5c51d6d845d49abea1320970e12b [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:04.896991 6627 raft_consensus.cc:2258] T ece711fecbcf44beae2a210da7b57926 P 67aa5c51d6d845d49abea1320970e12b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:04.912392 6627 tablet_replica.cc:330] T d63b7834d93346288748391962132228 P 67aa5c51d6d845d49abea1320970e12b: stopping tablet replica
I20260619 18:46:04.913365 6627 raft_consensus.cc:2229] T d63b7834d93346288748391962132228 P 67aa5c51d6d845d49abea1320970e12b [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:04.914402 6627 raft_consensus.cc:2258] T d63b7834d93346288748391962132228 P 67aa5c51d6d845d49abea1320970e12b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:04.928805 6627 tablet_replica.cc:330] T 77f5f95c233a4022baf5b4992e90172d P 67aa5c51d6d845d49abea1320970e12b: stopping tablet replica
I20260619 18:46:04.929629 6627 raft_consensus.cc:2229] T 77f5f95c233a4022baf5b4992e90172d P 67aa5c51d6d845d49abea1320970e12b [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:04.930338 6627 raft_consensus.cc:2258] T 77f5f95c233a4022baf5b4992e90172d P 67aa5c51d6d845d49abea1320970e12b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:04.934314 6627 tablet_replica.cc:330] T 4161914b7a5e40a888261cedc6398a73 P 67aa5c51d6d845d49abea1320970e12b: stopping tablet replica
I20260619 18:46:04.935012 6627 raft_consensus.cc:2229] T 4161914b7a5e40a888261cedc6398a73 P 67aa5c51d6d845d49abea1320970e12b [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:04.935787 6627 raft_consensus.cc:2258] T 4161914b7a5e40a888261cedc6398a73 P 67aa5c51d6d845d49abea1320970e12b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260619 18:46:06.007267 6627 thread.cc:536] Waited for 1000ms trying to join with diag-logger (tid 11105)
W20260619 18:46:07.008078 6627 thread.cc:536] Waited for 2000ms trying to join with diag-logger (tid 11105)
W20260619 18:46:08.008591 6627 thread.cc:536] Waited for 3000ms trying to join with diag-logger (tid 11105)
W20260619 18:46:09.009084 6627 thread.cc:536] Waited for 4000ms trying to join with diag-logger (tid 11105)
W20260619 18:46:10.009582 6627 thread.cc:536] Waited for 5000ms trying to join with diag-logger (tid 11105)
W20260619 18:46:11.010067 6627 thread.cc:536] Waited for 6000ms trying to join with diag-logger (tid 11105)
W20260619 18:46:12.010571 6627 thread.cc:536] Waited for 7000ms trying to join with diag-logger (tid 11105)
W20260619 18:46:13.011056 6627 thread.cc:536] Waited for 8000ms trying to join with diag-logger (tid 11105)
I20260619 18:46:13.363319 6627 tablet_server.cc:194] TabletServer@127.6.120.193:0 shutdown complete.
I20260619 18:46:13.410322 6627 master.cc:537] Master@127.6.120.254:36501 shutting down...
I20260619 18:46:13.445815 6627 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 9ac8849341bc4dca9b41f97708342079 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:13.446699 6627 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 9ac8849341bc4dca9b41f97708342079 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:13.447103 6627 tablet_replica.cc:330] T 00000000000000000000000000000000 P 9ac8849341bc4dca9b41f97708342079: stopping tablet replica
I20260619 18:46:13.553608 6627 master.cc:552] Master@127.6.120.254:36501 shutdown complete.
I20260619 18:46:13.595350 6627 test_util.cc:175] -----------------------------------------------
I20260619 18:46:13.595640 6627 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.TableKeyRangeTest.TestGetTableKeyRange.1781894682485826-6627-0
[ FAILED ] TableKeyRangeTest.TestGetTableKeyRange (67460 ms)
[----------] 1 test from TableKeyRangeTest (67460 ms total)
[----------] 1 test from MultiTServerClientTest
[ RUN ] MultiTServerClientTest.WriteWhileRestartingMultipleTabletServers
I20260619 18:46:13.600703 6627 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.120.254:43699
I20260619 18:46:13.601900 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:46:13.608282 13427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:13.608377 13426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:13.609378 13429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:46:13.612318 6627 server_base.cc:1034] running on GCE node
I20260619 18:46:13.614709 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:46:13.614915 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:46:13.615043 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894773615034 us; error 0 us; skew 500 ppm
I20260619 18:46:13.615549 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:46:13.623560 6627 webserver.cc:460] Webserver started at http://127.6.120.254:34601/ using document root <none> and password file <none>
I20260619 18:46:13.624017 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:46:13.624275 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:46:13.624532 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:46:13.625741 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.MultiTServerClientTest.WriteWhileRestartingMultipleTabletServers.1781894682485826-6627-0/minicluster-data/master-0-root/instance:
uuid: "65e949a5535b4bafa1ac04e92c415808"
format_stamp: "Formatted at 2026-06-19 18:46:13 on dist-test-slave-90mn"
I20260619 18:46:13.630388 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260619 18:46:13.633950 13434 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:13.634832 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260619 18:46:13.635164 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.MultiTServerClientTest.WriteWhileRestartingMultipleTabletServers.1781894682485826-6627-0/minicluster-data/master-0-root
uuid: "65e949a5535b4bafa1ac04e92c415808"
format_stamp: "Formatted at 2026-06-19 18:46:13 on dist-test-slave-90mn"
I20260619 18:46:13.635435 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.MultiTServerClientTest.WriteWhileRestartingMultipleTabletServers.1781894682485826-6627-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.MultiTServerClientTest.WriteWhileRestartingMultipleTabletServers.1781894682485826-6627-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.MultiTServerClientTest.WriteWhileRestartingMultipleTabletServers.1781894682485826-6627-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:46:13.686302 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:46:13.687438 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:46:13.725214 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.254:43699
I20260619 18:46:13.725334 13485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.254:43699 every 8 connection(s)
I20260619 18:46:13.729880 13486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:13.742306 13486 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65e949a5535b4bafa1ac04e92c415808: Bootstrap starting.
I20260619 18:46:13.747767 13486 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 65e949a5535b4bafa1ac04e92c415808: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:13.752259 13486 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 65e949a5535b4bafa1ac04e92c415808: No bootstrap required, opened a new log
I20260619 18:46:13.754623 13486 raft_consensus.cc:348] T 00000000000000000000000000000000 P 65e949a5535b4bafa1ac04e92c415808 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65e949a5535b4bafa1ac04e92c415808" member_type: VOTER }
I20260619 18:46:13.755165 13486 raft_consensus.cc:374] T 00000000000000000000000000000000 P 65e949a5535b4bafa1ac04e92c415808 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:13.755358 13486 raft_consensus.cc:729] T 00000000000000000000000000000000 P 65e949a5535b4bafa1ac04e92c415808 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65e949a5535b4bafa1ac04e92c415808, State: Initialized, Role: FOLLOWER
I20260619 18:46:13.755896 13486 consensus_queue.cc:260] T 00000000000000000000000000000000 P 65e949a5535b4bafa1ac04e92c415808 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65e949a5535b4bafa1ac04e92c415808" member_type: VOTER }
I20260619 18:46:13.756486 13486 raft_consensus.cc:388] T 00000000000000000000000000000000 P 65e949a5535b4bafa1ac04e92c415808 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:46:13.756717 13486 raft_consensus.cc:482] T 00000000000000000000000000000000 P 65e949a5535b4bafa1ac04e92c415808 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:46:13.756937 13486 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 65e949a5535b4bafa1ac04e92c415808 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:13.761835 13486 raft_consensus.cc:504] T 00000000000000000000000000000000 P 65e949a5535b4bafa1ac04e92c415808 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65e949a5535b4bafa1ac04e92c415808" member_type: VOTER }
I20260619 18:46:13.762359 13486 leader_election.cc:302] T 00000000000000000000000000000000 P 65e949a5535b4bafa1ac04e92c415808 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 65e949a5535b4bafa1ac04e92c415808; no voters:
I20260619 18:46:13.763525 13486 leader_election.cc:288] T 00000000000000000000000000000000 P 65e949a5535b4bafa1ac04e92c415808 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:46:13.763981 13489 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 65e949a5535b4bafa1ac04e92c415808 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:46:13.765648 13489 raft_consensus.cc:686] T 00000000000000000000000000000000 P 65e949a5535b4bafa1ac04e92c415808 [term 1 LEADER]: Becoming Leader. State: Replica: 65e949a5535b4bafa1ac04e92c415808, State: Running, Role: LEADER
I20260619 18:46:13.766463 13489 consensus_queue.cc:237] T 00000000000000000000000000000000 P 65e949a5535b4bafa1ac04e92c415808 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65e949a5535b4bafa1ac04e92c415808" member_type: VOTER }
I20260619 18:46:13.766819 13486 sys_catalog.cc:564] T 00000000000000000000000000000000 P 65e949a5535b4bafa1ac04e92c415808 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 18:46:13.774207 13491 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65e949a5535b4bafa1ac04e92c415808 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 65e949a5535b4bafa1ac04e92c415808. Latest consensus state: current_term: 1 leader_uuid: "65e949a5535b4bafa1ac04e92c415808" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65e949a5535b4bafa1ac04e92c415808" member_type: VOTER } }
I20260619 18:46:13.774930 13491 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65e949a5535b4bafa1ac04e92c415808 [sys.catalog]: This master's current role is: LEADER
I20260619 18:46:13.775341 13490 sys_catalog.cc:455] T 00000000000000000000000000000000 P 65e949a5535b4bafa1ac04e92c415808 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "65e949a5535b4bafa1ac04e92c415808" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "65e949a5535b4bafa1ac04e92c415808" member_type: VOTER } }
I20260619 18:46:13.776329 13490 sys_catalog.cc:458] T 00000000000000000000000000000000 P 65e949a5535b4bafa1ac04e92c415808 [sys.catalog]: This master's current role is: LEADER
I20260619 18:46:13.778146 13498 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 18:46:13.786626 13498 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 18:46:13.787808 6627 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260619 18:46:13.796660 13498 catalog_manager.cc:1347] Generated new cluster ID: b152ec45b0284c2dbee081de3a41d797
I20260619 18:46:13.796998 13498 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 18:46:13.842665 13498 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 18:46:13.844655 13498 catalog_manager.cc:1504] Loading token signing keys...
I20260619 18:46:13.861791 13498 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 65e949a5535b4bafa1ac04e92c415808: Generated new TSK 0
I20260619 18:46:13.862531 13498 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 18:46:13.919396 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:46:13.926652 13507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:13.927922 13508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:13.929840 13510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:46:13.929914 6627 server_base.cc:1034] running on GCE node
I20260619 18:46:13.931643 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:46:13.931886 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:46:13.932076 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894773932063 us; error 0 us; skew 500 ppm
I20260619 18:46:13.932703 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:46:13.935199 6627 webserver.cc:460] Webserver started at http://127.6.120.193:43451/ using document root <none> and password file <none>
I20260619 18:46:13.935770 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:46:13.936062 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:46:13.936442 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:46:13.937907 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.MultiTServerClientTest.WriteWhileRestartingMultipleTabletServers.1781894682485826-6627-0/minicluster-data/ts-0-root/instance:
uuid: "fab7c8f7f88446ff81c9bb85b11af321"
format_stamp: "Formatted at 2026-06-19 18:46:13 on dist-test-slave-90mn"
I20260619 18:46:13.942857 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260619 18:46:13.946609 13515 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:13.947678 6627 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 18:46:13.948029 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.MultiTServerClientTest.WriteWhileRestartingMultipleTabletServers.1781894682485826-6627-0/minicluster-data/ts-0-root
uuid: "fab7c8f7f88446ff81c9bb85b11af321"
format_stamp: "Formatted at 2026-06-19 18:46:13 on dist-test-slave-90mn"
I20260619 18:46:13.948444 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.MultiTServerClientTest.WriteWhileRestartingMultipleTabletServers.1781894682485826-6627-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.MultiTServerClientTest.WriteWhileRestartingMultipleTabletServers.1781894682485826-6627-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.MultiTServerClientTest.WriteWhileRestartingMultipleTabletServers.1781894682485826-6627-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:46:13.967562 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:46:13.968752 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:46:13.970265 6627 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 18:46:13.972649 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:46:13.972867 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:13.973126 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:46:13.973310 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:14.018309 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.193:38225
I20260619 18:46:14.018402 13577 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.193:38225 every 8 connection(s)
I20260619 18:46:14.024082 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:46:14.032202 13582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:14.033133 13583 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:14.037194 13585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:46:14.038022 6627 server_base.cc:1034] running on GCE node
I20260619 18:46:14.039302 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:46:14.039569 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:46:14.039772 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894774039755 us; error 0 us; skew 500 ppm
I20260619 18:46:14.040527 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:46:14.042906 13578 heartbeater.cc:347] Connected to a master server at 127.6.120.254:43699
I20260619 18:46:14.043448 13578 heartbeater.cc:464] Registering TS with master...
I20260619 18:46:14.043473 6627 webserver.cc:460] Webserver started at http://127.6.120.194:35117/ using document root <none> and password file <none>
I20260619 18:46:14.044327 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:46:14.044538 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:46:14.044572 13578 heartbeater.cc:511] Master 127.6.120.254:43699 requested a full tablet report, sending...
I20260619 18:46:14.044920 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:46:14.046430 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.MultiTServerClientTest.WriteWhileRestartingMultipleTabletServers.1781894682485826-6627-0/minicluster-data/ts-1-root/instance:
uuid: "76459d53d41a4b1ba0a4145a12c46642"
format_stamp: "Formatted at 2026-06-19 18:46:14 on dist-test-slave-90mn"
I20260619 18:46:14.047062 13451 ts_manager.cc:194] Registered new tserver with Master: fab7c8f7f88446ff81c9bb85b11af321 (127.6.120.193:38225)
I20260619 18:46:14.049683 13451 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51422
I20260619 18:46:14.051759 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260619 18:46:14.055516 13590 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:14.056495 6627 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 18:46:14.056877 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.MultiTServerClientTest.WriteWhileRestartingMultipleTabletServers.1781894682485826-6627-0/minicluster-data/ts-1-root
uuid: "76459d53d41a4b1ba0a4145a12c46642"
format_stamp: "Formatted at 2026-06-19 18:46:14 on dist-test-slave-90mn"
I20260619 18:46:14.057179 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.MultiTServerClientTest.WriteWhileRestartingMultipleTabletServers.1781894682485826-6627-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.MultiTServerClientTest.WriteWhileRestartingMultipleTabletServers.1781894682485826-6627-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.MultiTServerClientTest.WriteWhileRestartingMultipleTabletServers.1781894682485826-6627-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:46:14.084503 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:46:14.085765 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:46:14.087292 6627 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 18:46:14.089660 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:46:14.089901 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:14.090154 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:46:14.090322 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:14.132001 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.194:33213
I20260619 18:46:14.132190 13652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.194:33213 every 8 connection(s)
I20260619 18:46:14.136963 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:46:14.144919 13656 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:14.147327 13657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:14.153992 13659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:46:14.154321 6627 server_base.cc:1034] running on GCE node
I20260619 18:46:14.155073 13653 heartbeater.cc:347] Connected to a master server at 127.6.120.254:43699
I20260619 18:46:14.155481 13653 heartbeater.cc:464] Registering TS with master...
I20260619 18:46:14.155542 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:46:14.155932 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:46:14.156155 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894774156114 us; error 0 us; skew 500 ppm
I20260619 18:46:14.156481 13653 heartbeater.cc:511] Master 127.6.120.254:43699 requested a full tablet report, sending...
I20260619 18:46:14.156884 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:46:14.158803 13451 ts_manager.cc:194] Registered new tserver with Master: 76459d53d41a4b1ba0a4145a12c46642 (127.6.120.194:33213)
I20260619 18:46:14.159941 6627 webserver.cc:460] Webserver started at http://127.6.120.195:35637/ using document root <none> and password file <none>
I20260619 18:46:14.160490 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:46:14.160709 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:46:14.160979 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:46:14.161041 13451 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51436
I20260619 18:46:14.162283 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.MultiTServerClientTest.WriteWhileRestartingMultipleTabletServers.1781894682485826-6627-0/minicluster-data/ts-2-root/instance:
uuid: "d5a59b39b200425e90a14a70d491e5e8"
format_stamp: "Formatted at 2026-06-19 18:46:14 on dist-test-slave-90mn"
I20260619 18:46:14.166944 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260619 18:46:14.170559 13664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:14.171420 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260619 18:46:14.171743 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.MultiTServerClientTest.WriteWhileRestartingMultipleTabletServers.1781894682485826-6627-0/minicluster-data/ts-2-root
uuid: "d5a59b39b200425e90a14a70d491e5e8"
format_stamp: "Formatted at 2026-06-19 18:46:14 on dist-test-slave-90mn"
I20260619 18:46:14.172051 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.MultiTServerClientTest.WriteWhileRestartingMultipleTabletServers.1781894682485826-6627-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.MultiTServerClientTest.WriteWhileRestartingMultipleTabletServers.1781894682485826-6627-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.MultiTServerClientTest.WriteWhileRestartingMultipleTabletServers.1781894682485826-6627-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:46:14.183995 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:46:14.185281 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:46:14.186787 6627 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 18:46:14.189200 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:46:14.189429 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:14.189702 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:46:14.189888 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:14.233704 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.195:43371
I20260619 18:46:14.234020 13726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.195:43371 every 8 connection(s)
I20260619 18:46:14.239326 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:46:14.248580 13730 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:14.251232 13731 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:46:14.256975 13727 heartbeater.cc:347] Connected to a master server at 127.6.120.254:43699
I20260619 18:46:14.257589 13727 heartbeater.cc:464] Registering TS with master...
I20260619 18:46:14.257601 6627 server_base.cc:1034] running on GCE node
W20260619 18:46:14.257700 13733 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:46:14.259078 13727 heartbeater.cc:511] Master 127.6.120.254:43699 requested a full tablet report, sending...
I20260619 18:46:14.259548 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:46:14.259832 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:46:14.260133 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894774260087 us; error 0 us; skew 500 ppm
I20260619 18:46:14.260823 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:46:14.261399 13451 ts_manager.cc:194] Registered new tserver with Master: d5a59b39b200425e90a14a70d491e5e8 (127.6.120.195:43371)
I20260619 18:46:14.263608 13451 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51448
I20260619 18:46:14.263638 6627 webserver.cc:460] Webserver started at http://127.6.120.196:44901/ using document root <none> and password file <none>
I20260619 18:46:14.264514 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:46:14.264788 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:46:14.265128 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:46:14.266338 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.MultiTServerClientTest.WriteWhileRestartingMultipleTabletServers.1781894682485826-6627-0/minicluster-data/ts-3-root/instance:
uuid: "cd19b79f5a1245fb939a133d69b9af2b"
format_stamp: "Formatted at 2026-06-19 18:46:14 on dist-test-slave-90mn"
I20260619 18:46:14.270967 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260619 18:46:14.274626 13738 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:14.275609 6627 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 18:46:14.275986 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.MultiTServerClientTest.WriteWhileRestartingMultipleTabletServers.1781894682485826-6627-0/minicluster-data/ts-3-root
uuid: "cd19b79f5a1245fb939a133d69b9af2b"
format_stamp: "Formatted at 2026-06-19 18:46:14 on dist-test-slave-90mn"
I20260619 18:46:14.276422 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.MultiTServerClientTest.WriteWhileRestartingMultipleTabletServers.1781894682485826-6627-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.MultiTServerClientTest.WriteWhileRestartingMultipleTabletServers.1781894682485826-6627-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.MultiTServerClientTest.WriteWhileRestartingMultipleTabletServers.1781894682485826-6627-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:46:14.285487 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:46:14.286787 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:46:14.288475 6627 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 18:46:14.290453 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:46:14.290679 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:14.290915 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:46:14.291091 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:14.334152 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.196:43209
I20260619 18:46:14.334260 13800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.196:43209 every 8 connection(s)
I20260619 18:46:14.351621 13801 heartbeater.cc:347] Connected to a master server at 127.6.120.254:43699
I20260619 18:46:14.352128 13801 heartbeater.cc:464] Registering TS with master...
I20260619 18:46:14.353350 13801 heartbeater.cc:511] Master 127.6.120.254:43699 requested a full tablet report, sending...
I20260619 18:46:14.355715 13451 ts_manager.cc:194] Registered new tserver with Master: cd19b79f5a1245fb939a133d69b9af2b (127.6.120.196:43209)
I20260619 18:46:14.356082 6627 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.018449471s
I20260619 18:46:14.358733 13451 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51462
I20260619 18:46:14.384889 13451 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51472:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 2
seed: 0
}
}
I20260619 18:46:14.458555 13766 tablet_service.cc:1467] Processing CreateTablet for tablet 5f5258b6a647476d9d2a61a8f146e101 (DEFAULT_TABLE table=client-testtb [id=8ac0b59db7da48c1b893a129a3d2008f]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260619 18:46:14.460235 13766 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f5258b6a647476d9d2a61a8f146e101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:14.471756 13618 tablet_service.cc:1467] Processing CreateTablet for tablet 5f5258b6a647476d9d2a61a8f146e101 (DEFAULT_TABLE table=client-testtb [id=8ac0b59db7da48c1b893a129a3d2008f]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260619 18:46:14.473380 13618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f5258b6a647476d9d2a61a8f146e101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:14.477998 13821 tablet_bootstrap.cc:492] T 5f5258b6a647476d9d2a61a8f146e101 P cd19b79f5a1245fb939a133d69b9af2b: Bootstrap starting.
I20260619 18:46:14.478086 13617 tablet_service.cc:1467] Processing CreateTablet for tablet b1536b8ade254fcd8275c4858a9a23e3 (DEFAULT_TABLE table=client-testtb [id=8ac0b59db7da48c1b893a129a3d2008f]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260619 18:46:14.478220 13692 tablet_service.cc:1467] Processing CreateTablet for tablet b1536b8ade254fcd8275c4858a9a23e3 (DEFAULT_TABLE table=client-testtb [id=8ac0b59db7da48c1b893a129a3d2008f]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260619 18:46:14.479977 13692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1536b8ade254fcd8275c4858a9a23e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:14.479977 13617 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1536b8ade254fcd8275c4858a9a23e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:14.484061 13821 tablet_bootstrap.cc:654] T 5f5258b6a647476d9d2a61a8f146e101 P cd19b79f5a1245fb939a133d69b9af2b: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:14.487493 13543 tablet_service.cc:1467] Processing CreateTablet for tablet 5f5258b6a647476d9d2a61a8f146e101 (DEFAULT_TABLE table=client-testtb [id=8ac0b59db7da48c1b893a129a3d2008f]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260619 18:46:14.488189 13542 tablet_service.cc:1467] Processing CreateTablet for tablet b1536b8ade254fcd8275c4858a9a23e3 (DEFAULT_TABLE table=client-testtb [id=8ac0b59db7da48c1b893a129a3d2008f]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260619 18:46:14.489132 13543 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f5258b6a647476d9d2a61a8f146e101. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:14.490298 13542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1536b8ade254fcd8275c4858a9a23e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:14.511797 13824 tablet_bootstrap.cc:492] T b1536b8ade254fcd8275c4858a9a23e3 P fab7c8f7f88446ff81c9bb85b11af321: Bootstrap starting.
I20260619 18:46:14.512277 13821 tablet_bootstrap.cc:492] T 5f5258b6a647476d9d2a61a8f146e101 P cd19b79f5a1245fb939a133d69b9af2b: No bootstrap required, opened a new log
I20260619 18:46:14.512844 13821 ts_tablet_manager.cc:1397] T 5f5258b6a647476d9d2a61a8f146e101 P cd19b79f5a1245fb939a133d69b9af2b: Time spent bootstrapping tablet: real 0.035s user 0.006s sys 0.007s
I20260619 18:46:14.516273 13821 raft_consensus.cc:348] T 5f5258b6a647476d9d2a61a8f146e101 P cd19b79f5a1245fb939a133d69b9af2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd19b79f5a1245fb939a133d69b9af2b" member_type: VOTER last_known_addr { host: "127.6.120.196" port: 43209 } } peers { permanent_uuid: "76459d53d41a4b1ba0a4145a12c46642" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 33213 } } peers { permanent_uuid: "fab7c8f7f88446ff81c9bb85b11af321" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38225 } }
I20260619 18:46:14.517388 13821 raft_consensus.cc:374] T 5f5258b6a647476d9d2a61a8f146e101 P cd19b79f5a1245fb939a133d69b9af2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:14.517756 13821 raft_consensus.cc:729] T 5f5258b6a647476d9d2a61a8f146e101 P cd19b79f5a1245fb939a133d69b9af2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd19b79f5a1245fb939a133d69b9af2b, State: Initialized, Role: FOLLOWER
I20260619 18:46:14.518714 13821 consensus_queue.cc:260] T 5f5258b6a647476d9d2a61a8f146e101 P cd19b79f5a1245fb939a133d69b9af2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd19b79f5a1245fb939a133d69b9af2b" member_type: VOTER last_known_addr { host: "127.6.120.196" port: 43209 } } peers { permanent_uuid: "76459d53d41a4b1ba0a4145a12c46642" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 33213 } } peers { permanent_uuid: "fab7c8f7f88446ff81c9bb85b11af321" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38225 } }
I20260619 18:46:14.519259 13824 tablet_bootstrap.cc:654] T b1536b8ade254fcd8275c4858a9a23e3 P fab7c8f7f88446ff81c9bb85b11af321: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:14.519721 13822 tablet_bootstrap.cc:492] T b1536b8ade254fcd8275c4858a9a23e3 P d5a59b39b200425e90a14a70d491e5e8: Bootstrap starting.
I20260619 18:46:14.520802 13825 tablet_bootstrap.cc:492] T b1536b8ade254fcd8275c4858a9a23e3 P 76459d53d41a4b1ba0a4145a12c46642: Bootstrap starting.
I20260619 18:46:14.526333 13821 ts_tablet_manager.cc:1428] T 5f5258b6a647476d9d2a61a8f146e101 P cd19b79f5a1245fb939a133d69b9af2b: Time spent starting tablet: real 0.013s user 0.001s sys 0.009s
I20260619 18:46:14.527522 13801 heartbeater.cc:503] Master 127.6.120.254:43699 was elected leader, sending a full tablet report...
I20260619 18:46:14.529132 13822 tablet_bootstrap.cc:654] T b1536b8ade254fcd8275c4858a9a23e3 P d5a59b39b200425e90a14a70d491e5e8: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:14.529400 13825 tablet_bootstrap.cc:654] T b1536b8ade254fcd8275c4858a9a23e3 P 76459d53d41a4b1ba0a4145a12c46642: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:14.542979 13822 tablet_bootstrap.cc:492] T b1536b8ade254fcd8275c4858a9a23e3 P d5a59b39b200425e90a14a70d491e5e8: No bootstrap required, opened a new log
I20260619 18:46:14.543622 13822 ts_tablet_manager.cc:1397] T b1536b8ade254fcd8275c4858a9a23e3 P d5a59b39b200425e90a14a70d491e5e8: Time spent bootstrapping tablet: real 0.024s user 0.008s sys 0.014s
I20260619 18:46:14.543622 13825 tablet_bootstrap.cc:492] T b1536b8ade254fcd8275c4858a9a23e3 P 76459d53d41a4b1ba0a4145a12c46642: No bootstrap required, opened a new log
I20260619 18:46:14.544761 13825 ts_tablet_manager.cc:1397] T b1536b8ade254fcd8275c4858a9a23e3 P 76459d53d41a4b1ba0a4145a12c46642: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.014s
I20260619 18:46:14.547068 13824 tablet_bootstrap.cc:492] T b1536b8ade254fcd8275c4858a9a23e3 P fab7c8f7f88446ff81c9bb85b11af321: No bootstrap required, opened a new log
I20260619 18:46:14.547340 13822 raft_consensus.cc:348] T b1536b8ade254fcd8275c4858a9a23e3 P d5a59b39b200425e90a14a70d491e5e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5a59b39b200425e90a14a70d491e5e8" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 43371 } } peers { permanent_uuid: "fab7c8f7f88446ff81c9bb85b11af321" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38225 } } peers { permanent_uuid: "76459d53d41a4b1ba0a4145a12c46642" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 33213 } }
I20260619 18:46:14.547684 13824 ts_tablet_manager.cc:1397] T b1536b8ade254fcd8275c4858a9a23e3 P fab7c8f7f88446ff81c9bb85b11af321: Time spent bootstrapping tablet: real 0.036s user 0.018s sys 0.012s
I20260619 18:46:14.548359 13822 raft_consensus.cc:374] T b1536b8ade254fcd8275c4858a9a23e3 P d5a59b39b200425e90a14a70d491e5e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:14.547730 13825 raft_consensus.cc:348] T b1536b8ade254fcd8275c4858a9a23e3 P 76459d53d41a4b1ba0a4145a12c46642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5a59b39b200425e90a14a70d491e5e8" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 43371 } } peers { permanent_uuid: "fab7c8f7f88446ff81c9bb85b11af321" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38225 } } peers { permanent_uuid: "76459d53d41a4b1ba0a4145a12c46642" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 33213 } }
I20260619 18:46:14.548837 13822 raft_consensus.cc:729] T b1536b8ade254fcd8275c4858a9a23e3 P d5a59b39b200425e90a14a70d491e5e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5a59b39b200425e90a14a70d491e5e8, State: Initialized, Role: FOLLOWER
I20260619 18:46:14.548987 13825 raft_consensus.cc:374] T b1536b8ade254fcd8275c4858a9a23e3 P 76459d53d41a4b1ba0a4145a12c46642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:14.549597 13825 raft_consensus.cc:729] T b1536b8ade254fcd8275c4858a9a23e3 P 76459d53d41a4b1ba0a4145a12c46642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76459d53d41a4b1ba0a4145a12c46642, State: Initialized, Role: FOLLOWER
I20260619 18:46:14.549835 13822 consensus_queue.cc:260] T b1536b8ade254fcd8275c4858a9a23e3 P d5a59b39b200425e90a14a70d491e5e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5a59b39b200425e90a14a70d491e5e8" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 43371 } } peers { permanent_uuid: "fab7c8f7f88446ff81c9bb85b11af321" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38225 } } peers { permanent_uuid: "76459d53d41a4b1ba0a4145a12c46642" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 33213 } }
I20260619 18:46:14.550518 13825 consensus_queue.cc:260] T b1536b8ade254fcd8275c4858a9a23e3 P 76459d53d41a4b1ba0a4145a12c46642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5a59b39b200425e90a14a70d491e5e8" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 43371 } } peers { permanent_uuid: "fab7c8f7f88446ff81c9bb85b11af321" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38225 } } peers { permanent_uuid: "76459d53d41a4b1ba0a4145a12c46642" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 33213 } }
I20260619 18:46:14.551242 13824 raft_consensus.cc:348] T b1536b8ade254fcd8275c4858a9a23e3 P fab7c8f7f88446ff81c9bb85b11af321 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5a59b39b200425e90a14a70d491e5e8" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 43371 } } peers { permanent_uuid: "fab7c8f7f88446ff81c9bb85b11af321" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38225 } } peers { permanent_uuid: "76459d53d41a4b1ba0a4145a12c46642" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 33213 } }
I20260619 18:46:14.552183 13824 raft_consensus.cc:374] T b1536b8ade254fcd8275c4858a9a23e3 P fab7c8f7f88446ff81c9bb85b11af321 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:14.552484 13727 heartbeater.cc:503] Master 127.6.120.254:43699 was elected leader, sending a full tablet report...
I20260619 18:46:14.552575 13824 raft_consensus.cc:729] T b1536b8ade254fcd8275c4858a9a23e3 P fab7c8f7f88446ff81c9bb85b11af321 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab7c8f7f88446ff81c9bb85b11af321, State: Initialized, Role: FOLLOWER
I20260619 18:46:14.553958 13824 consensus_queue.cc:260] T b1536b8ade254fcd8275c4858a9a23e3 P fab7c8f7f88446ff81c9bb85b11af321 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5a59b39b200425e90a14a70d491e5e8" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 43371 } } peers { permanent_uuid: "fab7c8f7f88446ff81c9bb85b11af321" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38225 } } peers { permanent_uuid: "76459d53d41a4b1ba0a4145a12c46642" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 33213 } }
I20260619 18:46:14.554982 13822 ts_tablet_manager.cc:1428] T b1536b8ade254fcd8275c4858a9a23e3 P d5a59b39b200425e90a14a70d491e5e8: Time spent starting tablet: real 0.011s user 0.008s sys 0.000s
I20260619 18:46:14.556932 13653 heartbeater.cc:503] Master 127.6.120.254:43699 was elected leader, sending a full tablet report...
I20260619 18:46:14.557770 13825 ts_tablet_manager.cc:1428] T b1536b8ade254fcd8275c4858a9a23e3 P 76459d53d41a4b1ba0a4145a12c46642: Time spent starting tablet: real 0.013s user 0.003s sys 0.008s
I20260619 18:46:14.559121 13825 tablet_bootstrap.cc:492] T 5f5258b6a647476d9d2a61a8f146e101 P 76459d53d41a4b1ba0a4145a12c46642: Bootstrap starting.
I20260619 18:46:14.567793 13825 tablet_bootstrap.cc:654] T 5f5258b6a647476d9d2a61a8f146e101 P 76459d53d41a4b1ba0a4145a12c46642: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:14.568761 13578 heartbeater.cc:503] Master 127.6.120.254:43699 was elected leader, sending a full tablet report...
I20260619 18:46:14.569283 13824 ts_tablet_manager.cc:1428] T b1536b8ade254fcd8275c4858a9a23e3 P fab7c8f7f88446ff81c9bb85b11af321: Time spent starting tablet: real 0.021s user 0.012s sys 0.008s
I20260619 18:46:14.570395 13824 tablet_bootstrap.cc:492] T 5f5258b6a647476d9d2a61a8f146e101 P fab7c8f7f88446ff81c9bb85b11af321: Bootstrap starting.
I20260619 18:46:14.577522 13824 tablet_bootstrap.cc:654] T 5f5258b6a647476d9d2a61a8f146e101 P fab7c8f7f88446ff81c9bb85b11af321: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:14.579195 13825 tablet_bootstrap.cc:492] T 5f5258b6a647476d9d2a61a8f146e101 P 76459d53d41a4b1ba0a4145a12c46642: No bootstrap required, opened a new log
I20260619 18:46:14.579808 13825 ts_tablet_manager.cc:1397] T 5f5258b6a647476d9d2a61a8f146e101 P 76459d53d41a4b1ba0a4145a12c46642: Time spent bootstrapping tablet: real 0.021s user 0.016s sys 0.001s
I20260619 18:46:14.582525 13825 raft_consensus.cc:348] T 5f5258b6a647476d9d2a61a8f146e101 P 76459d53d41a4b1ba0a4145a12c46642 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd19b79f5a1245fb939a133d69b9af2b" member_type: VOTER last_known_addr { host: "127.6.120.196" port: 43209 } } peers { permanent_uuid: "76459d53d41a4b1ba0a4145a12c46642" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 33213 } } peers { permanent_uuid: "fab7c8f7f88446ff81c9bb85b11af321" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38225 } }
I20260619 18:46:14.583293 13825 raft_consensus.cc:374] T 5f5258b6a647476d9d2a61a8f146e101 P 76459d53d41a4b1ba0a4145a12c46642 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:14.583604 13825 raft_consensus.cc:729] T 5f5258b6a647476d9d2a61a8f146e101 P 76459d53d41a4b1ba0a4145a12c46642 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76459d53d41a4b1ba0a4145a12c46642, State: Initialized, Role: FOLLOWER
I20260619 18:46:14.583973 13824 tablet_bootstrap.cc:492] T 5f5258b6a647476d9d2a61a8f146e101 P fab7c8f7f88446ff81c9bb85b11af321: No bootstrap required, opened a new log
I20260619 18:46:14.584551 13824 ts_tablet_manager.cc:1397] T 5f5258b6a647476d9d2a61a8f146e101 P fab7c8f7f88446ff81c9bb85b11af321: Time spent bootstrapping tablet: real 0.014s user 0.013s sys 0.000s
I20260619 18:46:14.584306 13825 consensus_queue.cc:260] T 5f5258b6a647476d9d2a61a8f146e101 P 76459d53d41a4b1ba0a4145a12c46642 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd19b79f5a1245fb939a133d69b9af2b" member_type: VOTER last_known_addr { host: "127.6.120.196" port: 43209 } } peers { permanent_uuid: "76459d53d41a4b1ba0a4145a12c46642" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 33213 } } peers { permanent_uuid: "fab7c8f7f88446ff81c9bb85b11af321" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38225 } }
I20260619 18:46:14.586606 13825 ts_tablet_manager.cc:1428] T 5f5258b6a647476d9d2a61a8f146e101 P 76459d53d41a4b1ba0a4145a12c46642: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260619 18:46:14.587486 13824 raft_consensus.cc:348] T 5f5258b6a647476d9d2a61a8f146e101 P fab7c8f7f88446ff81c9bb85b11af321 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd19b79f5a1245fb939a133d69b9af2b" member_type: VOTER last_known_addr { host: "127.6.120.196" port: 43209 } } peers { permanent_uuid: "76459d53d41a4b1ba0a4145a12c46642" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 33213 } } peers { permanent_uuid: "fab7c8f7f88446ff81c9bb85b11af321" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38225 } }
I20260619 18:46:14.588063 13824 raft_consensus.cc:374] T 5f5258b6a647476d9d2a61a8f146e101 P fab7c8f7f88446ff81c9bb85b11af321 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:14.588383 13824 raft_consensus.cc:729] T 5f5258b6a647476d9d2a61a8f146e101 P fab7c8f7f88446ff81c9bb85b11af321 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fab7c8f7f88446ff81c9bb85b11af321, State: Initialized, Role: FOLLOWER
W20260619 18:46:14.588443 13802 tablet.cc:2369] T 5f5258b6a647476d9d2a61a8f146e101 P cd19b79f5a1245fb939a133d69b9af2b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 18:46:14.589219 13824 consensus_queue.cc:260] T 5f5258b6a647476d9d2a61a8f146e101 P fab7c8f7f88446ff81c9bb85b11af321 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd19b79f5a1245fb939a133d69b9af2b" member_type: VOTER last_known_addr { host: "127.6.120.196" port: 43209 } } peers { permanent_uuid: "76459d53d41a4b1ba0a4145a12c46642" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 33213 } } peers { permanent_uuid: "fab7c8f7f88446ff81c9bb85b11af321" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38225 } }
I20260619 18:46:14.591280 13824 ts_tablet_manager.cc:1428] T 5f5258b6a647476d9d2a61a8f146e101 P fab7c8f7f88446ff81c9bb85b11af321: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260619 18:46:14.615239 13830 raft_consensus.cc:482] T b1536b8ade254fcd8275c4858a9a23e3 P d5a59b39b200425e90a14a70d491e5e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 18:46:14.615876 13830 raft_consensus.cc:504] T b1536b8ade254fcd8275c4858a9a23e3 P d5a59b39b200425e90a14a70d491e5e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5a59b39b200425e90a14a70d491e5e8" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 43371 } } peers { permanent_uuid: "fab7c8f7f88446ff81c9bb85b11af321" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38225 } } peers { permanent_uuid: "76459d53d41a4b1ba0a4145a12c46642" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 33213 } }
I20260619 18:46:14.618848 13830 leader_election.cc:288] T b1536b8ade254fcd8275c4858a9a23e3 P d5a59b39b200425e90a14a70d491e5e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fab7c8f7f88446ff81c9bb85b11af321 (127.6.120.193:38225), 76459d53d41a4b1ba0a4145a12c46642 (127.6.120.194:33213)
I20260619 18:46:14.635228 13553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1536b8ade254fcd8275c4858a9a23e3" candidate_uuid: "d5a59b39b200425e90a14a70d491e5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab7c8f7f88446ff81c9bb85b11af321" is_pre_election: true
I20260619 18:46:14.636420 13553 raft_consensus.cc:2454] T b1536b8ade254fcd8275c4858a9a23e3 P fab7c8f7f88446ff81c9bb85b11af321 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5a59b39b200425e90a14a70d491e5e8 in term 0.
I20260619 18:46:14.637014 13628 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1536b8ade254fcd8275c4858a9a23e3" candidate_uuid: "d5a59b39b200425e90a14a70d491e5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76459d53d41a4b1ba0a4145a12c46642" is_pre_election: true
I20260619 18:46:14.637822 13628 raft_consensus.cc:2454] T b1536b8ade254fcd8275c4858a9a23e3 P 76459d53d41a4b1ba0a4145a12c46642 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5a59b39b200425e90a14a70d491e5e8 in term 0.
I20260619 18:46:14.637840 13667 leader_election.cc:302] T b1536b8ade254fcd8275c4858a9a23e3 P d5a59b39b200425e90a14a70d491e5e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5a59b39b200425e90a14a70d491e5e8, fab7c8f7f88446ff81c9bb85b11af321; no voters:
I20260619 18:46:14.638863 13830 raft_consensus.cc:2781] T b1536b8ade254fcd8275c4858a9a23e3 P d5a59b39b200425e90a14a70d491e5e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 18:46:14.639209 13830 raft_consensus.cc:482] T b1536b8ade254fcd8275c4858a9a23e3 P d5a59b39b200425e90a14a70d491e5e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 18:46:14.639474 13830 raft_consensus.cc:3037] T b1536b8ade254fcd8275c4858a9a23e3 P d5a59b39b200425e90a14a70d491e5e8 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:14.645574 13830 raft_consensus.cc:504] T b1536b8ade254fcd8275c4858a9a23e3 P d5a59b39b200425e90a14a70d491e5e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5a59b39b200425e90a14a70d491e5e8" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 43371 } } peers { permanent_uuid: "fab7c8f7f88446ff81c9bb85b11af321" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38225 } } peers { permanent_uuid: "76459d53d41a4b1ba0a4145a12c46642" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 33213 } }
I20260619 18:46:14.647568 13830 leader_election.cc:288] T b1536b8ade254fcd8275c4858a9a23e3 P d5a59b39b200425e90a14a70d491e5e8 [CANDIDATE]: Term 1 election: Requested vote from peers fab7c8f7f88446ff81c9bb85b11af321 (127.6.120.193:38225), 76459d53d41a4b1ba0a4145a12c46642 (127.6.120.194:33213)
I20260619 18:46:14.647979 13553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1536b8ade254fcd8275c4858a9a23e3" candidate_uuid: "d5a59b39b200425e90a14a70d491e5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab7c8f7f88446ff81c9bb85b11af321"
I20260619 18:46:14.648319 13628 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1536b8ade254fcd8275c4858a9a23e3" candidate_uuid: "d5a59b39b200425e90a14a70d491e5e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76459d53d41a4b1ba0a4145a12c46642"
I20260619 18:46:14.648700 13553 raft_consensus.cc:3037] T b1536b8ade254fcd8275c4858a9a23e3 P fab7c8f7f88446ff81c9bb85b11af321 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:14.648941 13628 raft_consensus.cc:3037] T b1536b8ade254fcd8275c4858a9a23e3 P 76459d53d41a4b1ba0a4145a12c46642 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:14.656080 13553 raft_consensus.cc:2454] T b1536b8ade254fcd8275c4858a9a23e3 P fab7c8f7f88446ff81c9bb85b11af321 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5a59b39b200425e90a14a70d491e5e8 in term 1.
I20260619 18:46:14.656085 13628 raft_consensus.cc:2454] T b1536b8ade254fcd8275c4858a9a23e3 P 76459d53d41a4b1ba0a4145a12c46642 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5a59b39b200425e90a14a70d491e5e8 in term 1.
I20260619 18:46:14.657699 13667 leader_election.cc:302] T b1536b8ade254fcd8275c4858a9a23e3 P d5a59b39b200425e90a14a70d491e5e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5a59b39b200425e90a14a70d491e5e8, fab7c8f7f88446ff81c9bb85b11af321; no voters:
I20260619 18:46:14.658440 13830 raft_consensus.cc:2781] T b1536b8ade254fcd8275c4858a9a23e3 P d5a59b39b200425e90a14a70d491e5e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:46:14.659333 13830 raft_consensus.cc:686] T b1536b8ade254fcd8275c4858a9a23e3 P d5a59b39b200425e90a14a70d491e5e8 [term 1 LEADER]: Becoming Leader. State: Replica: d5a59b39b200425e90a14a70d491e5e8, State: Running, Role: LEADER
I20260619 18:46:14.660135 13830 consensus_queue.cc:237] T b1536b8ade254fcd8275c4858a9a23e3 P d5a59b39b200425e90a14a70d491e5e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5a59b39b200425e90a14a70d491e5e8" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 43371 } } peers { permanent_uuid: "fab7c8f7f88446ff81c9bb85b11af321" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38225 } } peers { permanent_uuid: "76459d53d41a4b1ba0a4145a12c46642" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 33213 } }
I20260619 18:46:14.667999 13451 catalog_manager.cc:5495] T b1536b8ade254fcd8275c4858a9a23e3 P d5a59b39b200425e90a14a70d491e5e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to d5a59b39b200425e90a14a70d491e5e8 (127.6.120.195). New cstate: current_term: 1 leader_uuid: "d5a59b39b200425e90a14a70d491e5e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5a59b39b200425e90a14a70d491e5e8" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 43371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab7c8f7f88446ff81c9bb85b11af321" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76459d53d41a4b1ba0a4145a12c46642" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 33213 } health_report { overall_health: UNKNOWN } } }
I20260619 18:46:14.684448 13831 raft_consensus.cc:482] T 5f5258b6a647476d9d2a61a8f146e101 P 76459d53d41a4b1ba0a4145a12c46642 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 18:46:14.684985 13831 raft_consensus.cc:504] T 5f5258b6a647476d9d2a61a8f146e101 P 76459d53d41a4b1ba0a4145a12c46642 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd19b79f5a1245fb939a133d69b9af2b" member_type: VOTER last_known_addr { host: "127.6.120.196" port: 43209 } } peers { permanent_uuid: "76459d53d41a4b1ba0a4145a12c46642" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 33213 } } peers { permanent_uuid: "fab7c8f7f88446ff81c9bb85b11af321" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38225 } }
I20260619 18:46:14.686968 13831 leader_election.cc:288] T 5f5258b6a647476d9d2a61a8f146e101 P 76459d53d41a4b1ba0a4145a12c46642 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd19b79f5a1245fb939a133d69b9af2b (127.6.120.196:43209), fab7c8f7f88446ff81c9bb85b11af321 (127.6.120.193:38225)
I20260619 18:46:14.710307 13553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f5258b6a647476d9d2a61a8f146e101" candidate_uuid: "76459d53d41a4b1ba0a4145a12c46642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab7c8f7f88446ff81c9bb85b11af321" is_pre_election: true
I20260619 18:46:14.710273 13776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f5258b6a647476d9d2a61a8f146e101" candidate_uuid: "76459d53d41a4b1ba0a4145a12c46642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd19b79f5a1245fb939a133d69b9af2b" is_pre_election: true
I20260619 18:46:14.711349 13553 raft_consensus.cc:2454] T 5f5258b6a647476d9d2a61a8f146e101 P fab7c8f7f88446ff81c9bb85b11af321 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76459d53d41a4b1ba0a4145a12c46642 in term 0.
I20260619 18:46:14.711395 13776 raft_consensus.cc:2454] T 5f5258b6a647476d9d2a61a8f146e101 P cd19b79f5a1245fb939a133d69b9af2b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76459d53d41a4b1ba0a4145a12c46642 in term 0.
I20260619 18:46:14.712965 13593 leader_election.cc:302] T 5f5258b6a647476d9d2a61a8f146e101 P 76459d53d41a4b1ba0a4145a12c46642 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76459d53d41a4b1ba0a4145a12c46642, fab7c8f7f88446ff81c9bb85b11af321; no voters:
I20260619 18:46:14.713817 13831 raft_consensus.cc:2781] T 5f5258b6a647476d9d2a61a8f146e101 P 76459d53d41a4b1ba0a4145a12c46642 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 18:46:14.714162 13831 raft_consensus.cc:482] T 5f5258b6a647476d9d2a61a8f146e101 P 76459d53d41a4b1ba0a4145a12c46642 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 18:46:14.714404 13831 raft_consensus.cc:3037] T 5f5258b6a647476d9d2a61a8f146e101 P 76459d53d41a4b1ba0a4145a12c46642 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:14.719177 13831 raft_consensus.cc:504] T 5f5258b6a647476d9d2a61a8f146e101 P 76459d53d41a4b1ba0a4145a12c46642 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd19b79f5a1245fb939a133d69b9af2b" member_type: VOTER last_known_addr { host: "127.6.120.196" port: 43209 } } peers { permanent_uuid: "76459d53d41a4b1ba0a4145a12c46642" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 33213 } } peers { permanent_uuid: "fab7c8f7f88446ff81c9bb85b11af321" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38225 } }
I20260619 18:46:14.720794 13831 leader_election.cc:288] T 5f5258b6a647476d9d2a61a8f146e101 P 76459d53d41a4b1ba0a4145a12c46642 [CANDIDATE]: Term 1 election: Requested vote from peers cd19b79f5a1245fb939a133d69b9af2b (127.6.120.196:43209), fab7c8f7f88446ff81c9bb85b11af321 (127.6.120.193:38225)
I20260619 18:46:14.721820 13776 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f5258b6a647476d9d2a61a8f146e101" candidate_uuid: "76459d53d41a4b1ba0a4145a12c46642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd19b79f5a1245fb939a133d69b9af2b"
I20260619 18:46:14.721920 13553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f5258b6a647476d9d2a61a8f146e101" candidate_uuid: "76459d53d41a4b1ba0a4145a12c46642" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fab7c8f7f88446ff81c9bb85b11af321"
I20260619 18:46:14.722468 13776 raft_consensus.cc:3037] T 5f5258b6a647476d9d2a61a8f146e101 P cd19b79f5a1245fb939a133d69b9af2b [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:14.722556 13553 raft_consensus.cc:3037] T 5f5258b6a647476d9d2a61a8f146e101 P fab7c8f7f88446ff81c9bb85b11af321 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:14.727737 13553 raft_consensus.cc:2454] T 5f5258b6a647476d9d2a61a8f146e101 P fab7c8f7f88446ff81c9bb85b11af321 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76459d53d41a4b1ba0a4145a12c46642 in term 1.
I20260619 18:46:14.727831 13776 raft_consensus.cc:2454] T 5f5258b6a647476d9d2a61a8f146e101 P cd19b79f5a1245fb939a133d69b9af2b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76459d53d41a4b1ba0a4145a12c46642 in term 1.
I20260619 18:46:14.728982 13593 leader_election.cc:302] T 5f5258b6a647476d9d2a61a8f146e101 P 76459d53d41a4b1ba0a4145a12c46642 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76459d53d41a4b1ba0a4145a12c46642, fab7c8f7f88446ff81c9bb85b11af321; no voters:
I20260619 18:46:14.729813 13831 raft_consensus.cc:2781] T 5f5258b6a647476d9d2a61a8f146e101 P 76459d53d41a4b1ba0a4145a12c46642 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:46:14.730979 13831 raft_consensus.cc:686] T 5f5258b6a647476d9d2a61a8f146e101 P 76459d53d41a4b1ba0a4145a12c46642 [term 1 LEADER]: Becoming Leader. State: Replica: 76459d53d41a4b1ba0a4145a12c46642, State: Running, Role: LEADER
I20260619 18:46:14.731782 13831 consensus_queue.cc:237] T 5f5258b6a647476d9d2a61a8f146e101 P 76459d53d41a4b1ba0a4145a12c46642 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd19b79f5a1245fb939a133d69b9af2b" member_type: VOTER last_known_addr { host: "127.6.120.196" port: 43209 } } peers { permanent_uuid: "76459d53d41a4b1ba0a4145a12c46642" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 33213 } } peers { permanent_uuid: "fab7c8f7f88446ff81c9bb85b11af321" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38225 } }
I20260619 18:46:14.739308 13451 catalog_manager.cc:5495] T 5f5258b6a647476d9d2a61a8f146e101 P 76459d53d41a4b1ba0a4145a12c46642 reported cstate change: term changed from 0 to 1, leader changed from <none> to 76459d53d41a4b1ba0a4145a12c46642 (127.6.120.194). New cstate: current_term: 1 leader_uuid: "76459d53d41a4b1ba0a4145a12c46642" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd19b79f5a1245fb939a133d69b9af2b" member_type: VOTER last_known_addr { host: "127.6.120.196" port: 43209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76459d53d41a4b1ba0a4145a12c46642" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 33213 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fab7c8f7f88446ff81c9bb85b11af321" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 38225 } health_report { overall_health: UNKNOWN } } }
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:9931: Skipped
test is skipped; set KUDU_ALLOW_SLOW_TESTS=1 to run
I20260619 18:46:14.756318 6627 tablet_server.cc:178] TabletServer@127.6.120.193:0 shutting down...
I20260619 18:46:14.779479 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:46:14.780550 6627 tablet_replica.cc:330] T 5f5258b6a647476d9d2a61a8f146e101 P fab7c8f7f88446ff81c9bb85b11af321: stopping tablet replica
I20260619 18:46:14.781255 6627 raft_consensus.cc:2229] T 5f5258b6a647476d9d2a61a8f146e101 P fab7c8f7f88446ff81c9bb85b11af321 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 18:46:14.781652 6627 raft_consensus.cc:2258] T 5f5258b6a647476d9d2a61a8f146e101 P fab7c8f7f88446ff81c9bb85b11af321 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:14.783952 6627 tablet_replica.cc:330] T b1536b8ade254fcd8275c4858a9a23e3 P fab7c8f7f88446ff81c9bb85b11af321: stopping tablet replica
I20260619 18:46:14.784519 6627 raft_consensus.cc:2229] T b1536b8ade254fcd8275c4858a9a23e3 P fab7c8f7f88446ff81c9bb85b11af321 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 18:46:14.784891 6627 raft_consensus.cc:2258] T b1536b8ade254fcd8275c4858a9a23e3 P fab7c8f7f88446ff81c9bb85b11af321 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:14.806413 6627 tablet_server.cc:194] TabletServer@127.6.120.193:0 shutdown complete.
I20260619 18:46:14.818055 6627 tablet_server.cc:178] TabletServer@127.6.120.194:0 shutting down...
I20260619 18:46:14.837814 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:46:14.838753 6627 tablet_replica.cc:330] T 5f5258b6a647476d9d2a61a8f146e101 P 76459d53d41a4b1ba0a4145a12c46642: stopping tablet replica
I20260619 18:46:14.839329 6627 raft_consensus.cc:2229] T 5f5258b6a647476d9d2a61a8f146e101 P 76459d53d41a4b1ba0a4145a12c46642 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:14.840197 6627 pending_rounds.cc:62] T 5f5258b6a647476d9d2a61a8f146e101 P 76459d53d41a4b1ba0a4145a12c46642: Trying to abort 1 pending ops.
I20260619 18:46:14.840487 6627 pending_rounds.cc:68] T 5f5258b6a647476d9d2a61a8f146e101 P 76459d53d41a4b1ba0a4145a12c46642: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298640997309214720 op_type: NO_OP noop_request { }
I20260619 18:46:14.840797 6627 raft_consensus.cc:2866] T 5f5258b6a647476d9d2a61a8f146e101 P 76459d53d41a4b1ba0a4145a12c46642 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 18:46:14.841055 6627 raft_consensus.cc:2258] T 5f5258b6a647476d9d2a61a8f146e101 P 76459d53d41a4b1ba0a4145a12c46642 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:14.843658 6627 tablet_replica.cc:330] T b1536b8ade254fcd8275c4858a9a23e3 P 76459d53d41a4b1ba0a4145a12c46642: stopping tablet replica
I20260619 18:46:14.844213 6627 raft_consensus.cc:2229] T b1536b8ade254fcd8275c4858a9a23e3 P 76459d53d41a4b1ba0a4145a12c46642 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 18:46:14.844628 6627 raft_consensus.cc:2258] T b1536b8ade254fcd8275c4858a9a23e3 P 76459d53d41a4b1ba0a4145a12c46642 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:14.866297 6627 tablet_server.cc:194] TabletServer@127.6.120.194:0 shutdown complete.
I20260619 18:46:14.877449 6627 tablet_server.cc:178] TabletServer@127.6.120.195:0 shutting down...
I20260619 18:46:14.898043 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:46:14.898964 6627 tablet_replica.cc:330] T b1536b8ade254fcd8275c4858a9a23e3 P d5a59b39b200425e90a14a70d491e5e8: stopping tablet replica
I20260619 18:46:14.899623 6627 raft_consensus.cc:2229] T b1536b8ade254fcd8275c4858a9a23e3 P d5a59b39b200425e90a14a70d491e5e8 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:14.900435 6627 pending_rounds.cc:62] T b1536b8ade254fcd8275c4858a9a23e3 P d5a59b39b200425e90a14a70d491e5e8: Trying to abort 1 pending ops.
I20260619 18:46:14.900678 6627 pending_rounds.cc:68] T b1536b8ade254fcd8275c4858a9a23e3 P d5a59b39b200425e90a14a70d491e5e8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298640997015064576 op_type: NO_OP noop_request { }
I20260619 18:46:14.900979 6627 raft_consensus.cc:2866] T b1536b8ade254fcd8275c4858a9a23e3 P d5a59b39b200425e90a14a70d491e5e8 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 18:46:14.901258 6627 raft_consensus.cc:2258] T b1536b8ade254fcd8275c4858a9a23e3 P d5a59b39b200425e90a14a70d491e5e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:14.923259 6627 tablet_server.cc:194] TabletServer@127.6.120.195:0 shutdown complete.
I20260619 18:46:14.933955 6627 tablet_server.cc:178] TabletServer@127.6.120.196:0 shutting down...
I20260619 18:46:14.953034 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:46:14.954077 6627 tablet_replica.cc:330] T 5f5258b6a647476d9d2a61a8f146e101 P cd19b79f5a1245fb939a133d69b9af2b: stopping tablet replica
I20260619 18:46:14.954698 6627 raft_consensus.cc:2229] T 5f5258b6a647476d9d2a61a8f146e101 P cd19b79f5a1245fb939a133d69b9af2b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 18:46:14.955193 6627 raft_consensus.cc:2258] T 5f5258b6a647476d9d2a61a8f146e101 P cd19b79f5a1245fb939a133d69b9af2b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:14.976286 6627 tablet_server.cc:194] TabletServer@127.6.120.196:0 shutdown complete.
I20260619 18:46:14.986305 6627 master.cc:537] Master@127.6.120.254:43699 shutting down...
I20260619 18:46:15.003873 6627 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 65e949a5535b4bafa1ac04e92c415808 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:15.004552 6627 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 65e949a5535b4bafa1ac04e92c415808 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:15.004931 6627 tablet_replica.cc:330] T 00000000000000000000000000000000 P 65e949a5535b4bafa1ac04e92c415808: stopping tablet replica
I20260619 18:46:15.025566 6627 master.cc:552] Master@127.6.120.254:43699 shutdown complete.
[ SKIPPED ] MultiTServerClientTest.WriteWhileRestartingMultipleTabletServers (1451 ms)
[----------] 1 test from MultiTServerClientTest (1451 ms total)
[----------] 1 test from ClientTestAutoIncrementingColumn
[ RUN ] ClientTestAutoIncrementingColumn.AlterOperationNegatives
I20260619 18:46:15.052350 6627 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.120.254:38407
I20260619 18:46:15.053463 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:46:15.058507 13842 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:15.059403 13843 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:15.060612 13845 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:46:15.061952 6627 server_base.cc:1034] running on GCE node
I20260619 18:46:15.062846 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:46:15.063037 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:46:15.063233 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894775063219 us; error 0 us; skew 500 ppm
I20260619 18:46:15.063812 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:46:15.066193 6627 webserver.cc:460] Webserver started at http://127.6.120.254:46223/ using document root <none> and password file <none>
I20260619 18:46:15.066661 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:46:15.066847 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:46:15.067126 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:46:15.068321 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTestAutoIncrementingColumn.AlterOperationNegatives.1781894682485826-6627-0/minicluster-data/master-0-root/instance:
uuid: "03169ae21eee47558367dc44efecff42"
format_stamp: "Formatted at 2026-06-19 18:46:15 on dist-test-slave-90mn"
I20260619 18:46:15.072705 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260619 18:46:15.076079 13850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:15.077052 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260619 18:46:15.077361 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTestAutoIncrementingColumn.AlterOperationNegatives.1781894682485826-6627-0/minicluster-data/master-0-root
uuid: "03169ae21eee47558367dc44efecff42"
format_stamp: "Formatted at 2026-06-19 18:46:15 on dist-test-slave-90mn"
I20260619 18:46:15.077698 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTestAutoIncrementingColumn.AlterOperationNegatives.1781894682485826-6627-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTestAutoIncrementingColumn.AlterOperationNegatives.1781894682485826-6627-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTestAutoIncrementingColumn.AlterOperationNegatives.1781894682485826-6627-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:46:15.092952 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:46:15.093990 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:46:15.130358 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.254:38407
I20260619 18:46:15.130470 13901 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.254:38407 every 8 connection(s)
I20260619 18:46:15.134200 13902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:15.145710 13902 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03169ae21eee47558367dc44efecff42: Bootstrap starting.
I20260619 18:46:15.150602 13902 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 03169ae21eee47558367dc44efecff42: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:15.155195 13902 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03169ae21eee47558367dc44efecff42: No bootstrap required, opened a new log
I20260619 18:46:15.157250 13902 raft_consensus.cc:348] T 00000000000000000000000000000000 P 03169ae21eee47558367dc44efecff42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03169ae21eee47558367dc44efecff42" member_type: VOTER }
I20260619 18:46:15.157647 13902 raft_consensus.cc:374] T 00000000000000000000000000000000 P 03169ae21eee47558367dc44efecff42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:15.157819 13902 raft_consensus.cc:729] T 00000000000000000000000000000000 P 03169ae21eee47558367dc44efecff42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03169ae21eee47558367dc44efecff42, State: Initialized, Role: FOLLOWER
I20260619 18:46:15.158309 13902 consensus_queue.cc:260] T 00000000000000000000000000000000 P 03169ae21eee47558367dc44efecff42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03169ae21eee47558367dc44efecff42" member_type: VOTER }
I20260619 18:46:15.158717 13902 raft_consensus.cc:388] T 00000000000000000000000000000000 P 03169ae21eee47558367dc44efecff42 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:46:15.158905 13902 raft_consensus.cc:482] T 00000000000000000000000000000000 P 03169ae21eee47558367dc44efecff42 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:46:15.159097 13902 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 03169ae21eee47558367dc44efecff42 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:15.163389 13902 raft_consensus.cc:504] T 00000000000000000000000000000000 P 03169ae21eee47558367dc44efecff42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03169ae21eee47558367dc44efecff42" member_type: VOTER }
I20260619 18:46:15.163872 13902 leader_election.cc:302] T 00000000000000000000000000000000 P 03169ae21eee47558367dc44efecff42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 03169ae21eee47558367dc44efecff42; no voters:
I20260619 18:46:15.165156 13902 leader_election.cc:288] T 00000000000000000000000000000000 P 03169ae21eee47558367dc44efecff42 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:46:15.165522 13905 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 03169ae21eee47558367dc44efecff42 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:46:15.166949 13905 raft_consensus.cc:686] T 00000000000000000000000000000000 P 03169ae21eee47558367dc44efecff42 [term 1 LEADER]: Becoming Leader. State: Replica: 03169ae21eee47558367dc44efecff42, State: Running, Role: LEADER
I20260619 18:46:15.167546 13905 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03169ae21eee47558367dc44efecff42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03169ae21eee47558367dc44efecff42" member_type: VOTER }
I20260619 18:46:15.168094 13902 sys_catalog.cc:564] T 00000000000000000000000000000000 P 03169ae21eee47558367dc44efecff42 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 18:46:15.170500 13906 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03169ae21eee47558367dc44efecff42 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "03169ae21eee47558367dc44efecff42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03169ae21eee47558367dc44efecff42" member_type: VOTER } }
I20260619 18:46:15.170500 13907 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03169ae21eee47558367dc44efecff42 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03169ae21eee47558367dc44efecff42. Latest consensus state: current_term: 1 leader_uuid: "03169ae21eee47558367dc44efecff42" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03169ae21eee47558367dc44efecff42" member_type: VOTER } }
I20260619 18:46:15.171360 13906 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03169ae21eee47558367dc44efecff42 [sys.catalog]: This master's current role is: LEADER
I20260619 18:46:15.171481 13907 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03169ae21eee47558367dc44efecff42 [sys.catalog]: This master's current role is: LEADER
I20260619 18:46:15.175117 13910 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 18:46:15.181751 13910 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 18:46:15.183053 6627 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260619 18:46:15.190707 13910 catalog_manager.cc:1347] Generated new cluster ID: 3a12f702e880406c99c8d2d4fb1d99ce
I20260619 18:46:15.191026 13910 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 18:46:15.207563 13910 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 18:46:15.209484 13910 catalog_manager.cc:1504] Loading token signing keys...
I20260619 18:46:15.225942 13910 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 03169ae21eee47558367dc44efecff42: Generated new TSK 0
I20260619 18:46:15.226697 13910 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 18:46:15.250293 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:46:15.257040 13923 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:15.258103 13924 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:15.260950 13926 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:46:15.261312 6627 server_base.cc:1034] running on GCE node
I20260619 18:46:15.262315 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:46:15.262538 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:46:15.262730 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894775262715 us; error 0 us; skew 500 ppm
I20260619 18:46:15.263285 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:46:15.265723 6627 webserver.cc:460] Webserver started at http://127.6.120.193:34905/ using document root <none> and password file <none>
I20260619 18:46:15.266227 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:46:15.266424 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:46:15.266651 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:46:15.267705 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTestAutoIncrementingColumn.AlterOperationNegatives.1781894682485826-6627-0/minicluster-data/ts-0-root/instance:
uuid: "8194945e0ae54562a994d488bb53de86"
format_stamp: "Formatted at 2026-06-19 18:46:15 on dist-test-slave-90mn"
I20260619 18:46:15.272671 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260619 18:46:15.276320 13931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:15.277388 6627 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260619 18:46:15.277781 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTestAutoIncrementingColumn.AlterOperationNegatives.1781894682485826-6627-0/minicluster-data/ts-0-root
uuid: "8194945e0ae54562a994d488bb53de86"
format_stamp: "Formatted at 2026-06-19 18:46:15 on dist-test-slave-90mn"
I20260619 18:46:15.278117 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTestAutoIncrementingColumn.AlterOperationNegatives.1781894682485826-6627-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTestAutoIncrementingColumn.AlterOperationNegatives.1781894682485826-6627-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTestAutoIncrementingColumn.AlterOperationNegatives.1781894682485826-6627-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:46:15.301028 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:46:15.302587 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:46:15.304023 6627 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 18:46:15.306383 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:46:15.306556 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:15.306855 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:46:15.307003 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:15.347800 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.193:45865
I20260619 18:46:15.347903 13993 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.193:45865 every 8 connection(s)
I20260619 18:46:15.353020 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:46:15.362068 13998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:15.364053 13999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:15.365463 14001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:46:15.367120 6627 server_base.cc:1034] running on GCE node
I20260619 18:46:15.368203 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:46:15.368417 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:46:15.368618 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894775368604 us; error 0 us; skew 500 ppm
I20260619 18:46:15.369211 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:46:15.371718 13994 heartbeater.cc:347] Connected to a master server at 127.6.120.254:38407
I20260619 18:46:15.372247 13994 heartbeater.cc:464] Registering TS with master...
I20260619 18:46:15.372310 6627 webserver.cc:460] Webserver started at http://127.6.120.194:33229/ using document root <none> and password file <none>
I20260619 18:46:15.373055 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:46:15.373107 13994 heartbeater.cc:511] Master 127.6.120.254:38407 requested a full tablet report, sending...
I20260619 18:46:15.373287 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:46:15.373708 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:46:15.374986 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTestAutoIncrementingColumn.AlterOperationNegatives.1781894682485826-6627-0/minicluster-data/ts-1-root/instance:
uuid: "cf578aa5c89e48ef9a9316602c164d2e"
format_stamp: "Formatted at 2026-06-19 18:46:15 on dist-test-slave-90mn"
I20260619 18:46:15.375310 13867 ts_manager.cc:194] Registered new tserver with Master: 8194945e0ae54562a994d488bb53de86 (127.6.120.193:45865)
I20260619 18:46:15.377841 13867 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41842
I20260619 18:46:15.380574 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260619 18:46:15.384666 14006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:15.385514 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.002s
I20260619 18:46:15.385915 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTestAutoIncrementingColumn.AlterOperationNegatives.1781894682485826-6627-0/minicluster-data/ts-1-root
uuid: "cf578aa5c89e48ef9a9316602c164d2e"
format_stamp: "Formatted at 2026-06-19 18:46:15 on dist-test-slave-90mn"
I20260619 18:46:15.386188 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTestAutoIncrementingColumn.AlterOperationNegatives.1781894682485826-6627-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTestAutoIncrementingColumn.AlterOperationNegatives.1781894682485826-6627-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTestAutoIncrementingColumn.AlterOperationNegatives.1781894682485826-6627-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:46:15.404354 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:46:15.405479 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:46:15.407042 6627 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 18:46:15.409307 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:46:15.409530 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:15.409788 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:46:15.409950 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:15.450843 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.194:37607
I20260619 18:46:15.450938 14068 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.194:37607 every 8 connection(s)
I20260619 18:46:15.455909 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:46:15.464843 14073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:15.465098 14075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:15.465556 14072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:46:15.467209 6627 server_base.cc:1034] running on GCE node
I20260619 18:46:15.468429 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:46:15.468721 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:46:15.468870 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894775468861 us; error 0 us; skew 500 ppm
I20260619 18:46:15.469383 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:46:15.471884 14069 heartbeater.cc:347] Connected to a master server at 127.6.120.254:38407
I20260619 18:46:15.472397 14069 heartbeater.cc:464] Registering TS with master...
I20260619 18:46:15.472800 6627 webserver.cc:460] Webserver started at http://127.6.120.195:41657/ using document root <none> and password file <none>
I20260619 18:46:15.473321 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:46:15.473287 14069 heartbeater.cc:511] Master 127.6.120.254:38407 requested a full tablet report, sending...
I20260619 18:46:15.473917 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:46:15.474298 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:46:15.475530 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTestAutoIncrementingColumn.AlterOperationNegatives.1781894682485826-6627-0/minicluster-data/ts-2-root/instance:
uuid: "4a18df27880e4b2182d08405b37edfb6"
format_stamp: "Formatted at 2026-06-19 18:46:15 on dist-test-slave-90mn"
I20260619 18:46:15.476097 13867 ts_manager.cc:194] Registered new tserver with Master: cf578aa5c89e48ef9a9316602c164d2e (127.6.120.194:37607)
I20260619 18:46:15.478243 13867 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41848
I20260619 18:46:15.481400 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260619 18:46:15.485723 14080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:15.486752 6627 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 18:46:15.487089 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTestAutoIncrementingColumn.AlterOperationNegatives.1781894682485826-6627-0/minicluster-data/ts-2-root
uuid: "4a18df27880e4b2182d08405b37edfb6"
format_stamp: "Formatted at 2026-06-19 18:46:15 on dist-test-slave-90mn"
I20260619 18:46:15.487368 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTestAutoIncrementingColumn.AlterOperationNegatives.1781894682485826-6627-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTestAutoIncrementingColumn.AlterOperationNegatives.1781894682485826-6627-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ClientTestAutoIncrementingColumn.AlterOperationNegatives.1781894682485826-6627-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:46:15.506525 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:46:15.507591 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:46:15.508962 6627 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 18:46:15.511196 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:46:15.511408 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:15.511627 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:46:15.511885 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:15.549811 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.195:43137
I20260619 18:46:15.549921 14142 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.195:43137 every 8 connection(s)
I20260619 18:46:15.566615 14143 heartbeater.cc:347] Connected to a master server at 127.6.120.254:38407
I20260619 18:46:15.567075 14143 heartbeater.cc:464] Registering TS with master...
I20260619 18:46:15.567829 14143 heartbeater.cc:511] Master 127.6.120.254:38407 requested a full tablet report, sending...
I20260619 18:46:15.569834 13867 ts_manager.cc:194] Registered new tserver with Master: 4a18df27880e4b2182d08405b37edfb6 (127.6.120.195:43137)
I20260619 18:46:15.570915 6627 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017742863s
I20260619 18:46:15.571964 13867 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41862
I20260619 18:46:15.634073 13867 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41876:
name: "alter_operation_negatives_auto_incrementing_column"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "auto_incrementing_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
is_auto_incrementing: true
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 2
seed: 0
}
}
W20260619 18:46:15.636696 13867 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table alter_operation_negatives_auto_incrementing_column in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 18:46:15.703039 14034 tablet_service.cc:1467] Processing CreateTablet for tablet 74da12a9f1a64f11a15213e26345d930 (DEFAULT_TABLE table=alter_operation_negatives_auto_incrementing_column [id=ea3c70821e614fdaa0e0e5dae90740b5]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260619 18:46:15.703251 14033 tablet_service.cc:1467] Processing CreateTablet for tablet 4fe42ae2df924ba7a7edb42e8d21a126 (DEFAULT_TABLE table=alter_operation_negatives_auto_incrementing_column [id=ea3c70821e614fdaa0e0e5dae90740b5]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260619 18:46:15.706007 14033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fe42ae2df924ba7a7edb42e8d21a126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:15.710127 13959 tablet_service.cc:1467] Processing CreateTablet for tablet 74da12a9f1a64f11a15213e26345d930 (DEFAULT_TABLE table=alter_operation_negatives_auto_incrementing_column [id=ea3c70821e614fdaa0e0e5dae90740b5]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260619 18:46:15.710631 13958 tablet_service.cc:1467] Processing CreateTablet for tablet 4fe42ae2df924ba7a7edb42e8d21a126 (DEFAULT_TABLE table=alter_operation_negatives_auto_incrementing_column [id=ea3c70821e614fdaa0e0e5dae90740b5]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260619 18:46:15.711551 13959 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74da12a9f1a64f11a15213e26345d930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:15.712188 14034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74da12a9f1a64f11a15213e26345d930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:15.712287 13958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fe42ae2df924ba7a7edb42e8d21a126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:15.716292 14108 tablet_service.cc:1467] Processing CreateTablet for tablet 74da12a9f1a64f11a15213e26345d930 (DEFAULT_TABLE table=alter_operation_negatives_auto_incrementing_column [id=ea3c70821e614fdaa0e0e5dae90740b5]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260619 18:46:15.717887 14108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 74da12a9f1a64f11a15213e26345d930. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:15.721391 14107 tablet_service.cc:1467] Processing CreateTablet for tablet 4fe42ae2df924ba7a7edb42e8d21a126 (DEFAULT_TABLE table=alter_operation_negatives_auto_incrementing_column [id=ea3c70821e614fdaa0e0e5dae90740b5]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260619 18:46:15.722916 14107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4fe42ae2df924ba7a7edb42e8d21a126. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:15.745803 14160 tablet_bootstrap.cc:492] T 74da12a9f1a64f11a15213e26345d930 P cf578aa5c89e48ef9a9316602c164d2e: Bootstrap starting.
I20260619 18:46:15.752162 14160 tablet.cc:502] Time spent fetching auto increment counter: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:15.753571 14159 tablet_bootstrap.cc:492] T 4fe42ae2df924ba7a7edb42e8d21a126 P 8194945e0ae54562a994d488bb53de86: Bootstrap starting.
I20260619 18:46:15.754199 14160 tablet_bootstrap.cc:654] T 74da12a9f1a64f11a15213e26345d930 P cf578aa5c89e48ef9a9316602c164d2e: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:15.758173 14159 tablet.cc:502] Time spent fetching auto increment counter: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:15.759821 14159 tablet_bootstrap.cc:654] T 4fe42ae2df924ba7a7edb42e8d21a126 P 8194945e0ae54562a994d488bb53de86: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:15.762691 14161 tablet_bootstrap.cc:492] T 74da12a9f1a64f11a15213e26345d930 P 4a18df27880e4b2182d08405b37edfb6: Bootstrap starting.
I20260619 18:46:15.763756 14160 tablet_bootstrap.cc:492] T 74da12a9f1a64f11a15213e26345d930 P cf578aa5c89e48ef9a9316602c164d2e: No bootstrap required, opened a new log
I20260619 18:46:15.764343 14160 ts_tablet_manager.cc:1397] T 74da12a9f1a64f11a15213e26345d930 P cf578aa5c89e48ef9a9316602c164d2e: Time spent bootstrapping tablet: real 0.019s user 0.010s sys 0.008s
I20260619 18:46:15.765836 14159 tablet_bootstrap.cc:492] T 4fe42ae2df924ba7a7edb42e8d21a126 P 8194945e0ae54562a994d488bb53de86: No bootstrap required, opened a new log
I20260619 18:46:15.766366 14159 ts_tablet_manager.cc:1397] T 4fe42ae2df924ba7a7edb42e8d21a126 P 8194945e0ae54562a994d488bb53de86: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.006s
I20260619 18:46:15.767613 14160 raft_consensus.cc:348] T 74da12a9f1a64f11a15213e26345d930 P cf578aa5c89e48ef9a9316602c164d2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf578aa5c89e48ef9a9316602c164d2e" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 37607 } } peers { permanent_uuid: "4a18df27880e4b2182d08405b37edfb6" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 43137 } } peers { permanent_uuid: "8194945e0ae54562a994d488bb53de86" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45865 } }
I20260619 18:46:15.768767 14160 raft_consensus.cc:374] T 74da12a9f1a64f11a15213e26345d930 P cf578aa5c89e48ef9a9316602c164d2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:15.769060 14160 raft_consensus.cc:729] T 74da12a9f1a64f11a15213e26345d930 P cf578aa5c89e48ef9a9316602c164d2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf578aa5c89e48ef9a9316602c164d2e, State: Initialized, Role: FOLLOWER
I20260619 18:46:15.769815 14160 consensus_queue.cc:260] T 74da12a9f1a64f11a15213e26345d930 P cf578aa5c89e48ef9a9316602c164d2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf578aa5c89e48ef9a9316602c164d2e" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 37607 } } peers { permanent_uuid: "4a18df27880e4b2182d08405b37edfb6" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 43137 } } peers { permanent_uuid: "8194945e0ae54562a994d488bb53de86" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45865 } }
I20260619 18:46:15.769778 14159 raft_consensus.cc:348] T 4fe42ae2df924ba7a7edb42e8d21a126 P 8194945e0ae54562a994d488bb53de86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8194945e0ae54562a994d488bb53de86" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45865 } } peers { permanent_uuid: "cf578aa5c89e48ef9a9316602c164d2e" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 37607 } } peers { permanent_uuid: "4a18df27880e4b2182d08405b37edfb6" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 43137 } }
I20260619 18:46:15.770953 14161 tablet.cc:502] Time spent fetching auto increment counter: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:15.770955 14159 raft_consensus.cc:374] T 4fe42ae2df924ba7a7edb42e8d21a126 P 8194945e0ae54562a994d488bb53de86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:15.771638 14159 raft_consensus.cc:729] T 4fe42ae2df924ba7a7edb42e8d21a126 P 8194945e0ae54562a994d488bb53de86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8194945e0ae54562a994d488bb53de86, State: Initialized, Role: FOLLOWER
I20260619 18:46:15.772984 14161 tablet_bootstrap.cc:654] T 74da12a9f1a64f11a15213e26345d930 P 4a18df27880e4b2182d08405b37edfb6: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:15.772420 14159 consensus_queue.cc:260] T 4fe42ae2df924ba7a7edb42e8d21a126 P 8194945e0ae54562a994d488bb53de86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8194945e0ae54562a994d488bb53de86" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45865 } } peers { permanent_uuid: "cf578aa5c89e48ef9a9316602c164d2e" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 37607 } } peers { permanent_uuid: "4a18df27880e4b2182d08405b37edfb6" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 43137 } }
I20260619 18:46:15.773365 14069 heartbeater.cc:503] Master 127.6.120.254:38407 was elected leader, sending a full tablet report...
I20260619 18:46:15.773666 14160 ts_tablet_manager.cc:1428] T 74da12a9f1a64f11a15213e26345d930 P cf578aa5c89e48ef9a9316602c164d2e: Time spent starting tablet: real 0.009s user 0.003s sys 0.005s
I20260619 18:46:15.775009 14160 tablet_bootstrap.cc:492] T 4fe42ae2df924ba7a7edb42e8d21a126 P cf578aa5c89e48ef9a9316602c164d2e: Bootstrap starting.
I20260619 18:46:15.781539 14160 tablet.cc:502] Time spent fetching auto increment counter: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:15.782982 14160 tablet_bootstrap.cc:654] T 4fe42ae2df924ba7a7edb42e8d21a126 P cf578aa5c89e48ef9a9316602c164d2e: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:15.788375 13994 heartbeater.cc:503] Master 127.6.120.254:38407 was elected leader, sending a full tablet report...
I20260619 18:46:15.788694 14161 tablet_bootstrap.cc:492] T 74da12a9f1a64f11a15213e26345d930 P 4a18df27880e4b2182d08405b37edfb6: No bootstrap required, opened a new log
I20260619 18:46:15.788761 14159 ts_tablet_manager.cc:1428] T 4fe42ae2df924ba7a7edb42e8d21a126 P 8194945e0ae54562a994d488bb53de86: Time spent starting tablet: real 0.022s user 0.015s sys 0.008s
I20260619 18:46:15.789736 14161 ts_tablet_manager.cc:1397] T 74da12a9f1a64f11a15213e26345d930 P 4a18df27880e4b2182d08405b37edfb6: Time spent bootstrapping tablet: real 0.027s user 0.017s sys 0.008s
I20260619 18:46:15.790627 14159 tablet_bootstrap.cc:492] T 74da12a9f1a64f11a15213e26345d930 P 8194945e0ae54562a994d488bb53de86: Bootstrap starting.
I20260619 18:46:15.792969 14161 raft_consensus.cc:348] T 74da12a9f1a64f11a15213e26345d930 P 4a18df27880e4b2182d08405b37edfb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf578aa5c89e48ef9a9316602c164d2e" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 37607 } } peers { permanent_uuid: "4a18df27880e4b2182d08405b37edfb6" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 43137 } } peers { permanent_uuid: "8194945e0ae54562a994d488bb53de86" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45865 } }
I20260619 18:46:15.793829 14161 raft_consensus.cc:374] T 74da12a9f1a64f11a15213e26345d930 P 4a18df27880e4b2182d08405b37edfb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:15.794134 14161 raft_consensus.cc:729] T 74da12a9f1a64f11a15213e26345d930 P 4a18df27880e4b2182d08405b37edfb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a18df27880e4b2182d08405b37edfb6, State: Initialized, Role: FOLLOWER
I20260619 18:46:15.794955 14161 consensus_queue.cc:260] T 74da12a9f1a64f11a15213e26345d930 P 4a18df27880e4b2182d08405b37edfb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf578aa5c89e48ef9a9316602c164d2e" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 37607 } } peers { permanent_uuid: "4a18df27880e4b2182d08405b37edfb6" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 43137 } } peers { permanent_uuid: "8194945e0ae54562a994d488bb53de86" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45865 } }
I20260619 18:46:15.797142 14159 tablet.cc:502] Time spent fetching auto increment counter: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:15.799015 14160 tablet_bootstrap.cc:492] T 4fe42ae2df924ba7a7edb42e8d21a126 P cf578aa5c89e48ef9a9316602c164d2e: No bootstrap required, opened a new log
I20260619 18:46:15.799300 14159 tablet_bootstrap.cc:654] T 74da12a9f1a64f11a15213e26345d930 P 8194945e0ae54562a994d488bb53de86: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:15.799569 14160 ts_tablet_manager.cc:1397] T 4fe42ae2df924ba7a7edb42e8d21a126 P cf578aa5c89e48ef9a9316602c164d2e: Time spent bootstrapping tablet: real 0.025s user 0.013s sys 0.000s
I20260619 18:46:15.803025 14160 raft_consensus.cc:348] T 4fe42ae2df924ba7a7edb42e8d21a126 P cf578aa5c89e48ef9a9316602c164d2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8194945e0ae54562a994d488bb53de86" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45865 } } peers { permanent_uuid: "cf578aa5c89e48ef9a9316602c164d2e" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 37607 } } peers { permanent_uuid: "4a18df27880e4b2182d08405b37edfb6" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 43137 } }
I20260619 18:46:15.804183 14160 raft_consensus.cc:374] T 4fe42ae2df924ba7a7edb42e8d21a126 P cf578aa5c89e48ef9a9316602c164d2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:15.804466 14160 raft_consensus.cc:729] T 4fe42ae2df924ba7a7edb42e8d21a126 P cf578aa5c89e48ef9a9316602c164d2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf578aa5c89e48ef9a9316602c164d2e, State: Initialized, Role: FOLLOWER
I20260619 18:46:15.804805 14161 ts_tablet_manager.cc:1428] T 74da12a9f1a64f11a15213e26345d930 P 4a18df27880e4b2182d08405b37edfb6: Time spent starting tablet: real 0.015s user 0.010s sys 0.004s
I20260619 18:46:15.805104 14160 consensus_queue.cc:260] T 4fe42ae2df924ba7a7edb42e8d21a126 P cf578aa5c89e48ef9a9316602c164d2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8194945e0ae54562a994d488bb53de86" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45865 } } peers { permanent_uuid: "cf578aa5c89e48ef9a9316602c164d2e" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 37607 } } peers { permanent_uuid: "4a18df27880e4b2182d08405b37edfb6" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 43137 } }
I20260619 18:46:15.806282 14143 heartbeater.cc:503] Master 127.6.120.254:38407 was elected leader, sending a full tablet report...
I20260619 18:46:15.807789 14160 ts_tablet_manager.cc:1428] T 4fe42ae2df924ba7a7edb42e8d21a126 P cf578aa5c89e48ef9a9316602c164d2e: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260619 18:46:15.808837 14161 tablet_bootstrap.cc:492] T 4fe42ae2df924ba7a7edb42e8d21a126 P 4a18df27880e4b2182d08405b37edfb6: Bootstrap starting.
I20260619 18:46:15.811431 14159 tablet_bootstrap.cc:492] T 74da12a9f1a64f11a15213e26345d930 P 8194945e0ae54562a994d488bb53de86: No bootstrap required, opened a new log
I20260619 18:46:15.811995 14159 ts_tablet_manager.cc:1397] T 74da12a9f1a64f11a15213e26345d930 P 8194945e0ae54562a994d488bb53de86: Time spent bootstrapping tablet: real 0.022s user 0.015s sys 0.000s
I20260619 18:46:15.814747 14161 tablet.cc:502] Time spent fetching auto increment counter: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:15.814994 14159 raft_consensus.cc:348] T 74da12a9f1a64f11a15213e26345d930 P 8194945e0ae54562a994d488bb53de86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf578aa5c89e48ef9a9316602c164d2e" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 37607 } } peers { permanent_uuid: "4a18df27880e4b2182d08405b37edfb6" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 43137 } } peers { permanent_uuid: "8194945e0ae54562a994d488bb53de86" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45865 } }
I20260619 18:46:15.815812 14159 raft_consensus.cc:374] T 74da12a9f1a64f11a15213e26345d930 P 8194945e0ae54562a994d488bb53de86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:15.816087 14159 raft_consensus.cc:729] T 74da12a9f1a64f11a15213e26345d930 P 8194945e0ae54562a994d488bb53de86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8194945e0ae54562a994d488bb53de86, State: Initialized, Role: FOLLOWER
I20260619 18:46:15.816362 14161 tablet_bootstrap.cc:654] T 4fe42ae2df924ba7a7edb42e8d21a126 P 4a18df27880e4b2182d08405b37edfb6: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:15.817060 14159 consensus_queue.cc:260] T 74da12a9f1a64f11a15213e26345d930 P 8194945e0ae54562a994d488bb53de86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf578aa5c89e48ef9a9316602c164d2e" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 37607 } } peers { permanent_uuid: "4a18df27880e4b2182d08405b37edfb6" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 43137 } } peers { permanent_uuid: "8194945e0ae54562a994d488bb53de86" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45865 } }
I20260619 18:46:15.819581 14159 ts_tablet_manager.cc:1428] T 74da12a9f1a64f11a15213e26345d930 P 8194945e0ae54562a994d488bb53de86: Time spent starting tablet: real 0.007s user 0.001s sys 0.004s
I20260619 18:46:15.823814 14161 tablet_bootstrap.cc:492] T 4fe42ae2df924ba7a7edb42e8d21a126 P 4a18df27880e4b2182d08405b37edfb6: No bootstrap required, opened a new log
I20260619 18:46:15.824345 14161 ts_tablet_manager.cc:1397] T 4fe42ae2df924ba7a7edb42e8d21a126 P 4a18df27880e4b2182d08405b37edfb6: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.008s
I20260619 18:46:15.826583 14161 raft_consensus.cc:348] T 4fe42ae2df924ba7a7edb42e8d21a126 P 4a18df27880e4b2182d08405b37edfb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8194945e0ae54562a994d488bb53de86" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45865 } } peers { permanent_uuid: "cf578aa5c89e48ef9a9316602c164d2e" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 37607 } } peers { permanent_uuid: "4a18df27880e4b2182d08405b37edfb6" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 43137 } }
I20260619 18:46:15.827154 14161 raft_consensus.cc:374] T 4fe42ae2df924ba7a7edb42e8d21a126 P 4a18df27880e4b2182d08405b37edfb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:15.827373 14161 raft_consensus.cc:729] T 4fe42ae2df924ba7a7edb42e8d21a126 P 4a18df27880e4b2182d08405b37edfb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a18df27880e4b2182d08405b37edfb6, State: Initialized, Role: FOLLOWER
I20260619 18:46:15.827955 14161 consensus_queue.cc:260] T 4fe42ae2df924ba7a7edb42e8d21a126 P 4a18df27880e4b2182d08405b37edfb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8194945e0ae54562a994d488bb53de86" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45865 } } peers { permanent_uuid: "cf578aa5c89e48ef9a9316602c164d2e" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 37607 } } peers { permanent_uuid: "4a18df27880e4b2182d08405b37edfb6" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 43137 } }
I20260619 18:46:15.829706 14161 ts_tablet_manager.cc:1428] T 4fe42ae2df924ba7a7edb42e8d21a126 P 4a18df27880e4b2182d08405b37edfb6: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260619 18:46:15.910498 14165 raft_consensus.cc:482] T 4fe42ae2df924ba7a7edb42e8d21a126 P 8194945e0ae54562a994d488bb53de86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 18:46:15.911010 14165 raft_consensus.cc:504] T 4fe42ae2df924ba7a7edb42e8d21a126 P 8194945e0ae54562a994d488bb53de86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8194945e0ae54562a994d488bb53de86" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45865 } } peers { permanent_uuid: "cf578aa5c89e48ef9a9316602c164d2e" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 37607 } } peers { permanent_uuid: "4a18df27880e4b2182d08405b37edfb6" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 43137 } }
I20260619 18:46:15.912976 14165 leader_election.cc:288] T 4fe42ae2df924ba7a7edb42e8d21a126 P 8194945e0ae54562a994d488bb53de86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf578aa5c89e48ef9a9316602c164d2e (127.6.120.194:37607), 4a18df27880e4b2182d08405b37edfb6 (127.6.120.195:43137)
I20260619 18:46:15.919373 14164 raft_consensus.cc:482] T 74da12a9f1a64f11a15213e26345d930 P cf578aa5c89e48ef9a9316602c164d2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 18:46:15.919988 14164 raft_consensus.cc:504] T 74da12a9f1a64f11a15213e26345d930 P cf578aa5c89e48ef9a9316602c164d2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf578aa5c89e48ef9a9316602c164d2e" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 37607 } } peers { permanent_uuid: "4a18df27880e4b2182d08405b37edfb6" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 43137 } } peers { permanent_uuid: "8194945e0ae54562a994d488bb53de86" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45865 } }
I20260619 18:46:15.922564 14164 leader_election.cc:288] T 74da12a9f1a64f11a15213e26345d930 P cf578aa5c89e48ef9a9316602c164d2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a18df27880e4b2182d08405b37edfb6 (127.6.120.195:43137), 8194945e0ae54562a994d488bb53de86 (127.6.120.193:45865)
I20260619 18:46:15.938174 14044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fe42ae2df924ba7a7edb42e8d21a126" candidate_uuid: "8194945e0ae54562a994d488bb53de86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf578aa5c89e48ef9a9316602c164d2e" is_pre_election: true
I20260619 18:46:15.939059 14044 raft_consensus.cc:2454] T 4fe42ae2df924ba7a7edb42e8d21a126 P cf578aa5c89e48ef9a9316602c164d2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8194945e0ae54562a994d488bb53de86 in term 0.
I20260619 18:46:15.940366 13932 leader_election.cc:302] T 4fe42ae2df924ba7a7edb42e8d21a126 P 8194945e0ae54562a994d488bb53de86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8194945e0ae54562a994d488bb53de86, cf578aa5c89e48ef9a9316602c164d2e; no voters:
I20260619 18:46:15.941210 14118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fe42ae2df924ba7a7edb42e8d21a126" candidate_uuid: "8194945e0ae54562a994d488bb53de86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a18df27880e4b2182d08405b37edfb6" is_pre_election: true
I20260619 18:46:15.942029 14118 raft_consensus.cc:2454] T 4fe42ae2df924ba7a7edb42e8d21a126 P 4a18df27880e4b2182d08405b37edfb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8194945e0ae54562a994d488bb53de86 in term 0.
I20260619 18:46:15.943018 14165 raft_consensus.cc:2781] T 4fe42ae2df924ba7a7edb42e8d21a126 P 8194945e0ae54562a994d488bb53de86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 18:46:15.943439 14165 raft_consensus.cc:482] T 4fe42ae2df924ba7a7edb42e8d21a126 P 8194945e0ae54562a994d488bb53de86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 18:46:15.943763 14165 raft_consensus.cc:3037] T 4fe42ae2df924ba7a7edb42e8d21a126 P 8194945e0ae54562a994d488bb53de86 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:15.948652 14118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74da12a9f1a64f11a15213e26345d930" candidate_uuid: "cf578aa5c89e48ef9a9316602c164d2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a18df27880e4b2182d08405b37edfb6" is_pre_election: true
I20260619 18:46:15.949412 14118 raft_consensus.cc:2454] T 74da12a9f1a64f11a15213e26345d930 P 4a18df27880e4b2182d08405b37edfb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf578aa5c89e48ef9a9316602c164d2e in term 0.
I20260619 18:46:15.950235 13969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74da12a9f1a64f11a15213e26345d930" candidate_uuid: "cf578aa5c89e48ef9a9316602c164d2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8194945e0ae54562a994d488bb53de86" is_pre_election: true
I20260619 18:46:15.950858 14009 leader_election.cc:302] T 74da12a9f1a64f11a15213e26345d930 P cf578aa5c89e48ef9a9316602c164d2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a18df27880e4b2182d08405b37edfb6, cf578aa5c89e48ef9a9316602c164d2e; no voters:
I20260619 18:46:15.951063 13969 raft_consensus.cc:2454] T 74da12a9f1a64f11a15213e26345d930 P 8194945e0ae54562a994d488bb53de86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf578aa5c89e48ef9a9316602c164d2e in term 0.
I20260619 18:46:15.951977 14164 raft_consensus.cc:2781] T 74da12a9f1a64f11a15213e26345d930 P cf578aa5c89e48ef9a9316602c164d2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 18:46:15.952402 14164 raft_consensus.cc:482] T 74da12a9f1a64f11a15213e26345d930 P cf578aa5c89e48ef9a9316602c164d2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 18:46:15.952752 14164 raft_consensus.cc:3037] T 74da12a9f1a64f11a15213e26345d930 P cf578aa5c89e48ef9a9316602c164d2e [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:15.954818 14165 raft_consensus.cc:504] T 4fe42ae2df924ba7a7edb42e8d21a126 P 8194945e0ae54562a994d488bb53de86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8194945e0ae54562a994d488bb53de86" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45865 } } peers { permanent_uuid: "cf578aa5c89e48ef9a9316602c164d2e" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 37607 } } peers { permanent_uuid: "4a18df27880e4b2182d08405b37edfb6" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 43137 } }
I20260619 18:46:15.957796 14044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fe42ae2df924ba7a7edb42e8d21a126" candidate_uuid: "8194945e0ae54562a994d488bb53de86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf578aa5c89e48ef9a9316602c164d2e"
I20260619 18:46:15.958024 14118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4fe42ae2df924ba7a7edb42e8d21a126" candidate_uuid: "8194945e0ae54562a994d488bb53de86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a18df27880e4b2182d08405b37edfb6"
I20260619 18:46:15.958449 14044 raft_consensus.cc:3037] T 4fe42ae2df924ba7a7edb42e8d21a126 P cf578aa5c89e48ef9a9316602c164d2e [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:15.958670 14118 raft_consensus.cc:3037] T 4fe42ae2df924ba7a7edb42e8d21a126 P 4a18df27880e4b2182d08405b37edfb6 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:15.959794 14164 raft_consensus.cc:504] T 74da12a9f1a64f11a15213e26345d930 P cf578aa5c89e48ef9a9316602c164d2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf578aa5c89e48ef9a9316602c164d2e" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 37607 } } peers { permanent_uuid: "4a18df27880e4b2182d08405b37edfb6" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 43137 } } peers { permanent_uuid: "8194945e0ae54562a994d488bb53de86" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45865 } }
I20260619 18:46:15.960244 14165 leader_election.cc:288] T 4fe42ae2df924ba7a7edb42e8d21a126 P 8194945e0ae54562a994d488bb53de86 [CANDIDATE]: Term 1 election: Requested vote from peers cf578aa5c89e48ef9a9316602c164d2e (127.6.120.194:37607), 4a18df27880e4b2182d08405b37edfb6 (127.6.120.195:43137)
I20260619 18:46:15.963055 14117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74da12a9f1a64f11a15213e26345d930" candidate_uuid: "cf578aa5c89e48ef9a9316602c164d2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a18df27880e4b2182d08405b37edfb6"
I20260619 18:46:15.963322 14164 leader_election.cc:288] T 74da12a9f1a64f11a15213e26345d930 P cf578aa5c89e48ef9a9316602c164d2e [CANDIDATE]: Term 1 election: Requested vote from peers 4a18df27880e4b2182d08405b37edfb6 (127.6.120.195:43137), 8194945e0ae54562a994d488bb53de86 (127.6.120.193:45865)
I20260619 18:46:15.963758 14117 raft_consensus.cc:3037] T 74da12a9f1a64f11a15213e26345d930 P 4a18df27880e4b2182d08405b37edfb6 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:15.963995 13969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "74da12a9f1a64f11a15213e26345d930" candidate_uuid: "cf578aa5c89e48ef9a9316602c164d2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8194945e0ae54562a994d488bb53de86"
I20260619 18:46:15.964551 13969 raft_consensus.cc:3037] T 74da12a9f1a64f11a15213e26345d930 P 8194945e0ae54562a994d488bb53de86 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:15.965153 14118 raft_consensus.cc:2454] T 4fe42ae2df924ba7a7edb42e8d21a126 P 4a18df27880e4b2182d08405b37edfb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8194945e0ae54562a994d488bb53de86 in term 1.
I20260619 18:46:15.966535 13934 leader_election.cc:302] T 4fe42ae2df924ba7a7edb42e8d21a126 P 8194945e0ae54562a994d488bb53de86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a18df27880e4b2182d08405b37edfb6, 8194945e0ae54562a994d488bb53de86; no voters:
I20260619 18:46:15.967425 14165 raft_consensus.cc:2781] T 4fe42ae2df924ba7a7edb42e8d21a126 P 8194945e0ae54562a994d488bb53de86 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:46:15.970371 14044 raft_consensus.cc:2454] T 4fe42ae2df924ba7a7edb42e8d21a126 P cf578aa5c89e48ef9a9316602c164d2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8194945e0ae54562a994d488bb53de86 in term 1.
I20260619 18:46:15.972091 14165 raft_consensus.cc:686] T 4fe42ae2df924ba7a7edb42e8d21a126 P 8194945e0ae54562a994d488bb53de86 [term 1 LEADER]: Becoming Leader. State: Replica: 8194945e0ae54562a994d488bb53de86, State: Running, Role: LEADER
I20260619 18:46:15.972316 13969 raft_consensus.cc:2454] T 74da12a9f1a64f11a15213e26345d930 P 8194945e0ae54562a994d488bb53de86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf578aa5c89e48ef9a9316602c164d2e in term 1.
I20260619 18:46:15.972218 14117 raft_consensus.cc:2454] T 74da12a9f1a64f11a15213e26345d930 P 4a18df27880e4b2182d08405b37edfb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf578aa5c89e48ef9a9316602c164d2e in term 1.
I20260619 18:46:15.973765 14007 leader_election.cc:302] T 74da12a9f1a64f11a15213e26345d930 P cf578aa5c89e48ef9a9316602c164d2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8194945e0ae54562a994d488bb53de86, cf578aa5c89e48ef9a9316602c164d2e; no voters:
I20260619 18:46:15.973388 14165 consensus_queue.cc:237] T 4fe42ae2df924ba7a7edb42e8d21a126 P 8194945e0ae54562a994d488bb53de86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8194945e0ae54562a994d488bb53de86" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45865 } } peers { permanent_uuid: "cf578aa5c89e48ef9a9316602c164d2e" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 37607 } } peers { permanent_uuid: "4a18df27880e4b2182d08405b37edfb6" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 43137 } }
I20260619 18:46:15.974957 14164 raft_consensus.cc:2781] T 74da12a9f1a64f11a15213e26345d930 P cf578aa5c89e48ef9a9316602c164d2e [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:46:15.976468 14164 raft_consensus.cc:686] T 74da12a9f1a64f11a15213e26345d930 P cf578aa5c89e48ef9a9316602c164d2e [term 1 LEADER]: Becoming Leader. State: Replica: cf578aa5c89e48ef9a9316602c164d2e, State: Running, Role: LEADER
I20260619 18:46:15.977316 14164 consensus_queue.cc:237] T 74da12a9f1a64f11a15213e26345d930 P cf578aa5c89e48ef9a9316602c164d2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf578aa5c89e48ef9a9316602c164d2e" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 37607 } } peers { permanent_uuid: "4a18df27880e4b2182d08405b37edfb6" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 43137 } } peers { permanent_uuid: "8194945e0ae54562a994d488bb53de86" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45865 } }
I20260619 18:46:15.986104 13865 catalog_manager.cc:5495] T 4fe42ae2df924ba7a7edb42e8d21a126 P 8194945e0ae54562a994d488bb53de86 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8194945e0ae54562a994d488bb53de86 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "8194945e0ae54562a994d488bb53de86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8194945e0ae54562a994d488bb53de86" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf578aa5c89e48ef9a9316602c164d2e" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 37607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a18df27880e4b2182d08405b37edfb6" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 43137 } health_report { overall_health: UNKNOWN } } }
I20260619 18:46:15.986008 13867 catalog_manager.cc:5495] T 74da12a9f1a64f11a15213e26345d930 P cf578aa5c89e48ef9a9316602c164d2e reported cstate change: term changed from 0 to 1, leader changed from <none> to cf578aa5c89e48ef9a9316602c164d2e (127.6.120.194). New cstate: current_term: 1 leader_uuid: "cf578aa5c89e48ef9a9316602c164d2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf578aa5c89e48ef9a9316602c164d2e" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 37607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a18df27880e4b2182d08405b37edfb6" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 43137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8194945e0ae54562a994d488bb53de86" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 45865 } health_report { overall_health: UNKNOWN } } }
I20260619 18:46:16.010427 6627 tablet_server.cc:178] TabletServer@127.6.120.193:0 shutting down...
I20260619 18:46:16.038655 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:46:16.039693 6627 tablet_replica.cc:330] T 74da12a9f1a64f11a15213e26345d930 P 8194945e0ae54562a994d488bb53de86: stopping tablet replica
I20260619 18:46:16.040427 6627 raft_consensus.cc:2229] T 74da12a9f1a64f11a15213e26345d930 P 8194945e0ae54562a994d488bb53de86 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 18:46:16.040884 6627 raft_consensus.cc:2258] T 74da12a9f1a64f11a15213e26345d930 P 8194945e0ae54562a994d488bb53de86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:16.043180 6627 tablet_replica.cc:330] T 4fe42ae2df924ba7a7edb42e8d21a126 P 8194945e0ae54562a994d488bb53de86: stopping tablet replica
I20260619 18:46:16.043749 6627 raft_consensus.cc:2229] T 4fe42ae2df924ba7a7edb42e8d21a126 P 8194945e0ae54562a994d488bb53de86 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:16.044478 6627 pending_rounds.cc:62] T 4fe42ae2df924ba7a7edb42e8d21a126 P 8194945e0ae54562a994d488bb53de86: Trying to abort 1 pending ops.
I20260619 18:46:16.044718 6627 pending_rounds.cc:68] T 4fe42ae2df924ba7a7edb42e8d21a126 P 8194945e0ae54562a994d488bb53de86: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298641002396905472 op_type: NO_OP noop_request { }
I20260619 18:46:16.045084 6627 raft_consensus.cc:2866] T 4fe42ae2df924ba7a7edb42e8d21a126 P 8194945e0ae54562a994d488bb53de86 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 18:46:16.045377 6627 raft_consensus.cc:2258] T 4fe42ae2df924ba7a7edb42e8d21a126 P 8194945e0ae54562a994d488bb53de86 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:16.068614 6627 tablet_server.cc:194] TabletServer@127.6.120.193:0 shutdown complete.
I20260619 18:46:16.082343 6627 tablet_server.cc:178] TabletServer@127.6.120.194:0 shutting down...
I20260619 18:46:16.106760 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:46:16.107813 6627 tablet_replica.cc:330] T 4fe42ae2df924ba7a7edb42e8d21a126 P cf578aa5c89e48ef9a9316602c164d2e: stopping tablet replica
I20260619 18:46:16.108522 6627 raft_consensus.cc:2229] T 4fe42ae2df924ba7a7edb42e8d21a126 P cf578aa5c89e48ef9a9316602c164d2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 18:46:16.108978 6627 raft_consensus.cc:2258] T 4fe42ae2df924ba7a7edb42e8d21a126 P cf578aa5c89e48ef9a9316602c164d2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:16.111171 6627 tablet_replica.cc:330] T 74da12a9f1a64f11a15213e26345d930 P cf578aa5c89e48ef9a9316602c164d2e: stopping tablet replica
I20260619 18:46:16.111675 6627 raft_consensus.cc:2229] T 74da12a9f1a64f11a15213e26345d930 P cf578aa5c89e48ef9a9316602c164d2e [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:16.112391 6627 pending_rounds.cc:62] T 74da12a9f1a64f11a15213e26345d930 P cf578aa5c89e48ef9a9316602c164d2e: Trying to abort 1 pending ops.
I20260619 18:46:16.112589 6627 pending_rounds.cc:68] T 74da12a9f1a64f11a15213e26345d930 P cf578aa5c89e48ef9a9316602c164d2e: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7298641002411163648 op_type: NO_OP noop_request { }
I20260619 18:46:16.112848 6627 raft_consensus.cc:2866] T 74da12a9f1a64f11a15213e26345d930 P cf578aa5c89e48ef9a9316602c164d2e [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260619 18:46:16.113154 6627 raft_consensus.cc:2258] T 74da12a9f1a64f11a15213e26345d930 P cf578aa5c89e48ef9a9316602c164d2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:16.135311 6627 tablet_server.cc:194] TabletServer@127.6.120.194:0 shutdown complete.
I20260619 18:46:16.147447 6627 tablet_server.cc:178] TabletServer@127.6.120.195:0 shutting down...
I20260619 18:46:16.171461 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:46:16.172571 6627 tablet_replica.cc:330] T 4fe42ae2df924ba7a7edb42e8d21a126 P 4a18df27880e4b2182d08405b37edfb6: stopping tablet replica
I20260619 18:46:16.173131 6627 raft_consensus.cc:2229] T 4fe42ae2df924ba7a7edb42e8d21a126 P 4a18df27880e4b2182d08405b37edfb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 18:46:16.173549 6627 raft_consensus.cc:2258] T 4fe42ae2df924ba7a7edb42e8d21a126 P 4a18df27880e4b2182d08405b37edfb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:16.175654 6627 tablet_replica.cc:330] T 74da12a9f1a64f11a15213e26345d930 P 4a18df27880e4b2182d08405b37edfb6: stopping tablet replica
I20260619 18:46:16.176249 6627 raft_consensus.cc:2229] T 74da12a9f1a64f11a15213e26345d930 P 4a18df27880e4b2182d08405b37edfb6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 18:46:16.176673 6627 raft_consensus.cc:2258] T 74da12a9f1a64f11a15213e26345d930 P 4a18df27880e4b2182d08405b37edfb6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:16.197541 6627 tablet_server.cc:194] TabletServer@127.6.120.195:0 shutdown complete.
I20260619 18:46:16.210304 6627 master.cc:537] Master@127.6.120.254:38407 shutting down...
I20260619 18:46:16.233876 6627 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 03169ae21eee47558367dc44efecff42 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:16.234454 6627 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 03169ae21eee47558367dc44efecff42 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:16.234769 6627 tablet_replica.cc:330] T 00000000000000000000000000000000 P 03169ae21eee47558367dc44efecff42: stopping tablet replica
I20260619 18:46:16.254959 6627 master.cc:552] Master@127.6.120.254:38407 shutdown complete.
[ OK ] ClientTestAutoIncrementingColumn.AlterOperationNegatives (1235 ms)
[----------] 1 test from ClientTestAutoIncrementingColumn (1235 ms total)
[----------] 1 test from KeepAlivePeriodically/KeepAlivePeriodicallyTest
[ RUN ] KeepAlivePeriodically/KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers/1
I20260619 18:46:16.287549 6627 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.120.254:44779
I20260619 18:46:16.288834 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:46:16.295403 14179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:16.295418 14180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:16.296260 14182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:46:16.296471 6627 server_base.cc:1034] running on GCE node
I20260619 18:46:16.297637 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:46:16.297856 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:46:16.298019 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894776297998 us; error 0 us; skew 500 ppm
I20260619 18:46:16.298533 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:46:16.301085 6627 webserver.cc:460] Webserver started at http://127.6.120.254:33353/ using document root <none> and password file <none>
I20260619 18:46:16.301558 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:46:16.301764 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:46:16.302043 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:46:16.303170 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers_1.1781894682485826-6627-0/minicluster-data/master-0-root/instance:
uuid: "2d73262e891747afae1b9766da41ad2c"
format_stamp: "Formatted at 2026-06-19 18:46:16 on dist-test-slave-90mn"
I20260619 18:46:16.307919 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260619 18:46:16.311583 14187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:16.312552 6627 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 18:46:16.312814 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers_1.1781894682485826-6627-0/minicluster-data/master-0-root
uuid: "2d73262e891747afae1b9766da41ad2c"
format_stamp: "Formatted at 2026-06-19 18:46:16 on dist-test-slave-90mn"
I20260619 18:46:16.313066 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers_1.1781894682485826-6627-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers_1.1781894682485826-6627-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers_1.1781894682485826-6627-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:46:16.324270 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:46:16.325454 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:46:16.368644 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.254:44779
I20260619 18:46:16.368850 14248 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.254:44779 every 8 connection(s)
I20260619 18:46:16.372524 14249 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:16.382934 14249 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d73262e891747afae1b9766da41ad2c: Bootstrap starting.
I20260619 18:46:16.387598 14249 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2d73262e891747afae1b9766da41ad2c: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:16.391987 14249 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d73262e891747afae1b9766da41ad2c: No bootstrap required, opened a new log
I20260619 18:46:16.394361 14249 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2d73262e891747afae1b9766da41ad2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d73262e891747afae1b9766da41ad2c" member_type: VOTER }
I20260619 18:46:16.394824 14249 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2d73262e891747afae1b9766da41ad2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:16.395102 14249 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2d73262e891747afae1b9766da41ad2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d73262e891747afae1b9766da41ad2c, State: Initialized, Role: FOLLOWER
I20260619 18:46:16.395797 14249 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d73262e891747afae1b9766da41ad2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d73262e891747afae1b9766da41ad2c" member_type: VOTER }
I20260619 18:46:16.396317 14249 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2d73262e891747afae1b9766da41ad2c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:46:16.396607 14249 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2d73262e891747afae1b9766da41ad2c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:46:16.396894 14249 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2d73262e891747afae1b9766da41ad2c [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:16.401604 14249 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2d73262e891747afae1b9766da41ad2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d73262e891747afae1b9766da41ad2c" member_type: VOTER }
I20260619 18:46:16.402177 14249 leader_election.cc:302] T 00000000000000000000000000000000 P 2d73262e891747afae1b9766da41ad2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2d73262e891747afae1b9766da41ad2c; no voters:
I20260619 18:46:16.403348 14249 leader_election.cc:288] T 00000000000000000000000000000000 P 2d73262e891747afae1b9766da41ad2c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:46:16.403723 14252 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2d73262e891747afae1b9766da41ad2c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:46:16.405294 14252 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2d73262e891747afae1b9766da41ad2c [term 1 LEADER]: Becoming Leader. State: Replica: 2d73262e891747afae1b9766da41ad2c, State: Running, Role: LEADER
I20260619 18:46:16.405998 14252 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2d73262e891747afae1b9766da41ad2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d73262e891747afae1b9766da41ad2c" member_type: VOTER }
I20260619 18:46:16.406706 14249 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2d73262e891747afae1b9766da41ad2c [sys.catalog]: configured and running, proceeding with master startup.
I20260619 18:46:16.409057 14253 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d73262e891747afae1b9766da41ad2c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2d73262e891747afae1b9766da41ad2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d73262e891747afae1b9766da41ad2c" member_type: VOTER } }
I20260619 18:46:16.409161 14254 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d73262e891747afae1b9766da41ad2c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2d73262e891747afae1b9766da41ad2c. Latest consensus state: current_term: 1 leader_uuid: "2d73262e891747afae1b9766da41ad2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2d73262e891747afae1b9766da41ad2c" member_type: VOTER } }
I20260619 18:46:16.409919 14253 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d73262e891747afae1b9766da41ad2c [sys.catalog]: This master's current role is: LEADER
I20260619 18:46:16.410053 14254 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d73262e891747afae1b9766da41ad2c [sys.catalog]: This master's current role is: LEADER
I20260619 18:46:16.412700 14257 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 18:46:16.417976 14257 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 18:46:16.424497 6627 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260619 18:46:16.427704 14257 catalog_manager.cc:1347] Generated new cluster ID: ff05b0ac6ad6471fa407f86abb7c4c3b
I20260619 18:46:16.428192 14257 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 18:46:16.451380 14257 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 18:46:16.453712 14257 catalog_manager.cc:1504] Loading token signing keys...
I20260619 18:46:16.472983 14257 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2d73262e891747afae1b9766da41ad2c: Generated new TSK 0
I20260619 18:46:16.473776 14257 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 18:46:16.497138 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:46:16.503626 14270 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:16.505214 14271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:16.507099 14273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:46:16.507207 6627 server_base.cc:1034] running on GCE node
I20260619 18:46:16.508394 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:46:16.508584 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:46:16.508790 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894776508776 us; error 0 us; skew 500 ppm
I20260619 18:46:16.509346 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:46:16.511881 6627 webserver.cc:460] Webserver started at http://127.6.120.193:33063/ using document root <none> and password file <none>
I20260619 18:46:16.512408 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:46:16.512584 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:46:16.512778 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:46:16.513872 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers_1.1781894682485826-6627-0/minicluster-data/ts-0-root/instance:
uuid: "4cc736fb7c2147828e44a2aa4412529b"
format_stamp: "Formatted at 2026-06-19 18:46:16 on dist-test-slave-90mn"
I20260619 18:46:16.518756 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260619 18:46:16.522745 14278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:16.523592 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260619 18:46:16.523921 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers_1.1781894682485826-6627-0/minicluster-data/ts-0-root
uuid: "4cc736fb7c2147828e44a2aa4412529b"
format_stamp: "Formatted at 2026-06-19 18:46:16 on dist-test-slave-90mn"
I20260619 18:46:16.524277 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers_1.1781894682485826-6627-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers_1.1781894682485826-6627-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers_1.1781894682485826-6627-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:46:16.540548 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:46:16.541731 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:46:16.547127 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:46:16.547580 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260619 18:46:16.548008 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:46:16.548357 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:16.604678 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.193:42085
I20260619 18:46:16.604971 14348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.193:42085 every 8 connection(s)
I20260619 18:46:16.609799 14349 heartbeater.cc:347] Connected to a master server at 127.6.120.254:44779
I20260619 18:46:16.610257 14349 heartbeater.cc:464] Registering TS with master...
I20260619 18:46:16.611155 14349 heartbeater.cc:511] Master 127.6.120.254:44779 requested a full tablet report, sending...
I20260619 18:46:16.613411 14204 ts_manager.cc:194] Registered new tserver with Master: 4cc736fb7c2147828e44a2aa4412529b (127.6.120.193:42085)
I20260619 18:46:16.613504 6627 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.005308646s
I20260619 18:46:16.617131 14204 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56288
I20260619 18:46:16.632258 14349 heartbeater.cc:503] Master 127.6.120.254:44779 was elected leader, sending a full tablet report...
I20260619 18:46:16.642072 14204 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56294:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 18:46:16.679479 14314 tablet_service.cc:1467] Processing CreateTablet for tablet 55caef10b9814d6caae77b9f2f31131a (DEFAULT_TABLE table=client-testtb [id=1632eb005cff42d58b456b319dae73be]), partition=RANGE (key) PARTITION VALUES < 9
I20260619 18:46:16.679690 14313 tablet_service.cc:1467] Processing CreateTablet for tablet 15837974f2b04544942750ac6d3ba107 (DEFAULT_TABLE table=client-testtb [id=1632eb005cff42d58b456b319dae73be]), partition=RANGE (key) PARTITION 9 <= VALUES
I20260619 18:46:16.681231 14314 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55caef10b9814d6caae77b9f2f31131a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:16.681784 14313 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15837974f2b04544942750ac6d3ba107. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:16.697674 14359 tablet_bootstrap.cc:492] T 15837974f2b04544942750ac6d3ba107 P 4cc736fb7c2147828e44a2aa4412529b: Bootstrap starting.
I20260619 18:46:16.703604 14359 tablet_bootstrap.cc:654] T 15837974f2b04544942750ac6d3ba107 P 4cc736fb7c2147828e44a2aa4412529b: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:16.710670 14359 tablet_bootstrap.cc:492] T 15837974f2b04544942750ac6d3ba107 P 4cc736fb7c2147828e44a2aa4412529b: No bootstrap required, opened a new log
I20260619 18:46:16.711187 14359 ts_tablet_manager.cc:1397] T 15837974f2b04544942750ac6d3ba107 P 4cc736fb7c2147828e44a2aa4412529b: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.011s
I20260619 18:46:16.716298 14359 raft_consensus.cc:348] T 15837974f2b04544942750ac6d3ba107 P 4cc736fb7c2147828e44a2aa4412529b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cc736fb7c2147828e44a2aa4412529b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42085 } }
I20260619 18:46:16.716925 14359 raft_consensus.cc:374] T 15837974f2b04544942750ac6d3ba107 P 4cc736fb7c2147828e44a2aa4412529b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:16.717264 14359 raft_consensus.cc:729] T 15837974f2b04544942750ac6d3ba107 P 4cc736fb7c2147828e44a2aa4412529b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cc736fb7c2147828e44a2aa4412529b, State: Initialized, Role: FOLLOWER
I20260619 18:46:16.717926 14359 consensus_queue.cc:260] T 15837974f2b04544942750ac6d3ba107 P 4cc736fb7c2147828e44a2aa4412529b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cc736fb7c2147828e44a2aa4412529b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42085 } }
I20260619 18:46:16.718535 14359 raft_consensus.cc:388] T 15837974f2b04544942750ac6d3ba107 P 4cc736fb7c2147828e44a2aa4412529b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:46:16.718782 14359 raft_consensus.cc:482] T 15837974f2b04544942750ac6d3ba107 P 4cc736fb7c2147828e44a2aa4412529b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:46:16.719075 14359 raft_consensus.cc:3037] T 15837974f2b04544942750ac6d3ba107 P 4cc736fb7c2147828e44a2aa4412529b [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:16.725804 14359 raft_consensus.cc:504] T 15837974f2b04544942750ac6d3ba107 P 4cc736fb7c2147828e44a2aa4412529b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cc736fb7c2147828e44a2aa4412529b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42085 } }
I20260619 18:46:16.726446 14359 leader_election.cc:302] T 15837974f2b04544942750ac6d3ba107 P 4cc736fb7c2147828e44a2aa4412529b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4cc736fb7c2147828e44a2aa4412529b; no voters:
I20260619 18:46:16.727967 14359 leader_election.cc:288] T 15837974f2b04544942750ac6d3ba107 P 4cc736fb7c2147828e44a2aa4412529b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:46:16.728416 14361 raft_consensus.cc:2781] T 15837974f2b04544942750ac6d3ba107 P 4cc736fb7c2147828e44a2aa4412529b [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:46:16.729971 14361 raft_consensus.cc:686] T 15837974f2b04544942750ac6d3ba107 P 4cc736fb7c2147828e44a2aa4412529b [term 1 LEADER]: Becoming Leader. State: Replica: 4cc736fb7c2147828e44a2aa4412529b, State: Running, Role: LEADER
I20260619 18:46:16.730638 14359 ts_tablet_manager.cc:1428] T 15837974f2b04544942750ac6d3ba107 P 4cc736fb7c2147828e44a2aa4412529b: Time spent starting tablet: real 0.019s user 0.018s sys 0.000s
I20260619 18:46:16.730787 14361 consensus_queue.cc:237] T 15837974f2b04544942750ac6d3ba107 P 4cc736fb7c2147828e44a2aa4412529b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cc736fb7c2147828e44a2aa4412529b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42085 } }
I20260619 18:46:16.732074 14359 tablet_bootstrap.cc:492] T 55caef10b9814d6caae77b9f2f31131a P 4cc736fb7c2147828e44a2aa4412529b: Bootstrap starting.
I20260619 18:46:16.739332 14359 tablet_bootstrap.cc:654] T 55caef10b9814d6caae77b9f2f31131a P 4cc736fb7c2147828e44a2aa4412529b: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:16.740796 14204 catalog_manager.cc:5495] T 15837974f2b04544942750ac6d3ba107 P 4cc736fb7c2147828e44a2aa4412529b reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cc736fb7c2147828e44a2aa4412529b (127.6.120.193). New cstate: current_term: 1 leader_uuid: "4cc736fb7c2147828e44a2aa4412529b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cc736fb7c2147828e44a2aa4412529b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42085 } health_report { overall_health: HEALTHY } } }
I20260619 18:46:16.744575 14359 tablet_bootstrap.cc:492] T 55caef10b9814d6caae77b9f2f31131a P 4cc736fb7c2147828e44a2aa4412529b: No bootstrap required, opened a new log
I20260619 18:46:16.745057 14359 ts_tablet_manager.cc:1397] T 55caef10b9814d6caae77b9f2f31131a P 4cc736fb7c2147828e44a2aa4412529b: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.005s
I20260619 18:46:16.748148 14359 raft_consensus.cc:348] T 55caef10b9814d6caae77b9f2f31131a P 4cc736fb7c2147828e44a2aa4412529b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cc736fb7c2147828e44a2aa4412529b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42085 } }
I20260619 18:46:16.748708 14359 raft_consensus.cc:374] T 55caef10b9814d6caae77b9f2f31131a P 4cc736fb7c2147828e44a2aa4412529b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:16.748957 14359 raft_consensus.cc:729] T 55caef10b9814d6caae77b9f2f31131a P 4cc736fb7c2147828e44a2aa4412529b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4cc736fb7c2147828e44a2aa4412529b, State: Initialized, Role: FOLLOWER
I20260619 18:46:16.749560 14359 consensus_queue.cc:260] T 55caef10b9814d6caae77b9f2f31131a P 4cc736fb7c2147828e44a2aa4412529b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cc736fb7c2147828e44a2aa4412529b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42085 } }
I20260619 18:46:16.750257 14359 raft_consensus.cc:388] T 55caef10b9814d6caae77b9f2f31131a P 4cc736fb7c2147828e44a2aa4412529b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:46:16.750532 14359 raft_consensus.cc:482] T 55caef10b9814d6caae77b9f2f31131a P 4cc736fb7c2147828e44a2aa4412529b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:46:16.750890 14359 raft_consensus.cc:3037] T 55caef10b9814d6caae77b9f2f31131a P 4cc736fb7c2147828e44a2aa4412529b [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:16.757807 14359 raft_consensus.cc:504] T 55caef10b9814d6caae77b9f2f31131a P 4cc736fb7c2147828e44a2aa4412529b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cc736fb7c2147828e44a2aa4412529b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42085 } }
I20260619 18:46:16.758333 14359 leader_election.cc:302] T 55caef10b9814d6caae77b9f2f31131a P 4cc736fb7c2147828e44a2aa4412529b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4cc736fb7c2147828e44a2aa4412529b; no voters:
I20260619 18:46:16.758751 14359 leader_election.cc:288] T 55caef10b9814d6caae77b9f2f31131a P 4cc736fb7c2147828e44a2aa4412529b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:46:16.758977 14361 raft_consensus.cc:2781] T 55caef10b9814d6caae77b9f2f31131a P 4cc736fb7c2147828e44a2aa4412529b [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:46:16.759500 14361 raft_consensus.cc:686] T 55caef10b9814d6caae77b9f2f31131a P 4cc736fb7c2147828e44a2aa4412529b [term 1 LEADER]: Becoming Leader. State: Replica: 4cc736fb7c2147828e44a2aa4412529b, State: Running, Role: LEADER
I20260619 18:46:16.760344 14359 ts_tablet_manager.cc:1428] T 55caef10b9814d6caae77b9f2f31131a P 4cc736fb7c2147828e44a2aa4412529b: Time spent starting tablet: real 0.015s user 0.013s sys 0.002s
I20260619 18:46:16.761066 14361 consensus_queue.cc:237] T 55caef10b9814d6caae77b9f2f31131a P 4cc736fb7c2147828e44a2aa4412529b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cc736fb7c2147828e44a2aa4412529b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42085 } }
I20260619 18:46:16.767038 14204 catalog_manager.cc:5495] T 55caef10b9814d6caae77b9f2f31131a P 4cc736fb7c2147828e44a2aa4412529b reported cstate change: term changed from 0 to 1, leader changed from <none> to 4cc736fb7c2147828e44a2aa4412529b (127.6.120.193). New cstate: current_term: 1 leader_uuid: "4cc736fb7c2147828e44a2aa4412529b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4cc736fb7c2147828e44a2aa4412529b" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42085 } health_report { overall_health: HEALTHY } } }
I20260619 18:46:16.787231 6627 tablet_server.cc:178] TabletServer@127.6.120.193:0 shutting down...
I20260619 18:46:16.815166 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:46:16.816041 6627 tablet_replica.cc:330] T 55caef10b9814d6caae77b9f2f31131a P 4cc736fb7c2147828e44a2aa4412529b: stopping tablet replica
I20260619 18:46:16.816794 6627 raft_consensus.cc:2229] T 55caef10b9814d6caae77b9f2f31131a P 4cc736fb7c2147828e44a2aa4412529b [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:16.817368 6627 raft_consensus.cc:2258] T 55caef10b9814d6caae77b9f2f31131a P 4cc736fb7c2147828e44a2aa4412529b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:16.820466 6627 tablet_replica.cc:330] T 15837974f2b04544942750ac6d3ba107 P 4cc736fb7c2147828e44a2aa4412529b: stopping tablet replica
I20260619 18:46:16.820971 6627 raft_consensus.cc:2229] T 15837974f2b04544942750ac6d3ba107 P 4cc736fb7c2147828e44a2aa4412529b [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:16.821374 6627 raft_consensus.cc:2258] T 15837974f2b04544942750ac6d3ba107 P 4cc736fb7c2147828e44a2aa4412529b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:16.843209 6627 tablet_server.cc:194] TabletServer@127.6.120.193:0 shutdown complete.
I20260619 18:46:16.856550 6627 master.cc:537] Master@127.6.120.254:44779 shutting down...
I20260619 18:46:16.875308 6627 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 2d73262e891747afae1b9766da41ad2c [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:16.875928 6627 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 2d73262e891747afae1b9766da41ad2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:16.876538 6627 tablet_replica.cc:330] T 00000000000000000000000000000000 P 2d73262e891747afae1b9766da41ad2c: stopping tablet replica
I20260619 18:46:16.897336 6627 master.cc:552] Master@127.6.120.254:44779 shutdown complete.
I20260619 18:46:16.913070 6627 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.120.254:36689
I20260619 18:46:16.914211 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:46:16.919416 14368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:16.920845 14369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:16.921208 14371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:46:16.921881 6627 server_base.cc:1034] running on GCE node
I20260619 18:46:16.922653 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:46:16.922823 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:46:16.922935 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894776922928 us; error 0 us; skew 500 ppm
I20260619 18:46:16.923385 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:46:16.925846 6627 webserver.cc:460] Webserver started at http://127.6.120.254:34789/ using document root <none> and password file <none>
I20260619 18:46:16.926342 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:46:16.926501 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:46:16.926708 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:46:16.927711 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers_1.1781894682485826-6627-0/minicluster-data/master-0-root/instance:
uuid: "bb3eb09a89d34f6289e015f02351f14e"
format_stamp: "Formatted at 2026-06-19 18:46:16 on dist-test-slave-90mn"
I20260619 18:46:16.932920 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260619 18:46:16.936482 14376 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:16.937325 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260619 18:46:16.937674 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers_1.1781894682485826-6627-0/minicluster-data/master-0-root
uuid: "bb3eb09a89d34f6289e015f02351f14e"
format_stamp: "Formatted at 2026-06-19 18:46:16 on dist-test-slave-90mn"
I20260619 18:46:16.937973 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers_1.1781894682485826-6627-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers_1.1781894682485826-6627-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers_1.1781894682485826-6627-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:46:16.961923 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:46:16.962985 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:46:17.003443 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.254:36689
I20260619 18:46:17.003559 14437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.254:36689 every 8 connection(s)
I20260619 18:46:17.007180 14438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:17.018154 14438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb3eb09a89d34f6289e015f02351f14e: Bootstrap starting.
I20260619 18:46:17.022547 14438 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bb3eb09a89d34f6289e015f02351f14e: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:17.026559 14438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb3eb09a89d34f6289e015f02351f14e: No bootstrap required, opened a new log
I20260619 18:46:17.028613 14438 raft_consensus.cc:348] T 00000000000000000000000000000000 P bb3eb09a89d34f6289e015f02351f14e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb3eb09a89d34f6289e015f02351f14e" member_type: VOTER }
I20260619 18:46:17.028995 14438 raft_consensus.cc:374] T 00000000000000000000000000000000 P bb3eb09a89d34f6289e015f02351f14e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:17.029171 14438 raft_consensus.cc:729] T 00000000000000000000000000000000 P bb3eb09a89d34f6289e015f02351f14e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb3eb09a89d34f6289e015f02351f14e, State: Initialized, Role: FOLLOWER
I20260619 18:46:17.029747 14438 consensus_queue.cc:260] T 00000000000000000000000000000000 P bb3eb09a89d34f6289e015f02351f14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb3eb09a89d34f6289e015f02351f14e" member_type: VOTER }
I20260619 18:46:17.030216 14438 raft_consensus.cc:388] T 00000000000000000000000000000000 P bb3eb09a89d34f6289e015f02351f14e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:46:17.030409 14438 raft_consensus.cc:482] T 00000000000000000000000000000000 P bb3eb09a89d34f6289e015f02351f14e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:46:17.030622 14438 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bb3eb09a89d34f6289e015f02351f14e [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:17.035048 14438 raft_consensus.cc:504] T 00000000000000000000000000000000 P bb3eb09a89d34f6289e015f02351f14e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb3eb09a89d34f6289e015f02351f14e" member_type: VOTER }
I20260619 18:46:17.035511 14438 leader_election.cc:302] T 00000000000000000000000000000000 P bb3eb09a89d34f6289e015f02351f14e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bb3eb09a89d34f6289e015f02351f14e; no voters:
I20260619 18:46:17.036681 14438 leader_election.cc:288] T 00000000000000000000000000000000 P bb3eb09a89d34f6289e015f02351f14e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:46:17.037060 14441 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bb3eb09a89d34f6289e015f02351f14e [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:46:17.038699 14441 raft_consensus.cc:686] T 00000000000000000000000000000000 P bb3eb09a89d34f6289e015f02351f14e [term 1 LEADER]: Becoming Leader. State: Replica: bb3eb09a89d34f6289e015f02351f14e, State: Running, Role: LEADER
I20260619 18:46:17.039474 14441 consensus_queue.cc:237] T 00000000000000000000000000000000 P bb3eb09a89d34f6289e015f02351f14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb3eb09a89d34f6289e015f02351f14e" member_type: VOTER }
I20260619 18:46:17.039881 14438 sys_catalog.cc:564] T 00000000000000000000000000000000 P bb3eb09a89d34f6289e015f02351f14e [sys.catalog]: configured and running, proceeding with master startup.
I20260619 18:46:17.042199 14442 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb3eb09a89d34f6289e015f02351f14e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bb3eb09a89d34f6289e015f02351f14e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb3eb09a89d34f6289e015f02351f14e" member_type: VOTER } }
I20260619 18:46:17.042689 14442 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb3eb09a89d34f6289e015f02351f14e [sys.catalog]: This master's current role is: LEADER
I20260619 18:46:17.043469 14443 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb3eb09a89d34f6289e015f02351f14e [sys.catalog]: SysCatalogTable state changed. Reason: New leader bb3eb09a89d34f6289e015f02351f14e. Latest consensus state: current_term: 1 leader_uuid: "bb3eb09a89d34f6289e015f02351f14e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb3eb09a89d34f6289e015f02351f14e" member_type: VOTER } }
I20260619 18:46:17.044934 14443 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb3eb09a89d34f6289e015f02351f14e [sys.catalog]: This master's current role is: LEADER
I20260619 18:46:17.049012 14446 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 18:46:17.056571 14446 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 18:46:17.057879 6627 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260619 18:46:17.065702 14446 catalog_manager.cc:1347] Generated new cluster ID: c6b687bbb6e741dd9bad8bb375df85a4
I20260619 18:46:17.066288 14446 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 18:46:17.108695 14446 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 18:46:17.110899 14446 catalog_manager.cc:1504] Loading token signing keys...
I20260619 18:46:17.126349 14446 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bb3eb09a89d34f6289e015f02351f14e: Generated new TSK 0
I20260619 18:46:17.127178 14446 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 18:46:17.189438 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:46:17.195401 14459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:17.196503 14460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:17.199546 14462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:46:17.199790 6627 server_base.cc:1034] running on GCE node
I20260619 18:46:17.200855 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:46:17.201064 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:46:17.201243 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894777201228 us; error 0 us; skew 500 ppm
I20260619 18:46:17.201781 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:46:17.204192 6627 webserver.cc:460] Webserver started at http://127.6.120.193:35765/ using document root <none> and password file <none>
I20260619 18:46:17.204649 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:46:17.204846 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:46:17.205098 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:46:17.206192 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers_1.1781894682485826-6627-0/minicluster-data/ts-0-root/instance:
uuid: "28c5fae1e1b44708aa00200ea4fa9153"
format_stamp: "Formatted at 2026-06-19 18:46:17 on dist-test-slave-90mn"
I20260619 18:46:17.210928 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260619 18:46:17.214512 14467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:17.215412 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260619 18:46:17.215907 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers_1.1781894682485826-6627-0/minicluster-data/ts-0-root
uuid: "28c5fae1e1b44708aa00200ea4fa9153"
format_stamp: "Formatted at 2026-06-19 18:46:17 on dist-test-slave-90mn"
I20260619 18:46:17.216305 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers_1.1781894682485826-6627-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers_1.1781894682485826-6627-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers_1.1781894682485826-6627-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:46:17.238869 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:46:17.240165 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:46:17.246256 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:46:17.246726 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.001s user 0.001s sys 0.000s
I20260619 18:46:17.247076 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:46:17.247339 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:17.306690 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.193:42081
I20260619 18:46:17.306779 14537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.193:42081 every 8 connection(s)
I20260619 18:46:17.311606 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260619 18:46:17.311776 14538 heartbeater.cc:347] Connected to a master server at 127.6.120.254:36689
I20260619 18:46:17.312269 14538 heartbeater.cc:464] Registering TS with master...
I20260619 18:46:17.313153 14538 heartbeater.cc:511] Master 127.6.120.254:36689 requested a full tablet report, sending...
I20260619 18:46:17.315542 14393 ts_manager.cc:194] Registered new tserver with Master: 28c5fae1e1b44708aa00200ea4fa9153 (127.6.120.193:42081)
I20260619 18:46:17.319334 14393 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47064
W20260619 18:46:17.320977 14541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:17.325102 14540 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:17.326840 14543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:46:17.329291 6627 server_base.cc:1034] running on GCE node
I20260619 18:46:17.330179 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:46:17.330449 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:46:17.330600 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894777330590 us; error 0 us; skew 500 ppm
I20260619 18:46:17.331133 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:46:17.333890 6627 webserver.cc:460] Webserver started at http://127.6.120.194:39553/ using document root <none> and password file <none>
I20260619 18:46:17.334504 14538 heartbeater.cc:503] Master 127.6.120.254:36689 was elected leader, sending a full tablet report...
I20260619 18:46:17.334510 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:46:17.335111 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:46:17.335457 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:46:17.336898 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers_1.1781894682485826-6627-0/minicluster-data/ts-1-root/instance:
uuid: "de8b7c85ad8346629c2cc75b92ce1841"
format_stamp: "Formatted at 2026-06-19 18:46:17 on dist-test-slave-90mn"
I20260619 18:46:17.342021 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 18:46:17.345439 14548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:17.346452 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260619 18:46:17.346860 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers_1.1781894682485826-6627-0/minicluster-data/ts-1-root
uuid: "de8b7c85ad8346629c2cc75b92ce1841"
format_stamp: "Formatted at 2026-06-19 18:46:17 on dist-test-slave-90mn"
I20260619 18:46:17.347163 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers_1.1781894682485826-6627-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers_1.1781894682485826-6627-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers_1.1781894682485826-6627-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:46:17.372598 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:46:17.373776 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:46:17.379766 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:46:17.380249 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.001s user 0.000s sys 0.000s
I20260619 18:46:17.380640 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:46:17.380913 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:17.439203 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.194:38047
I20260619 18:46:17.439364 14617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.194:38047 every 8 connection(s)
I20260619 18:46:17.444494 14618 heartbeater.cc:347] Connected to a master server at 127.6.120.254:36689
I20260619 18:46:17.444440 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260619 18:46:17.445251 14618 heartbeater.cc:464] Registering TS with master...
I20260619 18:46:17.446336 14618 heartbeater.cc:511] Master 127.6.120.254:36689 requested a full tablet report, sending...
I20260619 18:46:17.449045 14392 ts_manager.cc:194] Registered new tserver with Master: de8b7c85ad8346629c2cc75b92ce1841 (127.6.120.194:38047)
I20260619 18:46:17.452152 14392 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50402
W20260619 18:46:17.454417 14620 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:17.457216 14621 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:46:17.460891 6627 server_base.cc:1034] running on GCE node
W20260619 18:46:17.462435 14623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:46:17.463719 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:46:17.464062 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:46:17.464305 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894777464286 us; error 0 us; skew 500 ppm
I20260619 18:46:17.465066 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:46:17.468075 6627 webserver.cc:460] Webserver started at http://127.6.120.195:45837/ using document root <none> and password file <none>
I20260619 18:46:17.468431 14618 heartbeater.cc:503] Master 127.6.120.254:36689 was elected leader, sending a full tablet report...
I20260619 18:46:17.468729 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:46:17.469033 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:46:17.469337 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:46:17.470638 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers_1.1781894682485826-6627-0/minicluster-data/ts-2-root/instance:
uuid: "2d826400f19d40c6b47f7b328a25981e"
format_stamp: "Formatted at 2026-06-19 18:46:17 on dist-test-slave-90mn"
I20260619 18:46:17.475332 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260619 18:46:17.479365 14628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:17.480384 6627 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 18:46:17.480700 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers_1.1781894682485826-6627-0/minicluster-data/ts-2-root
uuid: "2d826400f19d40c6b47f7b328a25981e"
format_stamp: "Formatted at 2026-06-19 18:46:17 on dist-test-slave-90mn"
I20260619 18:46:17.481012 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers_1.1781894682485826-6627-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers_1.1781894682485826-6627-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.KeepAlivePeriodically_KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers_1.1781894682485826-6627-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:46:17.505337 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:46:17.506844 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:46:17.513087 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:46:17.513444 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:17.513763 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:46:17.513974 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:17.587970 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.195:41877
I20260619 18:46:17.588071 14697 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.195:41877 every 8 connection(s)
I20260619 18:46:17.593274 14698 heartbeater.cc:347] Connected to a master server at 127.6.120.254:36689
I20260619 18:46:17.593752 14698 heartbeater.cc:464] Registering TS with master...
I20260619 18:46:17.594731 14698 heartbeater.cc:511] Master 127.6.120.254:36689 requested a full tablet report, sending...
I20260619 18:46:17.597083 14392 ts_manager.cc:194] Registered new tserver with Master: 2d826400f19d40c6b47f7b328a25981e (127.6.120.195:41877)
I20260619 18:46:17.598169 6627 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.006717101s
I20260619 18:46:17.599493 14392 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50426
I20260619 18:46:17.613076 14698 heartbeater.cc:503] Master 127.6.120.254:36689 was elected leader, sending a full tablet report...
I20260619 18:46:17.627159 14392 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50452:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
hash_schema {
columns {
name: "key"
}
num_buckets: 3
seed: 0
}
}
W20260619 18:46:17.630065 14392 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table client-testtb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 18:46:17.706707 14662 tablet_service.cc:1467] Processing CreateTablet for tablet 2d76489f27034ddba02153ed1476a976 (DEFAULT_TABLE table=client-testtb [id=402369ab781b4e09a1c29998b0d1ddb9]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260619 18:46:17.706696 14663 tablet_service.cc:1467] Processing CreateTablet for tablet 628bd229d0934ecb9d8e23c3450fcb05 (DEFAULT_TABLE table=client-testtb [id=402369ab781b4e09a1c29998b0d1ddb9]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260619 18:46:17.708214 14662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d76489f27034ddba02153ed1476a976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:17.708561 14583 tablet_service.cc:1467] Processing CreateTablet for tablet 628bd229d0934ecb9d8e23c3450fcb05 (DEFAULT_TABLE table=client-testtb [id=402369ab781b4e09a1c29998b0d1ddb9]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260619 18:46:17.709060 14663 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 628bd229d0934ecb9d8e23c3450fcb05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:17.709920 14583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 628bd229d0934ecb9d8e23c3450fcb05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:17.710616 14661 tablet_service.cc:1467] Processing CreateTablet for tablet 070eee78223a4ecab3b174225d89ff5a (DEFAULT_TABLE table=client-testtb [id=402369ab781b4e09a1c29998b0d1ddb9]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260619 18:46:17.712015 14661 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 070eee78223a4ecab3b174225d89ff5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:17.713418 14582 tablet_service.cc:1467] Processing CreateTablet for tablet 2d76489f27034ddba02153ed1476a976 (DEFAULT_TABLE table=client-testtb [id=402369ab781b4e09a1c29998b0d1ddb9]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260619 18:46:17.715096 14582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d76489f27034ddba02153ed1476a976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:17.717677 14581 tablet_service.cc:1467] Processing CreateTablet for tablet 070eee78223a4ecab3b174225d89ff5a (DEFAULT_TABLE table=client-testtb [id=402369ab781b4e09a1c29998b0d1ddb9]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260619 18:46:17.719530 14581 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 070eee78223a4ecab3b174225d89ff5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:17.737320 14503 tablet_service.cc:1467] Processing CreateTablet for tablet 628bd229d0934ecb9d8e23c3450fcb05 (DEFAULT_TABLE table=client-testtb [id=402369ab781b4e09a1c29998b0d1ddb9]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED
I20260619 18:46:17.738832 14503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 628bd229d0934ecb9d8e23c3450fcb05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:17.741176 14502 tablet_service.cc:1467] Processing CreateTablet for tablet 2d76489f27034ddba02153ed1476a976 (DEFAULT_TABLE table=client-testtb [id=402369ab781b4e09a1c29998b0d1ddb9]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED
I20260619 18:46:17.742554 14502 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d76489f27034ddba02153ed1476a976. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:17.745385 14501 tablet_service.cc:1467] Processing CreateTablet for tablet 070eee78223a4ecab3b174225d89ff5a (DEFAULT_TABLE table=client-testtb [id=402369ab781b4e09a1c29998b0d1ddb9]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED
I20260619 18:46:17.746809 14501 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 070eee78223a4ecab3b174225d89ff5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:17.747440 14715 tablet_bootstrap.cc:492] T 628bd229d0934ecb9d8e23c3450fcb05 P 2d826400f19d40c6b47f7b328a25981e: Bootstrap starting.
I20260619 18:46:17.751485 14716 tablet_bootstrap.cc:492] T 628bd229d0934ecb9d8e23c3450fcb05 P de8b7c85ad8346629c2cc75b92ce1841: Bootstrap starting.
I20260619 18:46:17.759614 14716 tablet_bootstrap.cc:654] T 628bd229d0934ecb9d8e23c3450fcb05 P de8b7c85ad8346629c2cc75b92ce1841: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:17.760226 14715 tablet_bootstrap.cc:654] T 628bd229d0934ecb9d8e23c3450fcb05 P 2d826400f19d40c6b47f7b328a25981e: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:17.776937 14715 tablet_bootstrap.cc:492] T 628bd229d0934ecb9d8e23c3450fcb05 P 2d826400f19d40c6b47f7b328a25981e: No bootstrap required, opened a new log
I20260619 18:46:17.778215 14715 ts_tablet_manager.cc:1397] T 628bd229d0934ecb9d8e23c3450fcb05 P 2d826400f19d40c6b47f7b328a25981e: Time spent bootstrapping tablet: real 0.044s user 0.015s sys 0.003s
I20260619 18:46:17.777626 14716 tablet_bootstrap.cc:492] T 628bd229d0934ecb9d8e23c3450fcb05 P de8b7c85ad8346629c2cc75b92ce1841: No bootstrap required, opened a new log
I20260619 18:46:17.778939 14716 ts_tablet_manager.cc:1397] T 628bd229d0934ecb9d8e23c3450fcb05 P de8b7c85ad8346629c2cc75b92ce1841: Time spent bootstrapping tablet: real 0.028s user 0.015s sys 0.003s
I20260619 18:46:17.785441 14715 raft_consensus.cc:348] T 628bd229d0934ecb9d8e23c3450fcb05 P 2d826400f19d40c6b47f7b328a25981e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } }
I20260619 18:46:17.782213 14716 raft_consensus.cc:348] T 628bd229d0934ecb9d8e23c3450fcb05 P de8b7c85ad8346629c2cc75b92ce1841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } }
I20260619 18:46:17.786744 14716 raft_consensus.cc:374] T 628bd229d0934ecb9d8e23c3450fcb05 P de8b7c85ad8346629c2cc75b92ce1841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:17.786723 14715 raft_consensus.cc:374] T 628bd229d0934ecb9d8e23c3450fcb05 P 2d826400f19d40c6b47f7b328a25981e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:17.787525 14715 raft_consensus.cc:729] T 628bd229d0934ecb9d8e23c3450fcb05 P 2d826400f19d40c6b47f7b328a25981e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d826400f19d40c6b47f7b328a25981e, State: Initialized, Role: FOLLOWER
I20260619 18:46:17.788607 14715 consensus_queue.cc:260] T 628bd229d0934ecb9d8e23c3450fcb05 P 2d826400f19d40c6b47f7b328a25981e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } }
I20260619 18:46:17.787400 14716 raft_consensus.cc:729] T 628bd229d0934ecb9d8e23c3450fcb05 P de8b7c85ad8346629c2cc75b92ce1841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de8b7c85ad8346629c2cc75b92ce1841, State: Initialized, Role: FOLLOWER
I20260619 18:46:17.790045 14716 consensus_queue.cc:260] T 628bd229d0934ecb9d8e23c3450fcb05 P de8b7c85ad8346629c2cc75b92ce1841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } }
I20260619 18:46:17.798564 14715 ts_tablet_manager.cc:1428] T 628bd229d0934ecb9d8e23c3450fcb05 P 2d826400f19d40c6b47f7b328a25981e: Time spent starting tablet: real 0.016s user 0.012s sys 0.000s
I20260619 18:46:17.800346 14715 tablet_bootstrap.cc:492] T 070eee78223a4ecab3b174225d89ff5a P 2d826400f19d40c6b47f7b328a25981e: Bootstrap starting.
I20260619 18:46:17.803839 14716 ts_tablet_manager.cc:1428] T 628bd229d0934ecb9d8e23c3450fcb05 P de8b7c85ad8346629c2cc75b92ce1841: Time spent starting tablet: real 0.025s user 0.007s sys 0.004s
I20260619 18:46:17.807039 14715 tablet_bootstrap.cc:654] T 070eee78223a4ecab3b174225d89ff5a P 2d826400f19d40c6b47f7b328a25981e: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:17.807935 14721 tablet_bootstrap.cc:492] T 2d76489f27034ddba02153ed1476a976 P 28c5fae1e1b44708aa00200ea4fa9153: Bootstrap starting.
I20260619 18:46:17.808693 14716 tablet_bootstrap.cc:492] T 2d76489f27034ddba02153ed1476a976 P de8b7c85ad8346629c2cc75b92ce1841: Bootstrap starting.
I20260619 18:46:17.814428 14716 tablet_bootstrap.cc:654] T 2d76489f27034ddba02153ed1476a976 P de8b7c85ad8346629c2cc75b92ce1841: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:17.820971 14721 tablet_bootstrap.cc:654] T 2d76489f27034ddba02153ed1476a976 P 28c5fae1e1b44708aa00200ea4fa9153: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:17.827880 14715 tablet_bootstrap.cc:492] T 070eee78223a4ecab3b174225d89ff5a P 2d826400f19d40c6b47f7b328a25981e: No bootstrap required, opened a new log
I20260619 18:46:17.828536 14715 ts_tablet_manager.cc:1397] T 070eee78223a4ecab3b174225d89ff5a P 2d826400f19d40c6b47f7b328a25981e: Time spent bootstrapping tablet: real 0.028s user 0.014s sys 0.010s
I20260619 18:46:17.831789 14716 tablet_bootstrap.cc:492] T 2d76489f27034ddba02153ed1476a976 P de8b7c85ad8346629c2cc75b92ce1841: No bootstrap required, opened a new log
I20260619 18:46:17.831389 14715 raft_consensus.cc:348] T 070eee78223a4ecab3b174225d89ff5a P 2d826400f19d40c6b47f7b328a25981e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } }
I20260619 18:46:17.832427 14715 raft_consensus.cc:374] T 070eee78223a4ecab3b174225d89ff5a P 2d826400f19d40c6b47f7b328a25981e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:17.832537 14716 ts_tablet_manager.cc:1397] T 2d76489f27034ddba02153ed1476a976 P de8b7c85ad8346629c2cc75b92ce1841: Time spent bootstrapping tablet: real 0.024s user 0.013s sys 0.000s
I20260619 18:46:17.832787 14715 raft_consensus.cc:729] T 070eee78223a4ecab3b174225d89ff5a P 2d826400f19d40c6b47f7b328a25981e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d826400f19d40c6b47f7b328a25981e, State: Initialized, Role: FOLLOWER
I20260619 18:46:17.833695 14715 consensus_queue.cc:260] T 070eee78223a4ecab3b174225d89ff5a P 2d826400f19d40c6b47f7b328a25981e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } }
I20260619 18:46:17.835098 14721 tablet_bootstrap.cc:492] T 2d76489f27034ddba02153ed1476a976 P 28c5fae1e1b44708aa00200ea4fa9153: No bootstrap required, opened a new log
I20260619 18:46:17.835633 14721 ts_tablet_manager.cc:1397] T 2d76489f27034ddba02153ed1476a976 P 28c5fae1e1b44708aa00200ea4fa9153: Time spent bootstrapping tablet: real 0.028s user 0.014s sys 0.004s
I20260619 18:46:17.835891 14715 ts_tablet_manager.cc:1428] T 070eee78223a4ecab3b174225d89ff5a P 2d826400f19d40c6b47f7b328a25981e: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260619 18:46:17.835744 14716 raft_consensus.cc:348] T 2d76489f27034ddba02153ed1476a976 P de8b7c85ad8346629c2cc75b92ce1841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } }
I20260619 18:46:17.836690 14716 raft_consensus.cc:374] T 2d76489f27034ddba02153ed1476a976 P de8b7c85ad8346629c2cc75b92ce1841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:17.836997 14716 raft_consensus.cc:729] T 2d76489f27034ddba02153ed1476a976 P de8b7c85ad8346629c2cc75b92ce1841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de8b7c85ad8346629c2cc75b92ce1841, State: Initialized, Role: FOLLOWER
I20260619 18:46:17.837239 14715 tablet_bootstrap.cc:492] T 2d76489f27034ddba02153ed1476a976 P 2d826400f19d40c6b47f7b328a25981e: Bootstrap starting.
I20260619 18:46:17.837833 14716 consensus_queue.cc:260] T 2d76489f27034ddba02153ed1476a976 P de8b7c85ad8346629c2cc75b92ce1841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } }
I20260619 18:46:17.838706 14721 raft_consensus.cc:348] T 2d76489f27034ddba02153ed1476a976 P 28c5fae1e1b44708aa00200ea4fa9153 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } }
I20260619 18:46:17.839493 14721 raft_consensus.cc:374] T 2d76489f27034ddba02153ed1476a976 P 28c5fae1e1b44708aa00200ea4fa9153 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:17.839761 14721 raft_consensus.cc:729] T 2d76489f27034ddba02153ed1476a976 P 28c5fae1e1b44708aa00200ea4fa9153 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28c5fae1e1b44708aa00200ea4fa9153, State: Initialized, Role: FOLLOWER
I20260619 18:46:17.840761 14721 consensus_queue.cc:260] T 2d76489f27034ddba02153ed1476a976 P 28c5fae1e1b44708aa00200ea4fa9153 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } }
I20260619 18:46:17.841553 14716 ts_tablet_manager.cc:1428] T 2d76489f27034ddba02153ed1476a976 P de8b7c85ad8346629c2cc75b92ce1841: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260619 18:46:17.844362 14716 tablet_bootstrap.cc:492] T 070eee78223a4ecab3b174225d89ff5a P de8b7c85ad8346629c2cc75b92ce1841: Bootstrap starting.
I20260619 18:46:17.844395 14715 tablet_bootstrap.cc:654] T 2d76489f27034ddba02153ed1476a976 P 2d826400f19d40c6b47f7b328a25981e: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:17.857771 14715 tablet_bootstrap.cc:492] T 2d76489f27034ddba02153ed1476a976 P 2d826400f19d40c6b47f7b328a25981e: No bootstrap required, opened a new log
I20260619 18:46:17.858448 14715 ts_tablet_manager.cc:1397] T 2d76489f27034ddba02153ed1476a976 P 2d826400f19d40c6b47f7b328a25981e: Time spent bootstrapping tablet: real 0.021s user 0.011s sys 0.008s
I20260619 18:46:17.860822 14716 tablet_bootstrap.cc:654] T 070eee78223a4ecab3b174225d89ff5a P de8b7c85ad8346629c2cc75b92ce1841: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:17.861809 14715 raft_consensus.cc:348] T 2d76489f27034ddba02153ed1476a976 P 2d826400f19d40c6b47f7b328a25981e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } }
I20260619 18:46:17.862768 14715 raft_consensus.cc:374] T 2d76489f27034ddba02153ed1476a976 P 2d826400f19d40c6b47f7b328a25981e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:17.863106 14715 raft_consensus.cc:729] T 2d76489f27034ddba02153ed1476a976 P 2d826400f19d40c6b47f7b328a25981e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d826400f19d40c6b47f7b328a25981e, State: Initialized, Role: FOLLOWER
I20260619 18:46:17.864142 14715 consensus_queue.cc:260] T 2d76489f27034ddba02153ed1476a976 P 2d826400f19d40c6b47f7b328a25981e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } }
I20260619 18:46:17.865144 14721 ts_tablet_manager.cc:1428] T 2d76489f27034ddba02153ed1476a976 P 28c5fae1e1b44708aa00200ea4fa9153: Time spent starting tablet: real 0.029s user 0.013s sys 0.012s
I20260619 18:46:17.866338 14721 tablet_bootstrap.cc:492] T 070eee78223a4ecab3b174225d89ff5a P 28c5fae1e1b44708aa00200ea4fa9153: Bootstrap starting.
I20260619 18:46:17.866392 14715 ts_tablet_manager.cc:1428] T 2d76489f27034ddba02153ed1476a976 P 2d826400f19d40c6b47f7b328a25981e: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20260619 18:46:17.882216 14721 tablet_bootstrap.cc:654] T 070eee78223a4ecab3b174225d89ff5a P 28c5fae1e1b44708aa00200ea4fa9153: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:17.884200 14716 tablet_bootstrap.cc:492] T 070eee78223a4ecab3b174225d89ff5a P de8b7c85ad8346629c2cc75b92ce1841: No bootstrap required, opened a new log
I20260619 18:46:17.884866 14716 ts_tablet_manager.cc:1397] T 070eee78223a4ecab3b174225d89ff5a P de8b7c85ad8346629c2cc75b92ce1841: Time spent bootstrapping tablet: real 0.041s user 0.017s sys 0.008s
I20260619 18:46:17.887961 14721 tablet_bootstrap.cc:492] T 070eee78223a4ecab3b174225d89ff5a P 28c5fae1e1b44708aa00200ea4fa9153: No bootstrap required, opened a new log
I20260619 18:46:17.887878 14716 raft_consensus.cc:348] T 070eee78223a4ecab3b174225d89ff5a P de8b7c85ad8346629c2cc75b92ce1841 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } }
I20260619 18:46:17.888702 14721 ts_tablet_manager.cc:1397] T 070eee78223a4ecab3b174225d89ff5a P 28c5fae1e1b44708aa00200ea4fa9153: Time spent bootstrapping tablet: real 0.023s user 0.009s sys 0.013s
I20260619 18:46:17.888845 14716 raft_consensus.cc:374] T 070eee78223a4ecab3b174225d89ff5a P de8b7c85ad8346629c2cc75b92ce1841 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:17.889230 14716 raft_consensus.cc:729] T 070eee78223a4ecab3b174225d89ff5a P de8b7c85ad8346629c2cc75b92ce1841 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de8b7c85ad8346629c2cc75b92ce1841, State: Initialized, Role: FOLLOWER
I20260619 18:46:17.890076 14716 consensus_queue.cc:260] T 070eee78223a4ecab3b174225d89ff5a P de8b7c85ad8346629c2cc75b92ce1841 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } }
I20260619 18:46:17.891746 14721 raft_consensus.cc:348] T 070eee78223a4ecab3b174225d89ff5a P 28c5fae1e1b44708aa00200ea4fa9153 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } }
I20260619 18:46:17.892436 14716 ts_tablet_manager.cc:1428] T 070eee78223a4ecab3b174225d89ff5a P de8b7c85ad8346629c2cc75b92ce1841: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260619 18:46:17.892606 14721 raft_consensus.cc:374] T 070eee78223a4ecab3b174225d89ff5a P 28c5fae1e1b44708aa00200ea4fa9153 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:17.892935 14721 raft_consensus.cc:729] T 070eee78223a4ecab3b174225d89ff5a P 28c5fae1e1b44708aa00200ea4fa9153 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28c5fae1e1b44708aa00200ea4fa9153, State: Initialized, Role: FOLLOWER
I20260619 18:46:17.893679 14721 consensus_queue.cc:260] T 070eee78223a4ecab3b174225d89ff5a P 28c5fae1e1b44708aa00200ea4fa9153 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } }
I20260619 18:46:17.895881 14721 ts_tablet_manager.cc:1428] T 070eee78223a4ecab3b174225d89ff5a P 28c5fae1e1b44708aa00200ea4fa9153: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260619 18:46:17.896960 14721 tablet_bootstrap.cc:492] T 628bd229d0934ecb9d8e23c3450fcb05 P 28c5fae1e1b44708aa00200ea4fa9153: Bootstrap starting.
I20260619 18:46:17.903236 14721 tablet_bootstrap.cc:654] T 628bd229d0934ecb9d8e23c3450fcb05 P 28c5fae1e1b44708aa00200ea4fa9153: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:17.908690 14721 tablet_bootstrap.cc:492] T 628bd229d0934ecb9d8e23c3450fcb05 P 28c5fae1e1b44708aa00200ea4fa9153: No bootstrap required, opened a new log
I20260619 18:46:17.909222 14721 ts_tablet_manager.cc:1397] T 628bd229d0934ecb9d8e23c3450fcb05 P 28c5fae1e1b44708aa00200ea4fa9153: Time spent bootstrapping tablet: real 0.012s user 0.011s sys 0.000s
I20260619 18:46:17.911212 14721 raft_consensus.cc:348] T 628bd229d0934ecb9d8e23c3450fcb05 P 28c5fae1e1b44708aa00200ea4fa9153 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } }
I20260619 18:46:17.911770 14721 raft_consensus.cc:374] T 628bd229d0934ecb9d8e23c3450fcb05 P 28c5fae1e1b44708aa00200ea4fa9153 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:17.912037 14721 raft_consensus.cc:729] T 628bd229d0934ecb9d8e23c3450fcb05 P 28c5fae1e1b44708aa00200ea4fa9153 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28c5fae1e1b44708aa00200ea4fa9153, State: Initialized, Role: FOLLOWER
I20260619 18:46:17.912726 14721 consensus_queue.cc:260] T 628bd229d0934ecb9d8e23c3450fcb05 P 28c5fae1e1b44708aa00200ea4fa9153 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } }
I20260619 18:46:17.914655 14721 ts_tablet_manager.cc:1428] T 628bd229d0934ecb9d8e23c3450fcb05 P 28c5fae1e1b44708aa00200ea4fa9153: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260619 18:46:17.946431 14719 raft_consensus.cc:482] T 2d76489f27034ddba02153ed1476a976 P 2d826400f19d40c6b47f7b328a25981e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 18:46:17.946923 14719 raft_consensus.cc:504] T 2d76489f27034ddba02153ed1476a976 P 2d826400f19d40c6b47f7b328a25981e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } }
I20260619 18:46:17.949414 14719 leader_election.cc:288] T 2d76489f27034ddba02153ed1476a976 P 2d826400f19d40c6b47f7b328a25981e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28c5fae1e1b44708aa00200ea4fa9153 (127.6.120.193:42081), de8b7c85ad8346629c2cc75b92ce1841 (127.6.120.194:38047)
I20260619 18:46:17.967123 14513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d76489f27034ddba02153ed1476a976" candidate_uuid: "2d826400f19d40c6b47f7b328a25981e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28c5fae1e1b44708aa00200ea4fa9153" is_pre_election: true
I20260619 18:46:17.967590 14593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d76489f27034ddba02153ed1476a976" candidate_uuid: "2d826400f19d40c6b47f7b328a25981e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de8b7c85ad8346629c2cc75b92ce1841" is_pre_election: true
I20260619 18:46:17.967993 14513 raft_consensus.cc:2454] T 2d76489f27034ddba02153ed1476a976 P 28c5fae1e1b44708aa00200ea4fa9153 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d826400f19d40c6b47f7b328a25981e in term 0.
I20260619 18:46:17.968508 14593 raft_consensus.cc:2454] T 2d76489f27034ddba02153ed1476a976 P de8b7c85ad8346629c2cc75b92ce1841 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d826400f19d40c6b47f7b328a25981e in term 0.
I20260619 18:46:17.969506 14631 leader_election.cc:302] T 2d76489f27034ddba02153ed1476a976 P 2d826400f19d40c6b47f7b328a25981e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28c5fae1e1b44708aa00200ea4fa9153, 2d826400f19d40c6b47f7b328a25981e; no voters:
I20260619 18:46:17.969682 14720 raft_consensus.cc:482] T 628bd229d0934ecb9d8e23c3450fcb05 P de8b7c85ad8346629c2cc75b92ce1841 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 18:46:17.970454 14719 raft_consensus.cc:2781] T 2d76489f27034ddba02153ed1476a976 P 2d826400f19d40c6b47f7b328a25981e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 18:46:17.971159 14719 raft_consensus.cc:482] T 2d76489f27034ddba02153ed1476a976 P 2d826400f19d40c6b47f7b328a25981e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 18:46:17.971508 14719 raft_consensus.cc:3037] T 2d76489f27034ddba02153ed1476a976 P 2d826400f19d40c6b47f7b328a25981e [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:17.970463 14720 raft_consensus.cc:504] T 628bd229d0934ecb9d8e23c3450fcb05 P de8b7c85ad8346629c2cc75b92ce1841 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } }
I20260619 18:46:17.975054 14720 leader_election.cc:288] T 628bd229d0934ecb9d8e23c3450fcb05 P de8b7c85ad8346629c2cc75b92ce1841 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28c5fae1e1b44708aa00200ea4fa9153 (127.6.120.193:42081), 2d826400f19d40c6b47f7b328a25981e (127.6.120.195:41877)
I20260619 18:46:17.980796 14719 raft_consensus.cc:504] T 2d76489f27034ddba02153ed1476a976 P 2d826400f19d40c6b47f7b328a25981e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } }
I20260619 18:46:17.984961 14593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d76489f27034ddba02153ed1476a976" candidate_uuid: "2d826400f19d40c6b47f7b328a25981e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de8b7c85ad8346629c2cc75b92ce1841"
I20260619 18:46:17.985669 14593 raft_consensus.cc:3037] T 2d76489f27034ddba02153ed1476a976 P de8b7c85ad8346629c2cc75b92ce1841 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:17.985905 14513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d76489f27034ddba02153ed1476a976" candidate_uuid: "2d826400f19d40c6b47f7b328a25981e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28c5fae1e1b44708aa00200ea4fa9153"
I20260619 18:46:17.986568 14513 raft_consensus.cc:3037] T 2d76489f27034ddba02153ed1476a976 P 28c5fae1e1b44708aa00200ea4fa9153 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:17.992288 14733 raft_consensus.cc:482] T 628bd229d0934ecb9d8e23c3450fcb05 P 2d826400f19d40c6b47f7b328a25981e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 18:46:17.991956 14593 raft_consensus.cc:2454] T 2d76489f27034ddba02153ed1476a976 P de8b7c85ad8346629c2cc75b92ce1841 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d826400f19d40c6b47f7b328a25981e in term 1.
I20260619 18:46:17.992993 14733 raft_consensus.cc:504] T 628bd229d0934ecb9d8e23c3450fcb05 P 2d826400f19d40c6b47f7b328a25981e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } }
I20260619 18:46:17.993707 14631 leader_election.cc:302] T 2d76489f27034ddba02153ed1476a976 P 2d826400f19d40c6b47f7b328a25981e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d826400f19d40c6b47f7b328a25981e, de8b7c85ad8346629c2cc75b92ce1841; no voters:
I20260619 18:46:17.995761 14734 raft_consensus.cc:2781] T 2d76489f27034ddba02153ed1476a976 P 2d826400f19d40c6b47f7b328a25981e [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:46:17.995764 14733 leader_election.cc:288] T 628bd229d0934ecb9d8e23c3450fcb05 P 2d826400f19d40c6b47f7b328a25981e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28c5fae1e1b44708aa00200ea4fa9153 (127.6.120.193:42081), de8b7c85ad8346629c2cc75b92ce1841 (127.6.120.194:38047)
I20260619 18:46:17.993480 14513 raft_consensus.cc:2454] T 2d76489f27034ddba02153ed1476a976 P 28c5fae1e1b44708aa00200ea4fa9153 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d826400f19d40c6b47f7b328a25981e in term 1.
I20260619 18:46:17.997273 14592 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "628bd229d0934ecb9d8e23c3450fcb05" candidate_uuid: "2d826400f19d40c6b47f7b328a25981e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de8b7c85ad8346629c2cc75b92ce1841" is_pre_election: true
I20260619 18:46:17.998373 14592 raft_consensus.cc:2454] T 628bd229d0934ecb9d8e23c3450fcb05 P de8b7c85ad8346629c2cc75b92ce1841 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d826400f19d40c6b47f7b328a25981e in term 0.
I20260619 18:46:18.002110 14631 leader_election.cc:302] T 628bd229d0934ecb9d8e23c3450fcb05 P 2d826400f19d40c6b47f7b328a25981e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d826400f19d40c6b47f7b328a25981e, de8b7c85ad8346629c2cc75b92ce1841; no voters:
I20260619 18:46:18.003858 14719 leader_election.cc:288] T 2d76489f27034ddba02153ed1476a976 P 2d826400f19d40c6b47f7b328a25981e [CANDIDATE]: Term 1 election: Requested vote from peers 28c5fae1e1b44708aa00200ea4fa9153 (127.6.120.193:42081), de8b7c85ad8346629c2cc75b92ce1841 (127.6.120.194:38047)
I20260619 18:46:18.005187 14719 raft_consensus.cc:2781] T 628bd229d0934ecb9d8e23c3450fcb05 P 2d826400f19d40c6b47f7b328a25981e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 18:46:18.007618 14719 raft_consensus.cc:482] T 628bd229d0934ecb9d8e23c3450fcb05 P 2d826400f19d40c6b47f7b328a25981e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 18:46:18.008133 14719 raft_consensus.cc:3037] T 628bd229d0934ecb9d8e23c3450fcb05 P 2d826400f19d40c6b47f7b328a25981e [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:18.016369 14734 raft_consensus.cc:686] T 2d76489f27034ddba02153ed1476a976 P 2d826400f19d40c6b47f7b328a25981e [term 1 LEADER]: Becoming Leader. State: Replica: 2d826400f19d40c6b47f7b328a25981e, State: Running, Role: LEADER
I20260619 18:46:18.017810 14719 raft_consensus.cc:504] T 628bd229d0934ecb9d8e23c3450fcb05 P 2d826400f19d40c6b47f7b328a25981e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } }
I20260619 18:46:18.017516 14734 consensus_queue.cc:237] T 2d76489f27034ddba02153ed1476a976 P 2d826400f19d40c6b47f7b328a25981e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } }
I20260619 18:46:18.006546 14513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "628bd229d0934ecb9d8e23c3450fcb05" candidate_uuid: "2d826400f19d40c6b47f7b328a25981e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28c5fae1e1b44708aa00200ea4fa9153" is_pre_election: true
I20260619 18:46:18.020844 14513 raft_consensus.cc:2454] T 628bd229d0934ecb9d8e23c3450fcb05 P 28c5fae1e1b44708aa00200ea4fa9153 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d826400f19d40c6b47f7b328a25981e in term 0.
I20260619 18:46:18.020722 14512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "628bd229d0934ecb9d8e23c3450fcb05" candidate_uuid: "de8b7c85ad8346629c2cc75b92ce1841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28c5fae1e1b44708aa00200ea4fa9153" is_pre_election: true
I20260619 18:46:18.023353 14512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "628bd229d0934ecb9d8e23c3450fcb05" candidate_uuid: "2d826400f19d40c6b47f7b328a25981e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28c5fae1e1b44708aa00200ea4fa9153"
I20260619 18:46:18.026281 14593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "628bd229d0934ecb9d8e23c3450fcb05" candidate_uuid: "2d826400f19d40c6b47f7b328a25981e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de8b7c85ad8346629c2cc75b92ce1841"
I20260619 18:46:18.027243 14593 raft_consensus.cc:3037] T 628bd229d0934ecb9d8e23c3450fcb05 P de8b7c85ad8346629c2cc75b92ce1841 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:18.019918 14719 leader_election.cc:288] T 628bd229d0934ecb9d8e23c3450fcb05 P 2d826400f19d40c6b47f7b328a25981e [CANDIDATE]: Term 1 election: Requested vote from peers 28c5fae1e1b44708aa00200ea4fa9153 (127.6.120.193:42081), de8b7c85ad8346629c2cc75b92ce1841 (127.6.120.194:38047)
I20260619 18:46:18.031086 14673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "628bd229d0934ecb9d8e23c3450fcb05" candidate_uuid: "de8b7c85ad8346629c2cc75b92ce1841" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d826400f19d40c6b47f7b328a25981e" is_pre_election: true
I20260619 18:46:18.032056 14673 raft_consensus.cc:2379] T 628bd229d0934ecb9d8e23c3450fcb05 P 2d826400f19d40c6b47f7b328a25981e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate de8b7c85ad8346629c2cc75b92ce1841 in current term 1: Already voted for candidate 2d826400f19d40c6b47f7b328a25981e in this term.
I20260619 18:46:18.034283 14549 leader_election.cc:302] T 628bd229d0934ecb9d8e23c3450fcb05 P de8b7c85ad8346629c2cc75b92ce1841 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: de8b7c85ad8346629c2cc75b92ce1841; no voters: 28c5fae1e1b44708aa00200ea4fa9153, 2d826400f19d40c6b47f7b328a25981e
I20260619 18:46:18.036667 14593 raft_consensus.cc:2454] T 628bd229d0934ecb9d8e23c3450fcb05 P de8b7c85ad8346629c2cc75b92ce1841 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d826400f19d40c6b47f7b328a25981e in term 1.
I20260619 18:46:18.037222 14720 raft_consensus.cc:2726] T 628bd229d0934ecb9d8e23c3450fcb05 P de8b7c85ad8346629c2cc75b92ce1841 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 18:46:18.041136 14390 catalog_manager.cc:5495] T 2d76489f27034ddba02153ed1476a976 P 2d826400f19d40c6b47f7b328a25981e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d826400f19d40c6b47f7b328a25981e (127.6.120.195). New cstate: current_term: 1 leader_uuid: "2d826400f19d40c6b47f7b328a25981e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } health_report { overall_health: HEALTHY } } }
I20260619 18:46:18.043874 14631 leader_election.cc:302] T 628bd229d0934ecb9d8e23c3450fcb05 P 2d826400f19d40c6b47f7b328a25981e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2d826400f19d40c6b47f7b328a25981e, de8b7c85ad8346629c2cc75b92ce1841; no voters: 28c5fae1e1b44708aa00200ea4fa9153
I20260619 18:46:18.044761 14734 raft_consensus.cc:2781] T 628bd229d0934ecb9d8e23c3450fcb05 P 2d826400f19d40c6b47f7b328a25981e [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:46:18.045298 14734 raft_consensus.cc:686] T 628bd229d0934ecb9d8e23c3450fcb05 P 2d826400f19d40c6b47f7b328a25981e [term 1 LEADER]: Becoming Leader. State: Replica: 2d826400f19d40c6b47f7b328a25981e, State: Running, Role: LEADER
I20260619 18:46:18.046094 14734 consensus_queue.cc:237] T 628bd229d0934ecb9d8e23c3450fcb05 P 2d826400f19d40c6b47f7b328a25981e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } }
I20260619 18:46:18.055269 14391 catalog_manager.cc:5495] T 628bd229d0934ecb9d8e23c3450fcb05 P 2d826400f19d40c6b47f7b328a25981e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d826400f19d40c6b47f7b328a25981e (127.6.120.195). New cstate: current_term: 1 leader_uuid: "2d826400f19d40c6b47f7b328a25981e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } health_report { overall_health: HEALTHY } } }
I20260619 18:46:18.081369 14725 raft_consensus.cc:482] T 070eee78223a4ecab3b174225d89ff5a P 28c5fae1e1b44708aa00200ea4fa9153 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 18:46:18.082000 14725 raft_consensus.cc:504] T 070eee78223a4ecab3b174225d89ff5a P 28c5fae1e1b44708aa00200ea4fa9153 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } }
I20260619 18:46:18.085639 14725 leader_election.cc:288] T 070eee78223a4ecab3b174225d89ff5a P 28c5fae1e1b44708aa00200ea4fa9153 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers de8b7c85ad8346629c2cc75b92ce1841 (127.6.120.194:38047), 2d826400f19d40c6b47f7b328a25981e (127.6.120.195:41877)
I20260619 18:46:18.089493 14734 raft_consensus.cc:482] T 070eee78223a4ecab3b174225d89ff5a P 2d826400f19d40c6b47f7b328a25981e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 18:46:18.090274 14734 raft_consensus.cc:504] T 070eee78223a4ecab3b174225d89ff5a P 2d826400f19d40c6b47f7b328a25981e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } }
I20260619 18:46:18.092449 14734 leader_election.cc:288] T 070eee78223a4ecab3b174225d89ff5a P 2d826400f19d40c6b47f7b328a25981e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 28c5fae1e1b44708aa00200ea4fa9153 (127.6.120.193:42081), de8b7c85ad8346629c2cc75b92ce1841 (127.6.120.194:38047)
I20260619 18:46:18.093640 14513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "070eee78223a4ecab3b174225d89ff5a" candidate_uuid: "2d826400f19d40c6b47f7b328a25981e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28c5fae1e1b44708aa00200ea4fa9153" is_pre_election: true
I20260619 18:46:18.094446 14513 raft_consensus.cc:2454] T 070eee78223a4ecab3b174225d89ff5a P 28c5fae1e1b44708aa00200ea4fa9153 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d826400f19d40c6b47f7b328a25981e in term 0.
I20260619 18:46:18.096032 14593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "070eee78223a4ecab3b174225d89ff5a" candidate_uuid: "2d826400f19d40c6b47f7b328a25981e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de8b7c85ad8346629c2cc75b92ce1841" is_pre_election: true
I20260619 18:46:18.096863 14593 raft_consensus.cc:2454] T 070eee78223a4ecab3b174225d89ff5a P de8b7c85ad8346629c2cc75b92ce1841 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2d826400f19d40c6b47f7b328a25981e in term 0.
I20260619 18:46:18.099371 14631 leader_election.cc:302] T 070eee78223a4ecab3b174225d89ff5a P 2d826400f19d40c6b47f7b328a25981e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d826400f19d40c6b47f7b328a25981e, de8b7c85ad8346629c2cc75b92ce1841; no voters:
I20260619 18:46:18.100265 14734 raft_consensus.cc:2781] T 070eee78223a4ecab3b174225d89ff5a P 2d826400f19d40c6b47f7b328a25981e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 18:46:18.100735 14734 raft_consensus.cc:482] T 070eee78223a4ecab3b174225d89ff5a P 2d826400f19d40c6b47f7b328a25981e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 18:46:18.101167 14734 raft_consensus.cc:3037] T 070eee78223a4ecab3b174225d89ff5a P 2d826400f19d40c6b47f7b328a25981e [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:18.107878 14593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "070eee78223a4ecab3b174225d89ff5a" candidate_uuid: "28c5fae1e1b44708aa00200ea4fa9153" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de8b7c85ad8346629c2cc75b92ce1841" is_pre_election: true
I20260619 18:46:18.108251 14734 raft_consensus.cc:504] T 070eee78223a4ecab3b174225d89ff5a P 2d826400f19d40c6b47f7b328a25981e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } }
I20260619 18:46:18.110064 14673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "070eee78223a4ecab3b174225d89ff5a" candidate_uuid: "28c5fae1e1b44708aa00200ea4fa9153" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d826400f19d40c6b47f7b328a25981e" is_pre_election: true
I20260619 18:46:18.110975 14673 raft_consensus.cc:2379] T 070eee78223a4ecab3b174225d89ff5a P 2d826400f19d40c6b47f7b328a25981e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 28c5fae1e1b44708aa00200ea4fa9153 in current term 1: Already voted for candidate 2d826400f19d40c6b47f7b328a25981e in this term.
I20260619 18:46:18.111449 14734 leader_election.cc:288] T 070eee78223a4ecab3b174225d89ff5a P 2d826400f19d40c6b47f7b328a25981e [CANDIDATE]: Term 1 election: Requested vote from peers 28c5fae1e1b44708aa00200ea4fa9153 (127.6.120.193:42081), de8b7c85ad8346629c2cc75b92ce1841 (127.6.120.194:38047)
I20260619 18:46:18.108744 14593 raft_consensus.cc:2454] T 070eee78223a4ecab3b174225d89ff5a P de8b7c85ad8346629c2cc75b92ce1841 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 28c5fae1e1b44708aa00200ea4fa9153 in term 0.
I20260619 18:46:18.113611 14470 leader_election.cc:302] T 070eee78223a4ecab3b174225d89ff5a P 28c5fae1e1b44708aa00200ea4fa9153 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 28c5fae1e1b44708aa00200ea4fa9153, de8b7c85ad8346629c2cc75b92ce1841; no voters:
I20260619 18:46:18.114485 14725 raft_consensus.cc:2781] T 070eee78223a4ecab3b174225d89ff5a P 28c5fae1e1b44708aa00200ea4fa9153 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 18:46:18.114842 14725 raft_consensus.cc:482] T 070eee78223a4ecab3b174225d89ff5a P 28c5fae1e1b44708aa00200ea4fa9153 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 18:46:18.115181 14725 raft_consensus.cc:3037] T 070eee78223a4ecab3b174225d89ff5a P 28c5fae1e1b44708aa00200ea4fa9153 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:18.115792 14513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "070eee78223a4ecab3b174225d89ff5a" candidate_uuid: "2d826400f19d40c6b47f7b328a25981e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "28c5fae1e1b44708aa00200ea4fa9153"
I20260619 18:46:18.116382 14593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "070eee78223a4ecab3b174225d89ff5a" candidate_uuid: "2d826400f19d40c6b47f7b328a25981e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de8b7c85ad8346629c2cc75b92ce1841"
I20260619 18:46:18.116966 14593 raft_consensus.cc:3037] T 070eee78223a4ecab3b174225d89ff5a P de8b7c85ad8346629c2cc75b92ce1841 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:18.121086 14725 raft_consensus.cc:504] T 070eee78223a4ecab3b174225d89ff5a P 28c5fae1e1b44708aa00200ea4fa9153 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } }
I20260619 18:46:18.122248 14593 raft_consensus.cc:2454] T 070eee78223a4ecab3b174225d89ff5a P de8b7c85ad8346629c2cc75b92ce1841 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2d826400f19d40c6b47f7b328a25981e in term 1.
I20260619 18:46:18.122709 14513 raft_consensus.cc:2379] T 070eee78223a4ecab3b174225d89ff5a P 28c5fae1e1b44708aa00200ea4fa9153 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2d826400f19d40c6b47f7b328a25981e in current term 1: Already voted for candidate 28c5fae1e1b44708aa00200ea4fa9153 in this term.
I20260619 18:46:18.123544 14631 leader_election.cc:302] T 070eee78223a4ecab3b174225d89ff5a P 2d826400f19d40c6b47f7b328a25981e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d826400f19d40c6b47f7b328a25981e, de8b7c85ad8346629c2cc75b92ce1841; no voters:
I20260619 18:46:18.125101 14734 raft_consensus.cc:2781] T 070eee78223a4ecab3b174225d89ff5a P 2d826400f19d40c6b47f7b328a25981e [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:46:18.125749 14734 raft_consensus.cc:686] T 070eee78223a4ecab3b174225d89ff5a P 2d826400f19d40c6b47f7b328a25981e [term 1 LEADER]: Becoming Leader. State: Replica: 2d826400f19d40c6b47f7b328a25981e, State: Running, Role: LEADER
I20260619 18:46:18.124943 14593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "070eee78223a4ecab3b174225d89ff5a" candidate_uuid: "28c5fae1e1b44708aa00200ea4fa9153" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de8b7c85ad8346629c2cc75b92ce1841"
I20260619 18:46:18.127188 14725 leader_election.cc:288] T 070eee78223a4ecab3b174225d89ff5a P 28c5fae1e1b44708aa00200ea4fa9153 [CANDIDATE]: Term 1 election: Requested vote from peers de8b7c85ad8346629c2cc75b92ce1841 (127.6.120.194:38047), 2d826400f19d40c6b47f7b328a25981e (127.6.120.195:41877)
I20260619 18:46:18.127377 14593 raft_consensus.cc:2379] T 070eee78223a4ecab3b174225d89ff5a P de8b7c85ad8346629c2cc75b92ce1841 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 28c5fae1e1b44708aa00200ea4fa9153 in current term 1: Already voted for candidate 2d826400f19d40c6b47f7b328a25981e in this term.
I20260619 18:46:18.128690 14673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "070eee78223a4ecab3b174225d89ff5a" candidate_uuid: "28c5fae1e1b44708aa00200ea4fa9153" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d826400f19d40c6b47f7b328a25981e"
I20260619 18:46:18.126634 14734 consensus_queue.cc:237] T 070eee78223a4ecab3b174225d89ff5a P 2d826400f19d40c6b47f7b328a25981e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } }
I20260619 18:46:18.130339 14468 leader_election.cc:302] T 070eee78223a4ecab3b174225d89ff5a P 28c5fae1e1b44708aa00200ea4fa9153 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 28c5fae1e1b44708aa00200ea4fa9153; no voters: 2d826400f19d40c6b47f7b328a25981e, de8b7c85ad8346629c2cc75b92ce1841
I20260619 18:46:18.131198 14725 raft_consensus.cc:2726] T 070eee78223a4ecab3b174225d89ff5a P 28c5fae1e1b44708aa00200ea4fa9153 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260619 18:46:18.136371 14391 catalog_manager.cc:5495] T 070eee78223a4ecab3b174225d89ff5a P 2d826400f19d40c6b47f7b328a25981e reported cstate change: term changed from 0 to 1, leader changed from <none> to 2d826400f19d40c6b47f7b328a25981e (127.6.120.195). New cstate: current_term: 1 leader_uuid: "2d826400f19d40c6b47f7b328a25981e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2d826400f19d40c6b47f7b328a25981e" member_type: VOTER last_known_addr { host: "127.6.120.195" port: 41877 } health_report { overall_health: HEALTHY } } }
I20260619 18:46:18.428244 14734 consensus_queue.cc:1035] T 2d76489f27034ddba02153ed1476a976 P 2d826400f19d40c6b47f7b328a25981e [LEADER]: Connected to new peer: Peer: permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 18:46:18.443691 14734 consensus_queue.cc:1035] T 2d76489f27034ddba02153ed1476a976 P 2d826400f19d40c6b47f7b328a25981e [LEADER]: Connected to new peer: Peer: permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 18:46:18.470450 14513 raft_consensus.cc:3037] T 628bd229d0934ecb9d8e23c3450fcb05 P 28c5fae1e1b44708aa00200ea4fa9153 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:18.477871 14734 consensus_queue.cc:1035] T 628bd229d0934ecb9d8e23c3450fcb05 P 2d826400f19d40c6b47f7b328a25981e [LEADER]: Connected to new peer: Peer: permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260619 18:46:18.492417 14733 consensus_queue.cc:1035] T 628bd229d0934ecb9d8e23c3450fcb05 P 2d826400f19d40c6b47f7b328a25981e [LEADER]: Connected to new peer: Peer: permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260619 18:46:18.613960 14719 consensus_queue.cc:1035] T 070eee78223a4ecab3b174225d89ff5a P 2d826400f19d40c6b47f7b328a25981e [LEADER]: Connected to new peer: Peer: permanent_uuid: "de8b7c85ad8346629c2cc75b92ce1841" member_type: VOTER last_known_addr { host: "127.6.120.194" port: 38047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260619 18:46:18.631230 14735 consensus_queue.cc:1035] T 070eee78223a4ecab3b174225d89ff5a P 2d826400f19d40c6b47f7b328a25981e [LEADER]: Connected to new peer: Peer: permanent_uuid: "28c5fae1e1b44708aa00200ea4fa9153" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 42081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 18:46:19.319114 14748 log.cc:924] Time spent T 070eee78223a4ecab3b174225d89ff5a P de8b7c85ad8346629c2cc75b92ce1841: Append to log took a long time: real 0.069s user 0.013s sys 0.000s
W20260619 18:46:19.335784 14736 log.cc:924] Time spent T 2d76489f27034ddba02153ed1476a976 P 2d826400f19d40c6b47f7b328a25981e: Append to log took a long time: real 0.062s user 0.009s sys 0.004s
W20260619 18:46:19.368412 14747 log.cc:924] Time spent T 628bd229d0934ecb9d8e23c3450fcb05 P de8b7c85ad8346629c2cc75b92ce1841: Append to log took a long time: real 0.122s user 0.014s sys 0.000s
W20260619 18:46:19.370432 14741 log.cc:924] Time spent T 2d76489f27034ddba02153ed1476a976 P de8b7c85ad8346629c2cc75b92ce1841: Append to log took a long time: real 0.063s user 0.010s sys 0.002s
W20260619 18:46:19.850211 14701 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.6.120.195:41877, user_credentials={real_user=slave}} blocked reactor thread for 105007us
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/client-test.cc:3032: Skipped
test is skipped; set KUDU_ALLOW_SLOW_TESTS=1 to run
I20260619 18:46:19.903463 6627 tablet_server.cc:178] TabletServer@127.6.120.193:0 shutting down...
W20260619 18:46:20.001653 14701 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.Write -> {remote=127.6.120.195:41877, user_credentials={real_user=slave}} blocked reactor thread for 111518us
W20260619 18:46:20.010041 14631 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260619 18:46:20.054359 14631 consensus_peers.cc:487] T 2d76489f27034ddba02153ed1476a976 P 2d826400f19d40c6b47f7b328a25981e -> Peer 28c5fae1e1b44708aa00200ea4fa9153 (127.6.120.193:42081): Couldn't send request to peer 28c5fae1e1b44708aa00200ea4fa9153. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260619 18:46:20.066738 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:46:20.068145 6627 tablet_replica.cc:330] T 628bd229d0934ecb9d8e23c3450fcb05 P 28c5fae1e1b44708aa00200ea4fa9153: stopping tablet replica
I20260619 18:46:20.069036 6627 raft_consensus.cc:2229] T 628bd229d0934ecb9d8e23c3450fcb05 P 28c5fae1e1b44708aa00200ea4fa9153 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 18:46:20.070322 6627 raft_consensus.cc:2258] T 628bd229d0934ecb9d8e23c3450fcb05 P 28c5fae1e1b44708aa00200ea4fa9153 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:20.076141 6627 tablet_replica.cc:330] T 070eee78223a4ecab3b174225d89ff5a P 28c5fae1e1b44708aa00200ea4fa9153: stopping tablet replica
I20260619 18:46:20.082497 6627 raft_consensus.cc:2229] T 070eee78223a4ecab3b174225d89ff5a P 28c5fae1e1b44708aa00200ea4fa9153 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 18:46:20.083441 6627 raft_consensus.cc:2258] T 070eee78223a4ecab3b174225d89ff5a P 28c5fae1e1b44708aa00200ea4fa9153 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:20.104511 6627 tablet_replica.cc:330] T 2d76489f27034ddba02153ed1476a976 P 28c5fae1e1b44708aa00200ea4fa9153: stopping tablet replica
I20260619 18:46:20.105427 6627 raft_consensus.cc:2229] T 2d76489f27034ddba02153ed1476a976 P 28c5fae1e1b44708aa00200ea4fa9153 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 18:46:20.106061 6627 raft_consensus.cc:2258] T 2d76489f27034ddba02153ed1476a976 P 28c5fae1e1b44708aa00200ea4fa9153 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:20.190627 6627 tablet_server.cc:194] TabletServer@127.6.120.193:0 shutdown complete.
I20260619 18:46:20.212877 6627 tablet_server.cc:178] TabletServer@127.6.120.194:0 shutting down...
I20260619 18:46:20.253214 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:46:20.253988 6627 tablet_replica.cc:330] T 070eee78223a4ecab3b174225d89ff5a P de8b7c85ad8346629c2cc75b92ce1841: stopping tablet replica
I20260619 18:46:20.254699 6627 raft_consensus.cc:2229] T 070eee78223a4ecab3b174225d89ff5a P de8b7c85ad8346629c2cc75b92ce1841 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 18:46:20.255216 6627 raft_consensus.cc:2258] T 070eee78223a4ecab3b174225d89ff5a P de8b7c85ad8346629c2cc75b92ce1841 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:20.258854 6627 tablet_replica.cc:330] T 2d76489f27034ddba02153ed1476a976 P de8b7c85ad8346629c2cc75b92ce1841: stopping tablet replica
I20260619 18:46:20.259413 6627 raft_consensus.cc:2229] T 2d76489f27034ddba02153ed1476a976 P de8b7c85ad8346629c2cc75b92ce1841 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 18:46:20.259873 6627 raft_consensus.cc:2258] T 2d76489f27034ddba02153ed1476a976 P de8b7c85ad8346629c2cc75b92ce1841 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:20.263321 6627 tablet_replica.cc:330] T 628bd229d0934ecb9d8e23c3450fcb05 P de8b7c85ad8346629c2cc75b92ce1841: stopping tablet replica
I20260619 18:46:20.263954 6627 raft_consensus.cc:2229] T 628bd229d0934ecb9d8e23c3450fcb05 P de8b7c85ad8346629c2cc75b92ce1841 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 18:46:20.264550 6627 raft_consensus.cc:2258] T 628bd229d0934ecb9d8e23c3450fcb05 P de8b7c85ad8346629c2cc75b92ce1841 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:20.289168 6627 tablet_server.cc:194] TabletServer@127.6.120.194:0 shutdown complete.
I20260619 18:46:20.305116 6627 tablet_server.cc:178] TabletServer@127.6.120.195:0 shutting down...
W20260619 18:46:20.308804 14631 consensus_peers.cc:487] T 628bd229d0934ecb9d8e23c3450fcb05 P 2d826400f19d40c6b47f7b328a25981e -> Peer 28c5fae1e1b44708aa00200ea4fa9153 (127.6.120.193:42081): Couldn't send request to peer 28c5fae1e1b44708aa00200ea4fa9153. Status: Network error: Client connection negotiation failed: client connection to 127.6.120.193:42081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260619 18:46:20.329486 14631 consensus_peers.cc:487] T 2d76489f27034ddba02153ed1476a976 P 2d826400f19d40c6b47f7b328a25981e -> Peer de8b7c85ad8346629c2cc75b92ce1841 (127.6.120.194:38047): Couldn't send request to peer de8b7c85ad8346629c2cc75b92ce1841. Status: Network error: Client connection negotiation failed: client connection to 127.6.120.194:38047: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260619 18:46:20.337862 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:46:20.338593 6627 tablet_replica.cc:330] T 2d76489f27034ddba02153ed1476a976 P 2d826400f19d40c6b47f7b328a25981e: stopping tablet replica
I20260619 18:46:20.339278 6627 raft_consensus.cc:2229] T 2d76489f27034ddba02153ed1476a976 P 2d826400f19d40c6b47f7b328a25981e [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:20.340346 6627 raft_consensus.cc:2258] T 2d76489f27034ddba02153ed1476a976 P 2d826400f19d40c6b47f7b328a25981e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:20.344312 6627 tablet_replica.cc:330] T 070eee78223a4ecab3b174225d89ff5a P 2d826400f19d40c6b47f7b328a25981e: stopping tablet replica
W20260619 18:46:20.344328 14631 consensus_peers.cc:487] T 070eee78223a4ecab3b174225d89ff5a P 2d826400f19d40c6b47f7b328a25981e -> Peer 28c5fae1e1b44708aa00200ea4fa9153 (127.6.120.193:42081): Couldn't send request to peer 28c5fae1e1b44708aa00200ea4fa9153. Status: Network error: Client connection negotiation failed: client connection to 127.6.120.193:42081: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260619 18:46:20.345101 6627 raft_consensus.cc:2229] T 070eee78223a4ecab3b174225d89ff5a P 2d826400f19d40c6b47f7b328a25981e [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:20.346004 6627 raft_consensus.cc:2258] T 070eee78223a4ecab3b174225d89ff5a P 2d826400f19d40c6b47f7b328a25981e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:20.349612 6627 tablet_replica.cc:330] T 628bd229d0934ecb9d8e23c3450fcb05 P 2d826400f19d40c6b47f7b328a25981e: stopping tablet replica
I20260619 18:46:20.350140 6627 raft_consensus.cc:2229] T 628bd229d0934ecb9d8e23c3450fcb05 P 2d826400f19d40c6b47f7b328a25981e [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:20.351028 6627 raft_consensus.cc:2258] T 628bd229d0934ecb9d8e23c3450fcb05 P 2d826400f19d40c6b47f7b328a25981e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:20.374603 6627 tablet_server.cc:194] TabletServer@127.6.120.195:0 shutdown complete.
I20260619 18:46:20.389657 6627 master.cc:537] Master@127.6.120.254:36689 shutting down...
I20260619 18:46:20.411151 6627 raft_consensus.cc:2229] T 00000000000000000000000000000000 P bb3eb09a89d34f6289e015f02351f14e [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:20.411684 6627 raft_consensus.cc:2258] T 00000000000000000000000000000000 P bb3eb09a89d34f6289e015f02351f14e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:20.411936 6627 tablet_replica.cc:330] T 00000000000000000000000000000000 P bb3eb09a89d34f6289e015f02351f14e: stopping tablet replica
I20260619 18:46:20.431248 6627 master.cc:552] Master@127.6.120.254:36689 shutdown complete.
[ SKIPPED ] KeepAlivePeriodically/KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers/1 (4174 ms)
[----------] 1 test from KeepAlivePeriodically/KeepAlivePeriodicallyTest (4175 ms total)
[----------] 1 test from Params/LatestObservedTimestampParamTest
[ RUN ] Params/LatestObservedTimestampParamTest.Test/1
I20260619 18:46:20.462543 6627 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.120.254:41725
I20260619 18:46:20.463527 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:46:20.468868 14772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:20.469012 14773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:20.471740 14775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:46:20.472465 6627 server_base.cc:1034] running on GCE node
I20260619 18:46:20.473284 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:46:20.473496 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:46:20.473649 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894780473635 us; error 0 us; skew 500 ppm
I20260619 18:46:20.474150 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:46:20.480324 6627 webserver.cc:460] Webserver started at http://127.6.120.254:34931/ using document root <none> and password file <none>
I20260619 18:46:20.480826 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:46:20.481035 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:46:20.481302 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:46:20.482368 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.Params_LatestObservedTimestampParamTest.Test_1.1781894682485826-6627-0/minicluster-data/master-0-root/instance:
uuid: "5370750215954ad8ad45e64d58286f07"
format_stamp: "Formatted at 2026-06-19 18:46:20 on dist-test-slave-90mn"
I20260619 18:46:20.486666 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260619 18:46:20.490183 14780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:20.491160 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260619 18:46:20.491439 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.Params_LatestObservedTimestampParamTest.Test_1.1781894682485826-6627-0/minicluster-data/master-0-root
uuid: "5370750215954ad8ad45e64d58286f07"
format_stamp: "Formatted at 2026-06-19 18:46:20 on dist-test-slave-90mn"
I20260619 18:46:20.491722 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.Params_LatestObservedTimestampParamTest.Test_1.1781894682485826-6627-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.Params_LatestObservedTimestampParamTest.Test_1.1781894682485826-6627-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.Params_LatestObservedTimestampParamTest.Test_1.1781894682485826-6627-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:46:20.513944 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:46:20.514966 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:46:20.555236 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.254:41725
I20260619 18:46:20.555332 14841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.254:41725 every 8 connection(s)
I20260619 18:46:20.559432 14842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:20.571050 14842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5370750215954ad8ad45e64d58286f07: Bootstrap starting.
I20260619 18:46:20.575914 14842 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5370750215954ad8ad45e64d58286f07: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:20.580317 14842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5370750215954ad8ad45e64d58286f07: No bootstrap required, opened a new log
I20260619 18:46:20.582392 14842 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5370750215954ad8ad45e64d58286f07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5370750215954ad8ad45e64d58286f07" member_type: VOTER }
I20260619 18:46:20.582820 14842 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5370750215954ad8ad45e64d58286f07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:20.583094 14842 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5370750215954ad8ad45e64d58286f07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5370750215954ad8ad45e64d58286f07, State: Initialized, Role: FOLLOWER
I20260619 18:46:20.583710 14842 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5370750215954ad8ad45e64d58286f07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5370750215954ad8ad45e64d58286f07" member_type: VOTER }
I20260619 18:46:20.584184 14842 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5370750215954ad8ad45e64d58286f07 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:46:20.584403 14842 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5370750215954ad8ad45e64d58286f07 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:46:20.584672 14842 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5370750215954ad8ad45e64d58286f07 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:20.589140 14842 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5370750215954ad8ad45e64d58286f07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5370750215954ad8ad45e64d58286f07" member_type: VOTER }
I20260619 18:46:20.589677 14842 leader_election.cc:302] T 00000000000000000000000000000000 P 5370750215954ad8ad45e64d58286f07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5370750215954ad8ad45e64d58286f07; no voters:
I20260619 18:46:20.590822 14842 leader_election.cc:288] T 00000000000000000000000000000000 P 5370750215954ad8ad45e64d58286f07 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:46:20.591225 14845 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5370750215954ad8ad45e64d58286f07 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:46:20.592693 14845 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5370750215954ad8ad45e64d58286f07 [term 1 LEADER]: Becoming Leader. State: Replica: 5370750215954ad8ad45e64d58286f07, State: Running, Role: LEADER
I20260619 18:46:20.593451 14845 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5370750215954ad8ad45e64d58286f07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5370750215954ad8ad45e64d58286f07" member_type: VOTER }
I20260619 18:46:20.593916 14842 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5370750215954ad8ad45e64d58286f07 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 18:46:20.598584 14847 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5370750215954ad8ad45e64d58286f07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5370750215954ad8ad45e64d58286f07. Latest consensus state: current_term: 1 leader_uuid: "5370750215954ad8ad45e64d58286f07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5370750215954ad8ad45e64d58286f07" member_type: VOTER } }
I20260619 18:46:20.598765 14846 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5370750215954ad8ad45e64d58286f07 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5370750215954ad8ad45e64d58286f07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5370750215954ad8ad45e64d58286f07" member_type: VOTER } }
I20260619 18:46:20.599795 14847 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5370750215954ad8ad45e64d58286f07 [sys.catalog]: This master's current role is: LEADER
I20260619 18:46:20.599872 14846 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5370750215954ad8ad45e64d58286f07 [sys.catalog]: This master's current role is: LEADER
I20260619 18:46:20.602841 14852 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 18:46:20.607496 14852 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 18:46:20.611410 6627 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260619 18:46:20.616670 14852 catalog_manager.cc:1347] Generated new cluster ID: dab510dceb49444db540e670040e0044
I20260619 18:46:20.616990 14852 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 18:46:20.635375 14852 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 18:46:20.637419 14852 catalog_manager.cc:1504] Loading token signing keys...
I20260619 18:46:20.649703 14852 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5370750215954ad8ad45e64d58286f07: Generated new TSK 0
I20260619 18:46:20.650519 14852 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 18:46:20.678570 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:46:20.684804 14863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:20.686018 14864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:20.687721 14866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:46:20.688789 6627 server_base.cc:1034] running on GCE node
I20260619 18:46:20.689713 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:46:20.689922 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:46:20.690125 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894780690078 us; error 0 us; skew 500 ppm
I20260619 18:46:20.690685 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:46:20.693339 6627 webserver.cc:460] Webserver started at http://127.6.120.193:40521/ using document root <none> and password file <none>
I20260619 18:46:20.693802 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:46:20.693992 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:46:20.694291 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:46:20.695508 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.Params_LatestObservedTimestampParamTest.Test_1.1781894682485826-6627-0/minicluster-data/ts-0-root/instance:
uuid: "1e7d2973b3e147dc899334d2142310e9"
format_stamp: "Formatted at 2026-06-19 18:46:20 on dist-test-slave-90mn"
I20260619 18:46:20.699996 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260619 18:46:20.703590 14871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:20.704553 6627 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 18:46:20.704952 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.Params_LatestObservedTimestampParamTest.Test_1.1781894682485826-6627-0/minicluster-data/ts-0-root
uuid: "1e7d2973b3e147dc899334d2142310e9"
format_stamp: "Formatted at 2026-06-19 18:46:20 on dist-test-slave-90mn"
I20260619 18:46:20.705261 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.Params_LatestObservedTimestampParamTest.Test_1.1781894682485826-6627-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.Params_LatestObservedTimestampParamTest.Test_1.1781894682485826-6627-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.Params_LatestObservedTimestampParamTest.Test_1.1781894682485826-6627-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:46:20.733613 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:46:20.734766 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:46:20.739737 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:46:20.740247 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.001s user 0.001s sys 0.000s
I20260619 18:46:20.740664 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:46:20.740931 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:20.792785 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.193:33141
I20260619 18:46:20.792958 14941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.193:33141 every 8 connection(s)
I20260619 18:46:20.797904 14942 heartbeater.cc:347] Connected to a master server at 127.6.120.254:41725
I20260619 18:46:20.798408 14942 heartbeater.cc:464] Registering TS with master...
I20260619 18:46:20.799335 14942 heartbeater.cc:511] Master 127.6.120.254:41725 requested a full tablet report, sending...
I20260619 18:46:20.801614 14797 ts_manager.cc:194] Registered new tserver with Master: 1e7d2973b3e147dc899334d2142310e9 (127.6.120.193:33141)
I20260619 18:46:20.801707 6627 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.005197594s
I20260619 18:46:20.804579 14797 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39396
I20260619 18:46:20.819355 14942 heartbeater.cc:503] Master 127.6.120.254:41725 was elected leader, sending a full tablet report...
I20260619 18:46:20.830710 14797 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39422:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 18:46:20.872258 14907 tablet_service.cc:1467] Processing CreateTablet for tablet 0612be81c2c84fa3bec7457f0a954ff0 (DEFAULT_TABLE table=client-testtb [id=331ba5131e2742ab8533eeca1ed4b9a5]), partition=RANGE (key) PARTITION VALUES < 9
I20260619 18:46:20.872388 14906 tablet_service.cc:1467] Processing CreateTablet for tablet 5e24e557cb1c433392aac2ef8cfb8cb8 (DEFAULT_TABLE table=client-testtb [id=331ba5131e2742ab8533eeca1ed4b9a5]), partition=RANGE (key) PARTITION 9 <= VALUES
I20260619 18:46:20.873416 14907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0612be81c2c84fa3bec7457f0a954ff0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:20.874109 14906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e24e557cb1c433392aac2ef8cfb8cb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:20.890298 14952 tablet_bootstrap.cc:492] T 5e24e557cb1c433392aac2ef8cfb8cb8 P 1e7d2973b3e147dc899334d2142310e9: Bootstrap starting.
I20260619 18:46:20.895769 14952 tablet_bootstrap.cc:654] T 5e24e557cb1c433392aac2ef8cfb8cb8 P 1e7d2973b3e147dc899334d2142310e9: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:20.899827 14952 tablet_bootstrap.cc:492] T 5e24e557cb1c433392aac2ef8cfb8cb8 P 1e7d2973b3e147dc899334d2142310e9: No bootstrap required, opened a new log
I20260619 18:46:20.900331 14952 ts_tablet_manager.cc:1397] T 5e24e557cb1c433392aac2ef8cfb8cb8 P 1e7d2973b3e147dc899334d2142310e9: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20260619 18:46:20.902204 14952 raft_consensus.cc:348] T 5e24e557cb1c433392aac2ef8cfb8cb8 P 1e7d2973b3e147dc899334d2142310e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e7d2973b3e147dc899334d2142310e9" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 33141 } }
I20260619 18:46:20.902701 14952 raft_consensus.cc:374] T 5e24e557cb1c433392aac2ef8cfb8cb8 P 1e7d2973b3e147dc899334d2142310e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:20.902874 14952 raft_consensus.cc:729] T 5e24e557cb1c433392aac2ef8cfb8cb8 P 1e7d2973b3e147dc899334d2142310e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e7d2973b3e147dc899334d2142310e9, State: Initialized, Role: FOLLOWER
I20260619 18:46:20.903425 14952 consensus_queue.cc:260] T 5e24e557cb1c433392aac2ef8cfb8cb8 P 1e7d2973b3e147dc899334d2142310e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e7d2973b3e147dc899334d2142310e9" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 33141 } }
I20260619 18:46:20.904206 14952 raft_consensus.cc:388] T 5e24e557cb1c433392aac2ef8cfb8cb8 P 1e7d2973b3e147dc899334d2142310e9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:46:20.904639 14952 raft_consensus.cc:482] T 5e24e557cb1c433392aac2ef8cfb8cb8 P 1e7d2973b3e147dc899334d2142310e9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:46:20.905009 14952 raft_consensus.cc:3037] T 5e24e557cb1c433392aac2ef8cfb8cb8 P 1e7d2973b3e147dc899334d2142310e9 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:20.910802 14952 raft_consensus.cc:504] T 5e24e557cb1c433392aac2ef8cfb8cb8 P 1e7d2973b3e147dc899334d2142310e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e7d2973b3e147dc899334d2142310e9" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 33141 } }
I20260619 18:46:20.911410 14952 leader_election.cc:302] T 5e24e557cb1c433392aac2ef8cfb8cb8 P 1e7d2973b3e147dc899334d2142310e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e7d2973b3e147dc899334d2142310e9; no voters:
I20260619 18:46:20.912719 14952 leader_election.cc:288] T 5e24e557cb1c433392aac2ef8cfb8cb8 P 1e7d2973b3e147dc899334d2142310e9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:46:20.913273 14954 raft_consensus.cc:2781] T 5e24e557cb1c433392aac2ef8cfb8cb8 P 1e7d2973b3e147dc899334d2142310e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:46:20.915074 14952 ts_tablet_manager.cc:1428] T 5e24e557cb1c433392aac2ef8cfb8cb8 P 1e7d2973b3e147dc899334d2142310e9: Time spent starting tablet: real 0.015s user 0.006s sys 0.008s
I20260619 18:46:20.915171 14954 raft_consensus.cc:686] T 5e24e557cb1c433392aac2ef8cfb8cb8 P 1e7d2973b3e147dc899334d2142310e9 [term 1 LEADER]: Becoming Leader. State: Replica: 1e7d2973b3e147dc899334d2142310e9, State: Running, Role: LEADER
I20260619 18:46:20.916291 14952 tablet_bootstrap.cc:492] T 0612be81c2c84fa3bec7457f0a954ff0 P 1e7d2973b3e147dc899334d2142310e9: Bootstrap starting.
I20260619 18:46:20.916097 14954 consensus_queue.cc:237] T 5e24e557cb1c433392aac2ef8cfb8cb8 P 1e7d2973b3e147dc899334d2142310e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e7d2973b3e147dc899334d2142310e9" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 33141 } }
I20260619 18:46:20.922403 14952 tablet_bootstrap.cc:654] T 0612be81c2c84fa3bec7457f0a954ff0 P 1e7d2973b3e147dc899334d2142310e9: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:20.926200 14796 catalog_manager.cc:5495] T 5e24e557cb1c433392aac2ef8cfb8cb8 P 1e7d2973b3e147dc899334d2142310e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e7d2973b3e147dc899334d2142310e9 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "1e7d2973b3e147dc899334d2142310e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e7d2973b3e147dc899334d2142310e9" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 33141 } health_report { overall_health: HEALTHY } } }
I20260619 18:46:20.927446 14952 tablet_bootstrap.cc:492] T 0612be81c2c84fa3bec7457f0a954ff0 P 1e7d2973b3e147dc899334d2142310e9: No bootstrap required, opened a new log
I20260619 18:46:20.927991 14952 ts_tablet_manager.cc:1397] T 0612be81c2c84fa3bec7457f0a954ff0 P 1e7d2973b3e147dc899334d2142310e9: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260619 18:46:20.930051 14952 raft_consensus.cc:348] T 0612be81c2c84fa3bec7457f0a954ff0 P 1e7d2973b3e147dc899334d2142310e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e7d2973b3e147dc899334d2142310e9" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 33141 } }
I20260619 18:46:20.930505 14952 raft_consensus.cc:374] T 0612be81c2c84fa3bec7457f0a954ff0 P 1e7d2973b3e147dc899334d2142310e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:20.930787 14952 raft_consensus.cc:729] T 0612be81c2c84fa3bec7457f0a954ff0 P 1e7d2973b3e147dc899334d2142310e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e7d2973b3e147dc899334d2142310e9, State: Initialized, Role: FOLLOWER
I20260619 18:46:20.931435 14952 consensus_queue.cc:260] T 0612be81c2c84fa3bec7457f0a954ff0 P 1e7d2973b3e147dc899334d2142310e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e7d2973b3e147dc899334d2142310e9" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 33141 } }
I20260619 18:46:20.932075 14952 raft_consensus.cc:388] T 0612be81c2c84fa3bec7457f0a954ff0 P 1e7d2973b3e147dc899334d2142310e9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:46:20.932399 14952 raft_consensus.cc:482] T 0612be81c2c84fa3bec7457f0a954ff0 P 1e7d2973b3e147dc899334d2142310e9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:46:20.932723 14952 raft_consensus.cc:3037] T 0612be81c2c84fa3bec7457f0a954ff0 P 1e7d2973b3e147dc899334d2142310e9 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:20.938742 14952 raft_consensus.cc:504] T 0612be81c2c84fa3bec7457f0a954ff0 P 1e7d2973b3e147dc899334d2142310e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e7d2973b3e147dc899334d2142310e9" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 33141 } }
I20260619 18:46:20.939437 14952 leader_election.cc:302] T 0612be81c2c84fa3bec7457f0a954ff0 P 1e7d2973b3e147dc899334d2142310e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e7d2973b3e147dc899334d2142310e9; no voters:
I20260619 18:46:20.940069 14952 leader_election.cc:288] T 0612be81c2c84fa3bec7457f0a954ff0 P 1e7d2973b3e147dc899334d2142310e9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:46:20.940287 14954 raft_consensus.cc:2781] T 0612be81c2c84fa3bec7457f0a954ff0 P 1e7d2973b3e147dc899334d2142310e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:46:20.940949 14954 raft_consensus.cc:686] T 0612be81c2c84fa3bec7457f0a954ff0 P 1e7d2973b3e147dc899334d2142310e9 [term 1 LEADER]: Becoming Leader. State: Replica: 1e7d2973b3e147dc899334d2142310e9, State: Running, Role: LEADER
I20260619 18:46:20.941619 14954 consensus_queue.cc:237] T 0612be81c2c84fa3bec7457f0a954ff0 P 1e7d2973b3e147dc899334d2142310e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e7d2973b3e147dc899334d2142310e9" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 33141 } }
I20260619 18:46:20.941728 14952 ts_tablet_manager.cc:1428] T 0612be81c2c84fa3bec7457f0a954ff0 P 1e7d2973b3e147dc899334d2142310e9: Time spent starting tablet: real 0.013s user 0.010s sys 0.002s
I20260619 18:46:20.947075 14796 catalog_manager.cc:5495] T 0612be81c2c84fa3bec7457f0a954ff0 P 1e7d2973b3e147dc899334d2142310e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e7d2973b3e147dc899334d2142310e9 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "1e7d2973b3e147dc899334d2142310e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e7d2973b3e147dc899334d2142310e9" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 33141 } health_report { overall_health: HEALTHY } } }
I20260619 18:46:21.069352 6627 tablet_server.cc:178] TabletServer@127.6.120.193:0 shutting down...
I20260619 18:46:21.099416 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:46:21.100373 6627 tablet_replica.cc:330] T 0612be81c2c84fa3bec7457f0a954ff0 P 1e7d2973b3e147dc899334d2142310e9: stopping tablet replica
I20260619 18:46:21.100955 6627 raft_consensus.cc:2229] T 0612be81c2c84fa3bec7457f0a954ff0 P 1e7d2973b3e147dc899334d2142310e9 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:21.101639 6627 raft_consensus.cc:2258] T 0612be81c2c84fa3bec7457f0a954ff0 P 1e7d2973b3e147dc899334d2142310e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:21.104517 6627 tablet_replica.cc:330] T 5e24e557cb1c433392aac2ef8cfb8cb8 P 1e7d2973b3e147dc899334d2142310e9: stopping tablet replica
I20260619 18:46:21.105185 6627 raft_consensus.cc:2229] T 5e24e557cb1c433392aac2ef8cfb8cb8 P 1e7d2973b3e147dc899334d2142310e9 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:21.105791 6627 raft_consensus.cc:2258] T 5e24e557cb1c433392aac2ef8cfb8cb8 P 1e7d2973b3e147dc899334d2142310e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:21.119388 6627 tablet_server.cc:194] TabletServer@127.6.120.193:0 shutdown complete.
I20260619 18:46:21.133193 6627 master.cc:537] Master@127.6.120.254:41725 shutting down...
I20260619 18:46:21.151942 6627 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 5370750215954ad8ad45e64d58286f07 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:21.152592 6627 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 5370750215954ad8ad45e64d58286f07 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:21.153029 6627 tablet_replica.cc:330] T 00000000000000000000000000000000 P 5370750215954ad8ad45e64d58286f07: stopping tablet replica
I20260619 18:46:21.171906 6627 master.cc:552] Master@127.6.120.254:41725 shutdown complete.
[ OK ] Params/LatestObservedTimestampParamTest.Test/1 (732 ms)
[----------] 1 test from Params/LatestObservedTimestampParamTest (733 ms total)
[----------] 1 test from ServiceUnavailableRetryClientTest
[ RUN ] ServiceUnavailableRetryClientTest.CreateTable/0
I20260619 18:46:21.195549 6627 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.120.254:46657
I20260619 18:46:21.196636 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:46:21.201820 14969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:21.201856 14970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:21.203558 14972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:46:21.205010 6627 server_base.cc:1034] running on GCE node
I20260619 18:46:21.205945 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:46:21.206151 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:46:21.206334 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894781206322 us; error 0 us; skew 500 ppm
I20260619 18:46:21.206843 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:46:21.209213 6627 webserver.cc:460] Webserver started at http://127.6.120.254:42505/ using document root <none> and password file <none>
I20260619 18:46:21.209671 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:46:21.209853 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:46:21.210109 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:46:21.211129 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ServiceUnavailableRetryClientTest.CreateTable_0.1781894682485826-6627-0/minicluster-data/master-0-root/instance:
uuid: "3be1dffe6e8c42ec8da11db688ef7358"
format_stamp: "Formatted at 2026-06-19 18:46:21 on dist-test-slave-90mn"
I20260619 18:46:21.215353 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260619 18:46:21.218729 14977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:21.219501 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260619 18:46:21.219831 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ServiceUnavailableRetryClientTest.CreateTable_0.1781894682485826-6627-0/minicluster-data/master-0-root
uuid: "3be1dffe6e8c42ec8da11db688ef7358"
format_stamp: "Formatted at 2026-06-19 18:46:21 on dist-test-slave-90mn"
I20260619 18:46:21.220147 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ServiceUnavailableRetryClientTest.CreateTable_0.1781894682485826-6627-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ServiceUnavailableRetryClientTest.CreateTable_0.1781894682485826-6627-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ServiceUnavailableRetryClientTest.CreateTable_0.1781894682485826-6627-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:46:21.231722 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:46:21.232833 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:46:21.273389 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.254:46657
I20260619 18:46:21.273537 15038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.254:46657 every 8 connection(s)
I20260619 18:46:21.277069 15039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:21.287166 15039 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3be1dffe6e8c42ec8da11db688ef7358: Bootstrap starting.
I20260619 18:46:21.291623 15039 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3be1dffe6e8c42ec8da11db688ef7358: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:21.296700 15039 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3be1dffe6e8c42ec8da11db688ef7358: No bootstrap required, opened a new log
I20260619 18:46:21.299433 15039 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3be1dffe6e8c42ec8da11db688ef7358 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3be1dffe6e8c42ec8da11db688ef7358" member_type: VOTER }
I20260619 18:46:21.300007 15039 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3be1dffe6e8c42ec8da11db688ef7358 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:21.300331 15039 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3be1dffe6e8c42ec8da11db688ef7358 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3be1dffe6e8c42ec8da11db688ef7358, State: Initialized, Role: FOLLOWER
I20260619 18:46:21.301072 15039 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3be1dffe6e8c42ec8da11db688ef7358 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3be1dffe6e8c42ec8da11db688ef7358" member_type: VOTER }
I20260619 18:46:21.301535 15039 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3be1dffe6e8c42ec8da11db688ef7358 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:46:21.301726 15039 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3be1dffe6e8c42ec8da11db688ef7358 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:46:21.301926 15039 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3be1dffe6e8c42ec8da11db688ef7358 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:21.306481 15039 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3be1dffe6e8c42ec8da11db688ef7358 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3be1dffe6e8c42ec8da11db688ef7358" member_type: VOTER }
I20260619 18:46:21.306977 15039 leader_election.cc:302] T 00000000000000000000000000000000 P 3be1dffe6e8c42ec8da11db688ef7358 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3be1dffe6e8c42ec8da11db688ef7358; no voters:
I20260619 18:46:21.308019 15039 leader_election.cc:288] T 00000000000000000000000000000000 P 3be1dffe6e8c42ec8da11db688ef7358 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:46:21.308444 15042 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3be1dffe6e8c42ec8da11db688ef7358 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:46:21.309834 15042 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3be1dffe6e8c42ec8da11db688ef7358 [term 1 LEADER]: Becoming Leader. State: Replica: 3be1dffe6e8c42ec8da11db688ef7358, State: Running, Role: LEADER
I20260619 18:46:21.310487 15042 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3be1dffe6e8c42ec8da11db688ef7358 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3be1dffe6e8c42ec8da11db688ef7358" member_type: VOTER }
I20260619 18:46:21.310981 15039 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3be1dffe6e8c42ec8da11db688ef7358 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 18:46:21.313445 15043 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3be1dffe6e8c42ec8da11db688ef7358 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3be1dffe6e8c42ec8da11db688ef7358" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3be1dffe6e8c42ec8da11db688ef7358" member_type: VOTER } }
I20260619 18:46:21.313445 15044 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3be1dffe6e8c42ec8da11db688ef7358 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3be1dffe6e8c42ec8da11db688ef7358. Latest consensus state: current_term: 1 leader_uuid: "3be1dffe6e8c42ec8da11db688ef7358" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3be1dffe6e8c42ec8da11db688ef7358" member_type: VOTER } }
I20260619 18:46:21.314379 15043 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3be1dffe6e8c42ec8da11db688ef7358 [sys.catalog]: This master's current role is: LEADER
I20260619 18:46:21.314489 15044 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3be1dffe6e8c42ec8da11db688ef7358 [sys.catalog]: This master's current role is: LEADER
I20260619 18:46:21.319911 15047 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 18:46:21.327350 15047 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 18:46:21.328478 6627 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260619 18:46:21.336409 15047 catalog_manager.cc:1347] Generated new cluster ID: 3b7acba3ae5c40b5857efca10364b435
I20260619 18:46:21.336755 15047 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 18:46:21.364627 15047 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 18:46:21.366719 15047 catalog_manager.cc:1504] Loading token signing keys...
I20260619 18:46:21.380770 15047 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3be1dffe6e8c42ec8da11db688ef7358: Generated new TSK 0
I20260619 18:46:21.381589 15047 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 18:46:21.395879 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:46:21.402189 15060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:21.402515 15061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:21.404399 15063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:46:21.405133 6627 server_base.cc:1034] running on GCE node
I20260619 18:46:21.406018 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:46:21.406205 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:46:21.406409 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894781406378 us; error 0 us; skew 500 ppm
I20260619 18:46:21.406905 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:46:21.409608 6627 webserver.cc:460] Webserver started at http://127.6.120.193:33803/ using document root <none> and password file <none>
I20260619 18:46:21.410053 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:46:21.410240 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:46:21.410485 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:46:21.411561 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ServiceUnavailableRetryClientTest.CreateTable_0.1781894682485826-6627-0/minicluster-data/ts-0-root/instance:
uuid: "acc2f5f5e796407fa46fbd176233f5ad"
format_stamp: "Formatted at 2026-06-19 18:46:21 on dist-test-slave-90mn"
I20260619 18:46:21.415901 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260619 18:46:21.419150 15068 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:21.420032 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260619 18:46:21.420488 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ServiceUnavailableRetryClientTest.CreateTable_0.1781894682485826-6627-0/minicluster-data/ts-0-root
uuid: "acc2f5f5e796407fa46fbd176233f5ad"
format_stamp: "Formatted at 2026-06-19 18:46:21 on dist-test-slave-90mn"
I20260619 18:46:21.420816 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ServiceUnavailableRetryClientTest.CreateTable_0.1781894682485826-6627-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ServiceUnavailableRetryClientTest.CreateTable_0.1781894682485826-6627-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.ServiceUnavailableRetryClientTest.CreateTable_0.1781894682485826-6627-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:46:21.450548 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:46:21.451545 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:46:21.459587 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:46:21.459985 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:21.460376 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:46:21.460623 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:21.515559 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.193:34029
I20260619 18:46:21.515662 15138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.193:34029 every 8 connection(s)
I20260619 18:46:21.520182 15139 heartbeater.cc:347] Connected to a master server at 127.6.120.254:46657
I20260619 18:46:21.520676 15139 heartbeater.cc:464] Registering TS with master...
I20260619 18:46:21.521535 15139 heartbeater.cc:511] Master 127.6.120.254:46657 requested a full tablet report, sending...
I20260619 18:46:21.523558 14994 ts_manager.cc:194] Registered new tserver with Master: acc2f5f5e796407fa46fbd176233f5ad (127.6.120.193:34029)
I20260619 18:46:21.523701 6627 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.005112183s
I20260619 18:46:21.525810 14994 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43778
I20260619 18:46:21.539705 15139 heartbeater.cc:503] Master 127.6.120.254:46657 was elected leader, sending a full tablet report...
I20260619 18:46:21.547447 14993 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43796:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 18:46:21.583668 15104 tablet_service.cc:1467] Processing CreateTablet for tablet d598ce87246749bd9e1e8f8cf6abe247 (DEFAULT_TABLE table=client-testtb [id=741626ebfdea4ac8bc4db201328e99db]), partition=RANGE (key) PARTITION VALUES < 9
I20260619 18:46:21.583940 15103 tablet_service.cc:1467] Processing CreateTablet for tablet 37d1648f0d8449b79690bced1480acbc (DEFAULT_TABLE table=client-testtb [id=741626ebfdea4ac8bc4db201328e99db]), partition=RANGE (key) PARTITION 9 <= VALUES
I20260619 18:46:21.585080 15104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d598ce87246749bd9e1e8f8cf6abe247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:21.585747 15103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37d1648f0d8449b79690bced1480acbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:21.597592 15149 tablet_bootstrap.cc:492] T d598ce87246749bd9e1e8f8cf6abe247 P acc2f5f5e796407fa46fbd176233f5ad: Bootstrap starting.
I20260619 18:46:21.602104 15149 tablet_bootstrap.cc:654] T d598ce87246749bd9e1e8f8cf6abe247 P acc2f5f5e796407fa46fbd176233f5ad: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:21.605772 15149 tablet_bootstrap.cc:492] T d598ce87246749bd9e1e8f8cf6abe247 P acc2f5f5e796407fa46fbd176233f5ad: No bootstrap required, opened a new log
I20260619 18:46:21.606148 15149 ts_tablet_manager.cc:1397] T d598ce87246749bd9e1e8f8cf6abe247 P acc2f5f5e796407fa46fbd176233f5ad: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260619 18:46:21.608158 15149 raft_consensus.cc:348] T d598ce87246749bd9e1e8f8cf6abe247 P acc2f5f5e796407fa46fbd176233f5ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acc2f5f5e796407fa46fbd176233f5ad" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34029 } }
I20260619 18:46:21.608656 15149 raft_consensus.cc:374] T d598ce87246749bd9e1e8f8cf6abe247 P acc2f5f5e796407fa46fbd176233f5ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:21.608918 15149 raft_consensus.cc:729] T d598ce87246749bd9e1e8f8cf6abe247 P acc2f5f5e796407fa46fbd176233f5ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acc2f5f5e796407fa46fbd176233f5ad, State: Initialized, Role: FOLLOWER
I20260619 18:46:21.609331 15149 consensus_queue.cc:260] T d598ce87246749bd9e1e8f8cf6abe247 P acc2f5f5e796407fa46fbd176233f5ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acc2f5f5e796407fa46fbd176233f5ad" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34029 } }
I20260619 18:46:21.609833 15149 raft_consensus.cc:388] T d598ce87246749bd9e1e8f8cf6abe247 P acc2f5f5e796407fa46fbd176233f5ad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:46:21.610040 15149 raft_consensus.cc:482] T d598ce87246749bd9e1e8f8cf6abe247 P acc2f5f5e796407fa46fbd176233f5ad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:46:21.610332 15149 raft_consensus.cc:3037] T d598ce87246749bd9e1e8f8cf6abe247 P acc2f5f5e796407fa46fbd176233f5ad [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:21.615190 15149 raft_consensus.cc:504] T d598ce87246749bd9e1e8f8cf6abe247 P acc2f5f5e796407fa46fbd176233f5ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acc2f5f5e796407fa46fbd176233f5ad" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34029 } }
I20260619 18:46:21.615717 15149 leader_election.cc:302] T d598ce87246749bd9e1e8f8cf6abe247 P acc2f5f5e796407fa46fbd176233f5ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: acc2f5f5e796407fa46fbd176233f5ad; no voters:
I20260619 18:46:21.617039 15149 leader_election.cc:288] T d598ce87246749bd9e1e8f8cf6abe247 P acc2f5f5e796407fa46fbd176233f5ad [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:46:21.617445 15151 raft_consensus.cc:2781] T d598ce87246749bd9e1e8f8cf6abe247 P acc2f5f5e796407fa46fbd176233f5ad [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:46:21.619544 15149 ts_tablet_manager.cc:1428] T d598ce87246749bd9e1e8f8cf6abe247 P acc2f5f5e796407fa46fbd176233f5ad: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260619 18:46:21.620373 15151 raft_consensus.cc:686] T d598ce87246749bd9e1e8f8cf6abe247 P acc2f5f5e796407fa46fbd176233f5ad [term 1 LEADER]: Becoming Leader. State: Replica: acc2f5f5e796407fa46fbd176233f5ad, State: Running, Role: LEADER
I20260619 18:46:21.620589 15149 tablet_bootstrap.cc:492] T 37d1648f0d8449b79690bced1480acbc P acc2f5f5e796407fa46fbd176233f5ad: Bootstrap starting.
I20260619 18:46:21.621251 15151 consensus_queue.cc:237] T d598ce87246749bd9e1e8f8cf6abe247 P acc2f5f5e796407fa46fbd176233f5ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acc2f5f5e796407fa46fbd176233f5ad" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34029 } }
I20260619 18:46:21.626259 15149 tablet_bootstrap.cc:654] T 37d1648f0d8449b79690bced1480acbc P acc2f5f5e796407fa46fbd176233f5ad: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:21.628512 14993 catalog_manager.cc:5495] T d598ce87246749bd9e1e8f8cf6abe247 P acc2f5f5e796407fa46fbd176233f5ad reported cstate change: term changed from 0 to 1, leader changed from <none> to acc2f5f5e796407fa46fbd176233f5ad (127.6.120.193). New cstate: current_term: 1 leader_uuid: "acc2f5f5e796407fa46fbd176233f5ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acc2f5f5e796407fa46fbd176233f5ad" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34029 } health_report { overall_health: HEALTHY } } }
I20260619 18:46:21.631202 15149 tablet_bootstrap.cc:492] T 37d1648f0d8449b79690bced1480acbc P acc2f5f5e796407fa46fbd176233f5ad: No bootstrap required, opened a new log
I20260619 18:46:21.631723 15149 ts_tablet_manager.cc:1397] T 37d1648f0d8449b79690bced1480acbc P acc2f5f5e796407fa46fbd176233f5ad: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260619 18:46:21.633674 15149 raft_consensus.cc:348] T 37d1648f0d8449b79690bced1480acbc P acc2f5f5e796407fa46fbd176233f5ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acc2f5f5e796407fa46fbd176233f5ad" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34029 } }
I20260619 18:46:21.634236 15149 raft_consensus.cc:374] T 37d1648f0d8449b79690bced1480acbc P acc2f5f5e796407fa46fbd176233f5ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:21.634459 15149 raft_consensus.cc:729] T 37d1648f0d8449b79690bced1480acbc P acc2f5f5e796407fa46fbd176233f5ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: acc2f5f5e796407fa46fbd176233f5ad, State: Initialized, Role: FOLLOWER
I20260619 18:46:21.635056 15149 consensus_queue.cc:260] T 37d1648f0d8449b79690bced1480acbc P acc2f5f5e796407fa46fbd176233f5ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acc2f5f5e796407fa46fbd176233f5ad" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34029 } }
I20260619 18:46:21.635550 15149 raft_consensus.cc:388] T 37d1648f0d8449b79690bced1480acbc P acc2f5f5e796407fa46fbd176233f5ad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:46:21.635783 15149 raft_consensus.cc:482] T 37d1648f0d8449b79690bced1480acbc P acc2f5f5e796407fa46fbd176233f5ad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:46:21.636044 15149 raft_consensus.cc:3037] T 37d1648f0d8449b79690bced1480acbc P acc2f5f5e796407fa46fbd176233f5ad [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:21.641042 15149 raft_consensus.cc:504] T 37d1648f0d8449b79690bced1480acbc P acc2f5f5e796407fa46fbd176233f5ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acc2f5f5e796407fa46fbd176233f5ad" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34029 } }
I20260619 18:46:21.641598 15149 leader_election.cc:302] T 37d1648f0d8449b79690bced1480acbc P acc2f5f5e796407fa46fbd176233f5ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: acc2f5f5e796407fa46fbd176233f5ad; no voters:
I20260619 18:46:21.642122 15149 leader_election.cc:288] T 37d1648f0d8449b79690bced1480acbc P acc2f5f5e796407fa46fbd176233f5ad [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:46:21.642339 15151 raft_consensus.cc:2781] T 37d1648f0d8449b79690bced1480acbc P acc2f5f5e796407fa46fbd176233f5ad [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:46:21.642993 15151 raft_consensus.cc:686] T 37d1648f0d8449b79690bced1480acbc P acc2f5f5e796407fa46fbd176233f5ad [term 1 LEADER]: Becoming Leader. State: Replica: acc2f5f5e796407fa46fbd176233f5ad, State: Running, Role: LEADER
I20260619 18:46:21.643720 15149 ts_tablet_manager.cc:1428] T 37d1648f0d8449b79690bced1480acbc P acc2f5f5e796407fa46fbd176233f5ad: Time spent starting tablet: real 0.012s user 0.007s sys 0.004s
I20260619 18:46:21.643673 15151 consensus_queue.cc:237] T 37d1648f0d8449b79690bced1480acbc P acc2f5f5e796407fa46fbd176233f5ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acc2f5f5e796407fa46fbd176233f5ad" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34029 } }
I20260619 18:46:21.649343 14993 catalog_manager.cc:5495] T 37d1648f0d8449b79690bced1480acbc P acc2f5f5e796407fa46fbd176233f5ad reported cstate change: term changed from 0 to 1, leader changed from <none> to acc2f5f5e796407fa46fbd176233f5ad (127.6.120.193). New cstate: current_term: 1 leader_uuid: "acc2f5f5e796407fa46fbd176233f5ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "acc2f5f5e796407fa46fbd176233f5ad" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 34029 } health_report { overall_health: HEALTHY } } }
W20260619 18:46:21.671005 15143 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.6.120.254:46657)
I20260619 18:46:23.670740 6627 tablet_server.cc:178] TabletServer@127.6.120.193:0 shutting down...
I20260619 18:46:23.693425 15139 heartbeater.cc:503] Master 127.6.120.254:46657 was elected leader, sending a full tablet report...
I20260619 18:46:23.714589 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:46:23.715225 6627 tablet_replica.cc:330] T 37d1648f0d8449b79690bced1480acbc P acc2f5f5e796407fa46fbd176233f5ad: stopping tablet replica
I20260619 18:46:23.715790 6627 raft_consensus.cc:2229] T 37d1648f0d8449b79690bced1480acbc P acc2f5f5e796407fa46fbd176233f5ad [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:23.716292 6627 raft_consensus.cc:2258] T 37d1648f0d8449b79690bced1480acbc P acc2f5f5e796407fa46fbd176233f5ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:23.720417 6627 tablet_replica.cc:330] T d598ce87246749bd9e1e8f8cf6abe247 P acc2f5f5e796407fa46fbd176233f5ad: stopping tablet replica
I20260619 18:46:23.721057 6627 raft_consensus.cc:2229] T d598ce87246749bd9e1e8f8cf6abe247 P acc2f5f5e796407fa46fbd176233f5ad [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:23.721585 6627 raft_consensus.cc:2258] T d598ce87246749bd9e1e8f8cf6abe247 P acc2f5f5e796407fa46fbd176233f5ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:23.742648 6627 tablet_server.cc:194] TabletServer@127.6.120.193:0 shutdown complete.
I20260619 18:46:23.757391 6627 master.cc:537] Master@127.6.120.254:46657 shutting down...
I20260619 18:46:23.779498 6627 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 3be1dffe6e8c42ec8da11db688ef7358 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:23.780164 6627 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 3be1dffe6e8c42ec8da11db688ef7358 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:23.780529 6627 tablet_replica.cc:330] T 00000000000000000000000000000000 P 3be1dffe6e8c42ec8da11db688ef7358: stopping tablet replica
I20260619 18:46:23.799026 6627 master.cc:552] Master@127.6.120.254:46657 shutdown complete.
[ OK ] ServiceUnavailableRetryClientTest.CreateTable/0 (2628 ms)
[----------] 1 test from ServiceUnavailableRetryClientTest (2628 ms total)
[----------] 2 tests from Params/ClientTestImmutableColumn
[ RUN ] Params/ClientTestImmutableColumn.TestUpdateIgnore/2
I20260619 18:46:23.824404 6627 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.120.254:45295
I20260619 18:46:23.825479 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:46:23.830505 15159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:23.831254 15160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:23.832402 15162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:46:23.834125 6627 server_base.cc:1034] running on GCE node
I20260619 18:46:23.834986 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:46:23.835181 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:46:23.835302 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894783835293 us; error 0 us; skew 500 ppm
I20260619 18:46:23.835784 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:46:23.838305 6627 webserver.cc:460] Webserver started at http://127.6.120.254:34737/ using document root <none> and password file <none>
I20260619 18:46:23.838786 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:46:23.838948 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:46:23.839167 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:46:23.840371 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.Params_ClientTestImmutableColumn.TestUpdateIgnore_2.1781894682485826-6627-0/minicluster-data/master-0-root/instance:
uuid: "906b182333a248d3a843adaaeea0d9c2"
format_stamp: "Formatted at 2026-06-19 18:46:23 on dist-test-slave-90mn"
I20260619 18:46:23.845078 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s
I20260619 18:46:23.848623 15167 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:23.849494 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.001s
I20260619 18:46:23.849840 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.Params_ClientTestImmutableColumn.TestUpdateIgnore_2.1781894682485826-6627-0/minicluster-data/master-0-root
uuid: "906b182333a248d3a843adaaeea0d9c2"
format_stamp: "Formatted at 2026-06-19 18:46:23 on dist-test-slave-90mn"
I20260619 18:46:23.850139 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.Params_ClientTestImmutableColumn.TestUpdateIgnore_2.1781894682485826-6627-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.Params_ClientTestImmutableColumn.TestUpdateIgnore_2.1781894682485826-6627-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.Params_ClientTestImmutableColumn.TestUpdateIgnore_2.1781894682485826-6627-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:46:23.866865 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:46:23.867952 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:46:23.912456 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.254:45295
I20260619 18:46:23.912643 15228 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.254:45295 every 8 connection(s)
I20260619 18:46:23.916462 15229 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:23.927845 15229 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 906b182333a248d3a843adaaeea0d9c2: Bootstrap starting.
I20260619 18:46:23.932811 15229 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 906b182333a248d3a843adaaeea0d9c2: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:23.937350 15229 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 906b182333a248d3a843adaaeea0d9c2: No bootstrap required, opened a new log
I20260619 18:46:23.939611 15229 raft_consensus.cc:348] T 00000000000000000000000000000000 P 906b182333a248d3a843adaaeea0d9c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "906b182333a248d3a843adaaeea0d9c2" member_type: VOTER }
I20260619 18:46:23.940069 15229 raft_consensus.cc:374] T 00000000000000000000000000000000 P 906b182333a248d3a843adaaeea0d9c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:23.940347 15229 raft_consensus.cc:729] T 00000000000000000000000000000000 P 906b182333a248d3a843adaaeea0d9c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 906b182333a248d3a843adaaeea0d9c2, State: Initialized, Role: FOLLOWER
I20260619 18:46:23.941027 15229 consensus_queue.cc:260] T 00000000000000000000000000000000 P 906b182333a248d3a843adaaeea0d9c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "906b182333a248d3a843adaaeea0d9c2" member_type: VOTER }
I20260619 18:46:23.941517 15229 raft_consensus.cc:388] T 00000000000000000000000000000000 P 906b182333a248d3a843adaaeea0d9c2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:46:23.941757 15229 raft_consensus.cc:482] T 00000000000000000000000000000000 P 906b182333a248d3a843adaaeea0d9c2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:46:23.942070 15229 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 906b182333a248d3a843adaaeea0d9c2 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:23.946918 15229 raft_consensus.cc:504] T 00000000000000000000000000000000 P 906b182333a248d3a843adaaeea0d9c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "906b182333a248d3a843adaaeea0d9c2" member_type: VOTER }
I20260619 18:46:23.947508 15229 leader_election.cc:302] T 00000000000000000000000000000000 P 906b182333a248d3a843adaaeea0d9c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 906b182333a248d3a843adaaeea0d9c2; no voters:
I20260619 18:46:23.948843 15229 leader_election.cc:288] T 00000000000000000000000000000000 P 906b182333a248d3a843adaaeea0d9c2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:46:23.949222 15232 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 906b182333a248d3a843adaaeea0d9c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:46:23.950575 15232 raft_consensus.cc:686] T 00000000000000000000000000000000 P 906b182333a248d3a843adaaeea0d9c2 [term 1 LEADER]: Becoming Leader. State: Replica: 906b182333a248d3a843adaaeea0d9c2, State: Running, Role: LEADER
I20260619 18:46:23.951323 15232 consensus_queue.cc:237] T 00000000000000000000000000000000 P 906b182333a248d3a843adaaeea0d9c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "906b182333a248d3a843adaaeea0d9c2" member_type: VOTER }
I20260619 18:46:23.952548 15229 sys_catalog.cc:564] T 00000000000000000000000000000000 P 906b182333a248d3a843adaaeea0d9c2 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 18:46:23.954550 15233 sys_catalog.cc:455] T 00000000000000000000000000000000 P 906b182333a248d3a843adaaeea0d9c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "906b182333a248d3a843adaaeea0d9c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "906b182333a248d3a843adaaeea0d9c2" member_type: VOTER } }
I20260619 18:46:23.954619 15234 sys_catalog.cc:455] T 00000000000000000000000000000000 P 906b182333a248d3a843adaaeea0d9c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 906b182333a248d3a843adaaeea0d9c2. Latest consensus state: current_term: 1 leader_uuid: "906b182333a248d3a843adaaeea0d9c2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "906b182333a248d3a843adaaeea0d9c2" member_type: VOTER } }
I20260619 18:46:23.955703 15234 sys_catalog.cc:458] T 00000000000000000000000000000000 P 906b182333a248d3a843adaaeea0d9c2 [sys.catalog]: This master's current role is: LEADER
I20260619 18:46:23.955711 15233 sys_catalog.cc:458] T 00000000000000000000000000000000 P 906b182333a248d3a843adaaeea0d9c2 [sys.catalog]: This master's current role is: LEADER
I20260619 18:46:23.964444 15238 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 18:46:23.968989 15238 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 18:46:23.970046 6627 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260619 18:46:23.978057 15238 catalog_manager.cc:1347] Generated new cluster ID: 1e1189aea52346e695db437b9ce2cbc0
I20260619 18:46:23.978370 15238 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 18:46:24.011925 15238 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 18:46:24.014101 15238 catalog_manager.cc:1504] Loading token signing keys...
I20260619 18:46:24.032538 15238 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 906b182333a248d3a843adaaeea0d9c2: Generated new TSK 0
I20260619 18:46:24.033381 15238 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 18:46:24.101778 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:46:24.107865 15250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:24.109203 15251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:24.109954 15253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:46:24.110800 6627 server_base.cc:1034] running on GCE node
I20260619 18:46:24.111707 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:46:24.111908 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:46:24.112155 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894784112116 us; error 0 us; skew 500 ppm
I20260619 18:46:24.112709 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:46:24.115170 6627 webserver.cc:460] Webserver started at http://127.6.120.193:43041/ using document root <none> and password file <none>
I20260619 18:46:24.115679 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:46:24.115890 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:46:24.116216 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:46:24.117360 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.Params_ClientTestImmutableColumn.TestUpdateIgnore_2.1781894682485826-6627-0/minicluster-data/ts-0-root/instance:
uuid: "9190b0bf744a45f58eb2720ce6ef7428"
format_stamp: "Formatted at 2026-06-19 18:46:24 on dist-test-slave-90mn"
I20260619 18:46:24.122387 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260619 18:46:24.126045 15258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:24.126890 6627 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260619 18:46:24.127293 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.Params_ClientTestImmutableColumn.TestUpdateIgnore_2.1781894682485826-6627-0/minicluster-data/ts-0-root
uuid: "9190b0bf744a45f58eb2720ce6ef7428"
format_stamp: "Formatted at 2026-06-19 18:46:24 on dist-test-slave-90mn"
I20260619 18:46:24.127559 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.Params_ClientTestImmutableColumn.TestUpdateIgnore_2.1781894682485826-6627-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.Params_ClientTestImmutableColumn.TestUpdateIgnore_2.1781894682485826-6627-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.Params_ClientTestImmutableColumn.TestUpdateIgnore_2.1781894682485826-6627-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:46:24.154286 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:46:24.155360 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:46:24.160925 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:46:24.161377 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:24.161819 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:46:24.162055 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:24.216207 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.193:33611
I20260619 18:46:24.216328 15328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.193:33611 every 8 connection(s)
I20260619 18:46:24.221036 15329 heartbeater.cc:347] Connected to a master server at 127.6.120.254:45295
I20260619 18:46:24.221527 15329 heartbeater.cc:464] Registering TS with master...
I20260619 18:46:24.222399 15329 heartbeater.cc:511] Master 127.6.120.254:45295 requested a full tablet report, sending...
I20260619 18:46:24.224696 15184 ts_manager.cc:194] Registered new tserver with Master: 9190b0bf744a45f58eb2720ce6ef7428 (127.6.120.193:33611)
I20260619 18:46:24.224887 6627 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.005284104s
I20260619 18:46:24.227770 15184 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37390
I20260619 18:46:24.242117 15329 heartbeater.cc:503] Master 127.6.120.254:45295 was elected leader, sending a full tablet report...
I20260619 18:46:24.252293 15184 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37402:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "imm_val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: true
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 18:46:24.290593 15294 tablet_service.cc:1467] Processing CreateTablet for tablet 97fc1f0cf8e24de1a1d9fc4aae9025f5 (DEFAULT_TABLE table=client-testtb [id=65b738242c4a406a9284cf8d9406c9c6]), partition=RANGE (key) PARTITION VALUES < 9
I20260619 18:46:24.290858 15293 tablet_service.cc:1467] Processing CreateTablet for tablet 254fb8fea9cd4736896a9a6400729b87 (DEFAULT_TABLE table=client-testtb [id=65b738242c4a406a9284cf8d9406c9c6]), partition=RANGE (key) PARTITION 9 <= VALUES
I20260619 18:46:24.291903 15294 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 97fc1f0cf8e24de1a1d9fc4aae9025f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:24.292479 15293 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 254fb8fea9cd4736896a9a6400729b87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:24.305692 15339 tablet_bootstrap.cc:492] T 254fb8fea9cd4736896a9a6400729b87 P 9190b0bf744a45f58eb2720ce6ef7428: Bootstrap starting.
I20260619 18:46:24.309950 15339 tablet_bootstrap.cc:654] T 254fb8fea9cd4736896a9a6400729b87 P 9190b0bf744a45f58eb2720ce6ef7428: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:24.314559 15339 tablet_bootstrap.cc:492] T 254fb8fea9cd4736896a9a6400729b87 P 9190b0bf744a45f58eb2720ce6ef7428: No bootstrap required, opened a new log
I20260619 18:46:24.315097 15339 ts_tablet_manager.cc:1397] T 254fb8fea9cd4736896a9a6400729b87 P 9190b0bf744a45f58eb2720ce6ef7428: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260619 18:46:24.317276 15339 raft_consensus.cc:348] T 254fb8fea9cd4736896a9a6400729b87 P 9190b0bf744a45f58eb2720ce6ef7428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9190b0bf744a45f58eb2720ce6ef7428" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 33611 } }
I20260619 18:46:24.317723 15339 raft_consensus.cc:374] T 254fb8fea9cd4736896a9a6400729b87 P 9190b0bf744a45f58eb2720ce6ef7428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:24.317953 15339 raft_consensus.cc:729] T 254fb8fea9cd4736896a9a6400729b87 P 9190b0bf744a45f58eb2720ce6ef7428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9190b0bf744a45f58eb2720ce6ef7428, State: Initialized, Role: FOLLOWER
I20260619 18:46:24.318462 15339 consensus_queue.cc:260] T 254fb8fea9cd4736896a9a6400729b87 P 9190b0bf744a45f58eb2720ce6ef7428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9190b0bf744a45f58eb2720ce6ef7428" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 33611 } }
I20260619 18:46:24.318945 15339 raft_consensus.cc:388] T 254fb8fea9cd4736896a9a6400729b87 P 9190b0bf744a45f58eb2720ce6ef7428 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:46:24.319190 15339 raft_consensus.cc:482] T 254fb8fea9cd4736896a9a6400729b87 P 9190b0bf744a45f58eb2720ce6ef7428 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:46:24.319456 15339 raft_consensus.cc:3037] T 254fb8fea9cd4736896a9a6400729b87 P 9190b0bf744a45f58eb2720ce6ef7428 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:24.324441 15339 raft_consensus.cc:504] T 254fb8fea9cd4736896a9a6400729b87 P 9190b0bf744a45f58eb2720ce6ef7428 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9190b0bf744a45f58eb2720ce6ef7428" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 33611 } }
I20260619 18:46:24.325093 15339 leader_election.cc:302] T 254fb8fea9cd4736896a9a6400729b87 P 9190b0bf744a45f58eb2720ce6ef7428 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9190b0bf744a45f58eb2720ce6ef7428; no voters:
I20260619 18:46:24.327087 15339 leader_election.cc:288] T 254fb8fea9cd4736896a9a6400729b87 P 9190b0bf744a45f58eb2720ce6ef7428 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:46:24.327533 15341 raft_consensus.cc:2781] T 254fb8fea9cd4736896a9a6400729b87 P 9190b0bf744a45f58eb2720ce6ef7428 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:46:24.329712 15341 raft_consensus.cc:686] T 254fb8fea9cd4736896a9a6400729b87 P 9190b0bf744a45f58eb2720ce6ef7428 [term 1 LEADER]: Becoming Leader. State: Replica: 9190b0bf744a45f58eb2720ce6ef7428, State: Running, Role: LEADER
I20260619 18:46:24.330547 15341 consensus_queue.cc:237] T 254fb8fea9cd4736896a9a6400729b87 P 9190b0bf744a45f58eb2720ce6ef7428 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9190b0bf744a45f58eb2720ce6ef7428" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 33611 } }
I20260619 18:46:24.331111 15339 ts_tablet_manager.cc:1428] T 254fb8fea9cd4736896a9a6400729b87 P 9190b0bf744a45f58eb2720ce6ef7428: Time spent starting tablet: real 0.016s user 0.012s sys 0.004s
I20260619 18:46:24.332191 15339 tablet_bootstrap.cc:492] T 97fc1f0cf8e24de1a1d9fc4aae9025f5 P 9190b0bf744a45f58eb2720ce6ef7428: Bootstrap starting.
I20260619 18:46:24.337960 15339 tablet_bootstrap.cc:654] T 97fc1f0cf8e24de1a1d9fc4aae9025f5 P 9190b0bf744a45f58eb2720ce6ef7428: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:24.338182 15183 catalog_manager.cc:5495] T 254fb8fea9cd4736896a9a6400729b87 P 9190b0bf744a45f58eb2720ce6ef7428 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9190b0bf744a45f58eb2720ce6ef7428 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "9190b0bf744a45f58eb2720ce6ef7428" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9190b0bf744a45f58eb2720ce6ef7428" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 33611 } health_report { overall_health: HEALTHY } } }
I20260619 18:46:24.346438 15339 tablet_bootstrap.cc:492] T 97fc1f0cf8e24de1a1d9fc4aae9025f5 P 9190b0bf744a45f58eb2720ce6ef7428: No bootstrap required, opened a new log
I20260619 18:46:24.346982 15339 ts_tablet_manager.cc:1397] T 97fc1f0cf8e24de1a1d9fc4aae9025f5 P 9190b0bf744a45f58eb2720ce6ef7428: Time spent bootstrapping tablet: real 0.015s user 0.012s sys 0.000s
I20260619 18:46:24.349731 15339 raft_consensus.cc:348] T 97fc1f0cf8e24de1a1d9fc4aae9025f5 P 9190b0bf744a45f58eb2720ce6ef7428 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9190b0bf744a45f58eb2720ce6ef7428" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 33611 } }
I20260619 18:46:24.350353 15339 raft_consensus.cc:374] T 97fc1f0cf8e24de1a1d9fc4aae9025f5 P 9190b0bf744a45f58eb2720ce6ef7428 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:24.350664 15339 raft_consensus.cc:729] T 97fc1f0cf8e24de1a1d9fc4aae9025f5 P 9190b0bf744a45f58eb2720ce6ef7428 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9190b0bf744a45f58eb2720ce6ef7428, State: Initialized, Role: FOLLOWER
I20260619 18:46:24.351346 15339 consensus_queue.cc:260] T 97fc1f0cf8e24de1a1d9fc4aae9025f5 P 9190b0bf744a45f58eb2720ce6ef7428 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9190b0bf744a45f58eb2720ce6ef7428" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 33611 } }
I20260619 18:46:24.352092 15339 raft_consensus.cc:388] T 97fc1f0cf8e24de1a1d9fc4aae9025f5 P 9190b0bf744a45f58eb2720ce6ef7428 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:46:24.352363 15339 raft_consensus.cc:482] T 97fc1f0cf8e24de1a1d9fc4aae9025f5 P 9190b0bf744a45f58eb2720ce6ef7428 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:46:24.352742 15339 raft_consensus.cc:3037] T 97fc1f0cf8e24de1a1d9fc4aae9025f5 P 9190b0bf744a45f58eb2720ce6ef7428 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:24.358078 15339 raft_consensus.cc:504] T 97fc1f0cf8e24de1a1d9fc4aae9025f5 P 9190b0bf744a45f58eb2720ce6ef7428 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9190b0bf744a45f58eb2720ce6ef7428" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 33611 } }
I20260619 18:46:24.358714 15339 leader_election.cc:302] T 97fc1f0cf8e24de1a1d9fc4aae9025f5 P 9190b0bf744a45f58eb2720ce6ef7428 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9190b0bf744a45f58eb2720ce6ef7428; no voters:
I20260619 18:46:24.359266 15339 leader_election.cc:288] T 97fc1f0cf8e24de1a1d9fc4aae9025f5 P 9190b0bf744a45f58eb2720ce6ef7428 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:46:24.359459 15341 raft_consensus.cc:2781] T 97fc1f0cf8e24de1a1d9fc4aae9025f5 P 9190b0bf744a45f58eb2720ce6ef7428 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:46:24.360011 15341 raft_consensus.cc:686] T 97fc1f0cf8e24de1a1d9fc4aae9025f5 P 9190b0bf744a45f58eb2720ce6ef7428 [term 1 LEADER]: Becoming Leader. State: Replica: 9190b0bf744a45f58eb2720ce6ef7428, State: Running, Role: LEADER
I20260619 18:46:24.360932 15339 ts_tablet_manager.cc:1428] T 97fc1f0cf8e24de1a1d9fc4aae9025f5 P 9190b0bf744a45f58eb2720ce6ef7428: Time spent starting tablet: real 0.014s user 0.011s sys 0.004s
I20260619 18:46:24.360796 15341 consensus_queue.cc:237] T 97fc1f0cf8e24de1a1d9fc4aae9025f5 P 9190b0bf744a45f58eb2720ce6ef7428 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9190b0bf744a45f58eb2720ce6ef7428" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 33611 } }
I20260619 18:46:24.366990 15183 catalog_manager.cc:5495] T 97fc1f0cf8e24de1a1d9fc4aae9025f5 P 9190b0bf744a45f58eb2720ce6ef7428 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9190b0bf744a45f58eb2720ce6ef7428 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "9190b0bf744a45f58eb2720ce6ef7428" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9190b0bf744a45f58eb2720ce6ef7428" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 33611 } health_report { overall_health: HEALTHY } } }
I20260619 18:46:24.481424 6627 tablet_server.cc:178] TabletServer@127.6.120.193:0 shutting down...
I20260619 18:46:24.518575 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:46:24.519889 6627 tablet_replica.cc:330] T 97fc1f0cf8e24de1a1d9fc4aae9025f5 P 9190b0bf744a45f58eb2720ce6ef7428: stopping tablet replica
I20260619 18:46:24.520532 6627 raft_consensus.cc:2229] T 97fc1f0cf8e24de1a1d9fc4aae9025f5 P 9190b0bf744a45f58eb2720ce6ef7428 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:24.521104 6627 raft_consensus.cc:2258] T 97fc1f0cf8e24de1a1d9fc4aae9025f5 P 9190b0bf744a45f58eb2720ce6ef7428 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:24.524309 6627 tablet_replica.cc:330] T 254fb8fea9cd4736896a9a6400729b87 P 9190b0bf744a45f58eb2720ce6ef7428: stopping tablet replica
I20260619 18:46:24.524833 6627 raft_consensus.cc:2229] T 254fb8fea9cd4736896a9a6400729b87 P 9190b0bf744a45f58eb2720ce6ef7428 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:24.525286 6627 raft_consensus.cc:2258] T 254fb8fea9cd4736896a9a6400729b87 P 9190b0bf744a45f58eb2720ce6ef7428 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:24.549329 6627 tablet_server.cc:194] TabletServer@127.6.120.193:0 shutdown complete.
I20260619 18:46:24.566160 6627 master.cc:537] Master@127.6.120.254:45295 shutting down...
I20260619 18:46:24.596099 6627 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 906b182333a248d3a843adaaeea0d9c2 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:24.596794 6627 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 906b182333a248d3a843adaaeea0d9c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:24.597131 6627 tablet_replica.cc:330] T 00000000000000000000000000000000 P 906b182333a248d3a843adaaeea0d9c2: stopping tablet replica
I20260619 18:46:24.618120 6627 master.cc:552] Master@127.6.120.254:45295 shutdown complete.
[ OK ] Params/ClientTestImmutableColumn.TestUpdateIgnore/2 (818 ms)
[ RUN ] Params/ClientTestImmutableColumn.TestUpsert/2
I20260619 18:46:24.642632 6627 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.6.120.254:38235
I20260619 18:46:24.643678 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:46:24.649042 15351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:24.650197 15352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:46:24.653589 6627 server_base.cc:1034] running on GCE node
W20260619 18:46:24.653647 15354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:46:24.655081 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:46:24.655328 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:46:24.655488 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894784655474 us; error 0 us; skew 500 ppm
I20260619 18:46:24.656018 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:46:24.659772 6627 webserver.cc:460] Webserver started at http://127.6.120.254:34061/ using document root <none> and password file <none>
I20260619 18:46:24.660398 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:46:24.660609 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:46:24.660890 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:46:24.661954 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.Params_ClientTestImmutableColumn.TestUpsert_2.1781894682485826-6627-0/minicluster-data/master-0-root/instance:
uuid: "232645e589054a93998fa6c00f33ced6"
format_stamp: "Formatted at 2026-06-19 18:46:24 on dist-test-slave-90mn"
I20260619 18:46:24.668891 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260619 18:46:24.672655 15359 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:24.673609 6627 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260619 18:46:24.673928 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.Params_ClientTestImmutableColumn.TestUpsert_2.1781894682485826-6627-0/minicluster-data/master-0-root
uuid: "232645e589054a93998fa6c00f33ced6"
format_stamp: "Formatted at 2026-06-19 18:46:24 on dist-test-slave-90mn"
I20260619 18:46:24.674204 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.Params_ClientTestImmutableColumn.TestUpsert_2.1781894682485826-6627-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.Params_ClientTestImmutableColumn.TestUpsert_2.1781894682485826-6627-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.Params_ClientTestImmutableColumn.TestUpsert_2.1781894682485826-6627-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:46:24.697222 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:46:24.698287 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:46:24.758304 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.254:38235
I20260619 18:46:24.758405 15420 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.254:38235 every 8 connection(s)
I20260619 18:46:24.763003 15421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:24.778263 15421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 232645e589054a93998fa6c00f33ced6: Bootstrap starting.
I20260619 18:46:24.784420 15421 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 232645e589054a93998fa6c00f33ced6: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:24.789433 15421 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 232645e589054a93998fa6c00f33ced6: No bootstrap required, opened a new log
I20260619 18:46:24.792074 15421 raft_consensus.cc:348] T 00000000000000000000000000000000 P 232645e589054a93998fa6c00f33ced6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "232645e589054a93998fa6c00f33ced6" member_type: VOTER }
I20260619 18:46:24.792645 15421 raft_consensus.cc:374] T 00000000000000000000000000000000 P 232645e589054a93998fa6c00f33ced6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:24.792912 15421 raft_consensus.cc:729] T 00000000000000000000000000000000 P 232645e589054a93998fa6c00f33ced6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 232645e589054a93998fa6c00f33ced6, State: Initialized, Role: FOLLOWER
I20260619 18:46:24.793591 15421 consensus_queue.cc:260] T 00000000000000000000000000000000 P 232645e589054a93998fa6c00f33ced6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "232645e589054a93998fa6c00f33ced6" member_type: VOTER }
I20260619 18:46:24.794176 15421 raft_consensus.cc:388] T 00000000000000000000000000000000 P 232645e589054a93998fa6c00f33ced6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:46:24.794451 15421 raft_consensus.cc:482] T 00000000000000000000000000000000 P 232645e589054a93998fa6c00f33ced6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:46:24.794759 15421 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 232645e589054a93998fa6c00f33ced6 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:24.801613 15421 raft_consensus.cc:504] T 00000000000000000000000000000000 P 232645e589054a93998fa6c00f33ced6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "232645e589054a93998fa6c00f33ced6" member_type: VOTER }
I20260619 18:46:24.802282 15421 leader_election.cc:302] T 00000000000000000000000000000000 P 232645e589054a93998fa6c00f33ced6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 232645e589054a93998fa6c00f33ced6; no voters:
I20260619 18:46:24.803632 15421 leader_election.cc:288] T 00000000000000000000000000000000 P 232645e589054a93998fa6c00f33ced6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:46:24.803999 15424 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 232645e589054a93998fa6c00f33ced6 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:46:24.806098 15424 raft_consensus.cc:686] T 00000000000000000000000000000000 P 232645e589054a93998fa6c00f33ced6 [term 1 LEADER]: Becoming Leader. State: Replica: 232645e589054a93998fa6c00f33ced6, State: Running, Role: LEADER
I20260619 18:46:24.806836 15424 consensus_queue.cc:237] T 00000000000000000000000000000000 P 232645e589054a93998fa6c00f33ced6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "232645e589054a93998fa6c00f33ced6" member_type: VOTER }
I20260619 18:46:24.807027 15421 sys_catalog.cc:564] T 00000000000000000000000000000000 P 232645e589054a93998fa6c00f33ced6 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 18:46:24.809444 15425 sys_catalog.cc:455] T 00000000000000000000000000000000 P 232645e589054a93998fa6c00f33ced6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "232645e589054a93998fa6c00f33ced6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "232645e589054a93998fa6c00f33ced6" member_type: VOTER } }
I20260619 18:46:24.809939 15425 sys_catalog.cc:458] T 00000000000000000000000000000000 P 232645e589054a93998fa6c00f33ced6 [sys.catalog]: This master's current role is: LEADER
I20260619 18:46:24.810668 15426 sys_catalog.cc:455] T 00000000000000000000000000000000 P 232645e589054a93998fa6c00f33ced6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 232645e589054a93998fa6c00f33ced6. Latest consensus state: current_term: 1 leader_uuid: "232645e589054a93998fa6c00f33ced6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "232645e589054a93998fa6c00f33ced6" member_type: VOTER } }
I20260619 18:46:24.811424 15426 sys_catalog.cc:458] T 00000000000000000000000000000000 P 232645e589054a93998fa6c00f33ced6 [sys.catalog]: This master's current role is: LEADER
I20260619 18:46:24.824630 15429 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 18:46:24.831414 15429 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 18:46:24.843742 15429 catalog_manager.cc:1347] Generated new cluster ID: 13a62b461f3a4cd99093c9de21496d7d
I20260619 18:46:24.844064 15429 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 18:46:24.852783 6627 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260619 18:46:24.872354 15429 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 18:46:24.874203 15429 catalog_manager.cc:1504] Loading token signing keys...
I20260619 18:46:24.900146 15429 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 232645e589054a93998fa6c00f33ced6: Generated new TSK 0
I20260619 18:46:24.900970 15429 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 18:46:24.919749 6627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 18:46:24.926438 15442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 18:46:24.928679 15443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:46:24.930004 6627 server_base.cc:1034] running on GCE node
W20260619 18:46:24.930927 15445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 18:46:24.931980 6627 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260619 18:46:24.932300 6627 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260619 18:46:24.932484 6627 hybrid_clock.cc:648] HybridClock initialized: now 1781894784932459 us; error 0 us; skew 500 ppm
I20260619 18:46:24.932998 6627 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 18:46:24.935998 6627 webserver.cc:460] Webserver started at http://127.6.120.193:34803/ using document root <none> and password file <none>
I20260619 18:46:24.936648 6627 fs_manager.cc:359] Metadata directory not provided
I20260619 18:46:24.936877 6627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 18:46:24.937150 6627 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 18:46:24.938354 6627 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.Params_ClientTestImmutableColumn.TestUpsert_2.1781894682485826-6627-0/minicluster-data/ts-0-root/instance:
uuid: "ee463571d7ce4684a040dc2941d67251"
format_stamp: "Formatted at 2026-06-19 18:46:24 on dist-test-slave-90mn"
I20260619 18:46:24.943073 6627 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260619 18:46:24.946902 15450 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:24.947830 6627 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 18:46:24.948158 6627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.Params_ClientTestImmutableColumn.TestUpsert_2.1781894682485826-6627-0/minicluster-data/ts-0-root
uuid: "ee463571d7ce4684a040dc2941d67251"
format_stamp: "Formatted at 2026-06-19 18:46:24 on dist-test-slave-90mn"
I20260619 18:46:24.948436 6627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.Params_ClientTestImmutableColumn.TestUpsert_2.1781894682485826-6627-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.Params_ClientTestImmutableColumn.TestUpsert_2.1781894682485826-6627-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskK5YWMj/test-tmp/client-test.6.Params_ClientTestImmutableColumn.TestUpsert_2.1781894682485826-6627-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 18:46:24.980715 6627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 18:46:24.981729 6627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 18:46:24.994417 6627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 18:46:24.994876 6627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:24.995263 6627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 18:46:24.995517 6627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 18:46:25.080613 6627 rpc_server.cc:307] RPC server started. Bound to: 127.6.120.193:41667
I20260619 18:46:25.080703 15520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.6.120.193:41667 every 8 connection(s)
I20260619 18:46:25.086076 15521 heartbeater.cc:347] Connected to a master server at 127.6.120.254:38235
I20260619 18:46:25.086557 15521 heartbeater.cc:464] Registering TS with master...
I20260619 18:46:25.087553 15521 heartbeater.cc:511] Master 127.6.120.254:38235 requested a full tablet report, sending...
I20260619 18:46:25.089797 15376 ts_manager.cc:194] Registered new tserver with Master: ee463571d7ce4684a040dc2941d67251 (127.6.120.193:41667)
I20260619 18:46:25.090654 6627 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.00611439s
I20260619 18:46:25.092963 15376 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48194
I20260619 18:46:25.107857 15521 heartbeater.cc:503] Master 127.6.120.254:38235 was elected leader, sending a full tablet report...
I20260619 18:46:25.117990 15376 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48212:
name: "client-testtb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "non_null_with_default"
type: INT32
is_key: false
is_nullable: false
read_default_value: "90\000\000"
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "imm_val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: true
}
}
num_replicas: 1
split_rows_range_bounds {
rows: "\004\001\000\t\000\000\000""\004\001\000\t\000\000\000"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 18:46:25.161446 15482 tablet_service.cc:1467] Processing CreateTablet for tablet fefc0698d17141868b9ed673cc0c5f93 (DEFAULT_TABLE table=client-testtb [id=902979b8568a4c5299a81471a9f93054]), partition=RANGE (key) PARTITION VALUES < 9
I20260619 18:46:25.161605 15481 tablet_service.cc:1467] Processing CreateTablet for tablet 85792b6389944669aa5fe7b51f5e2bd9 (DEFAULT_TABLE table=client-testtb [id=902979b8568a4c5299a81471a9f93054]), partition=RANGE (key) PARTITION 9 <= VALUES
I20260619 18:46:25.162912 15482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fefc0698d17141868b9ed673cc0c5f93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:25.163573 15481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 85792b6389944669aa5fe7b51f5e2bd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 18:46:25.182350 15531 tablet_bootstrap.cc:492] T fefc0698d17141868b9ed673cc0c5f93 P ee463571d7ce4684a040dc2941d67251: Bootstrap starting.
I20260619 18:46:25.187940 15531 tablet_bootstrap.cc:654] T fefc0698d17141868b9ed673cc0c5f93 P ee463571d7ce4684a040dc2941d67251: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:25.193307 15531 tablet_bootstrap.cc:492] T fefc0698d17141868b9ed673cc0c5f93 P ee463571d7ce4684a040dc2941d67251: No bootstrap required, opened a new log
I20260619 18:46:25.193782 15531 ts_tablet_manager.cc:1397] T fefc0698d17141868b9ed673cc0c5f93 P ee463571d7ce4684a040dc2941d67251: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260619 18:46:25.196344 15531 raft_consensus.cc:348] T fefc0698d17141868b9ed673cc0c5f93 P ee463571d7ce4684a040dc2941d67251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee463571d7ce4684a040dc2941d67251" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 41667 } }
I20260619 18:46:25.196903 15531 raft_consensus.cc:374] T fefc0698d17141868b9ed673cc0c5f93 P ee463571d7ce4684a040dc2941d67251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:25.197218 15531 raft_consensus.cc:729] T fefc0698d17141868b9ed673cc0c5f93 P ee463571d7ce4684a040dc2941d67251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee463571d7ce4684a040dc2941d67251, State: Initialized, Role: FOLLOWER
I20260619 18:46:25.197818 15531 consensus_queue.cc:260] T fefc0698d17141868b9ed673cc0c5f93 P ee463571d7ce4684a040dc2941d67251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee463571d7ce4684a040dc2941d67251" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 41667 } }
I20260619 18:46:25.198446 15531 raft_consensus.cc:388] T fefc0698d17141868b9ed673cc0c5f93 P ee463571d7ce4684a040dc2941d67251 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:46:25.198724 15531 raft_consensus.cc:482] T fefc0698d17141868b9ed673cc0c5f93 P ee463571d7ce4684a040dc2941d67251 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:46:25.199038 15531 raft_consensus.cc:3037] T fefc0698d17141868b9ed673cc0c5f93 P ee463571d7ce4684a040dc2941d67251 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:25.205720 15531 raft_consensus.cc:504] T fefc0698d17141868b9ed673cc0c5f93 P ee463571d7ce4684a040dc2941d67251 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee463571d7ce4684a040dc2941d67251" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 41667 } }
I20260619 18:46:25.206389 15531 leader_election.cc:302] T fefc0698d17141868b9ed673cc0c5f93 P ee463571d7ce4684a040dc2941d67251 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee463571d7ce4684a040dc2941d67251; no voters:
I20260619 18:46:25.207780 15531 leader_election.cc:288] T fefc0698d17141868b9ed673cc0c5f93 P ee463571d7ce4684a040dc2941d67251 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:46:25.208293 15533 raft_consensus.cc:2781] T fefc0698d17141868b9ed673cc0c5f93 P ee463571d7ce4684a040dc2941d67251 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:46:25.210392 15531 ts_tablet_manager.cc:1428] T fefc0698d17141868b9ed673cc0c5f93 P ee463571d7ce4684a040dc2941d67251: Time spent starting tablet: real 0.016s user 0.008s sys 0.009s
I20260619 18:46:25.211386 15531 tablet_bootstrap.cc:492] T 85792b6389944669aa5fe7b51f5e2bd9 P ee463571d7ce4684a040dc2941d67251: Bootstrap starting.
I20260619 18:46:25.218381 15533 raft_consensus.cc:686] T fefc0698d17141868b9ed673cc0c5f93 P ee463571d7ce4684a040dc2941d67251 [term 1 LEADER]: Becoming Leader. State: Replica: ee463571d7ce4684a040dc2941d67251, State: Running, Role: LEADER
I20260619 18:46:25.218847 15531 tablet_bootstrap.cc:654] T 85792b6389944669aa5fe7b51f5e2bd9 P ee463571d7ce4684a040dc2941d67251: Neither blocks nor log segments found. Creating new log.
I20260619 18:46:25.219146 15533 consensus_queue.cc:237] T fefc0698d17141868b9ed673cc0c5f93 P ee463571d7ce4684a040dc2941d67251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee463571d7ce4684a040dc2941d67251" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 41667 } }
I20260619 18:46:25.224786 15531 tablet_bootstrap.cc:492] T 85792b6389944669aa5fe7b51f5e2bd9 P ee463571d7ce4684a040dc2941d67251: No bootstrap required, opened a new log
I20260619 18:46:25.225278 15531 ts_tablet_manager.cc:1397] T 85792b6389944669aa5fe7b51f5e2bd9 P ee463571d7ce4684a040dc2941d67251: Time spent bootstrapping tablet: real 0.014s user 0.010s sys 0.000s
I20260619 18:46:25.226263 15375 catalog_manager.cc:5495] T fefc0698d17141868b9ed673cc0c5f93 P ee463571d7ce4684a040dc2941d67251 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee463571d7ce4684a040dc2941d67251 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "ee463571d7ce4684a040dc2941d67251" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee463571d7ce4684a040dc2941d67251" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 41667 } health_report { overall_health: HEALTHY } } }
I20260619 18:46:25.227960 15531 raft_consensus.cc:348] T 85792b6389944669aa5fe7b51f5e2bd9 P ee463571d7ce4684a040dc2941d67251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee463571d7ce4684a040dc2941d67251" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 41667 } }
I20260619 18:46:25.228591 15531 raft_consensus.cc:374] T 85792b6389944669aa5fe7b51f5e2bd9 P ee463571d7ce4684a040dc2941d67251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 18:46:25.228848 15531 raft_consensus.cc:729] T 85792b6389944669aa5fe7b51f5e2bd9 P ee463571d7ce4684a040dc2941d67251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee463571d7ce4684a040dc2941d67251, State: Initialized, Role: FOLLOWER
I20260619 18:46:25.229535 15531 consensus_queue.cc:260] T 85792b6389944669aa5fe7b51f5e2bd9 P ee463571d7ce4684a040dc2941d67251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee463571d7ce4684a040dc2941d67251" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 41667 } }
I20260619 18:46:25.230180 15531 raft_consensus.cc:388] T 85792b6389944669aa5fe7b51f5e2bd9 P ee463571d7ce4684a040dc2941d67251 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 18:46:25.230475 15531 raft_consensus.cc:482] T 85792b6389944669aa5fe7b51f5e2bd9 P ee463571d7ce4684a040dc2941d67251 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 18:46:25.230764 15531 raft_consensus.cc:3037] T 85792b6389944669aa5fe7b51f5e2bd9 P ee463571d7ce4684a040dc2941d67251 [term 0 FOLLOWER]: Advancing to term 1
I20260619 18:46:25.236965 15531 raft_consensus.cc:504] T 85792b6389944669aa5fe7b51f5e2bd9 P ee463571d7ce4684a040dc2941d67251 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee463571d7ce4684a040dc2941d67251" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 41667 } }
I20260619 18:46:25.237730 15531 leader_election.cc:302] T 85792b6389944669aa5fe7b51f5e2bd9 P ee463571d7ce4684a040dc2941d67251 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee463571d7ce4684a040dc2941d67251; no voters:
I20260619 18:46:25.238386 15531 leader_election.cc:288] T 85792b6389944669aa5fe7b51f5e2bd9 P ee463571d7ce4684a040dc2941d67251 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 18:46:25.238590 15533 raft_consensus.cc:2781] T 85792b6389944669aa5fe7b51f5e2bd9 P ee463571d7ce4684a040dc2941d67251 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 18:46:25.239426 15533 raft_consensus.cc:686] T 85792b6389944669aa5fe7b51f5e2bd9 P ee463571d7ce4684a040dc2941d67251 [term 1 LEADER]: Becoming Leader. State: Replica: ee463571d7ce4684a040dc2941d67251, State: Running, Role: LEADER
I20260619 18:46:25.240372 15531 ts_tablet_manager.cc:1428] T 85792b6389944669aa5fe7b51f5e2bd9 P ee463571d7ce4684a040dc2941d67251: Time spent starting tablet: real 0.015s user 0.011s sys 0.005s
I20260619 18:46:25.240242 15533 consensus_queue.cc:237] T 85792b6389944669aa5fe7b51f5e2bd9 P ee463571d7ce4684a040dc2941d67251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee463571d7ce4684a040dc2941d67251" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 41667 } }
I20260619 18:46:25.246393 15375 catalog_manager.cc:5495] T 85792b6389944669aa5fe7b51f5e2bd9 P ee463571d7ce4684a040dc2941d67251 reported cstate change: term changed from 0 to 1, leader changed from <none> to ee463571d7ce4684a040dc2941d67251 (127.6.120.193). New cstate: current_term: 1 leader_uuid: "ee463571d7ce4684a040dc2941d67251" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee463571d7ce4684a040dc2941d67251" member_type: VOTER last_known_addr { host: "127.6.120.193" port: 41667 } health_report { overall_health: HEALTHY } } }
I20260619 18:46:25.363279 6627 tablet_server.cc:178] TabletServer@127.6.120.193:0 shutting down...
I20260619 18:46:25.394389 6627 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260619 18:46:25.395397 6627 tablet_replica.cc:330] T 85792b6389944669aa5fe7b51f5e2bd9 P ee463571d7ce4684a040dc2941d67251: stopping tablet replica
I20260619 18:46:25.396246 6627 raft_consensus.cc:2229] T 85792b6389944669aa5fe7b51f5e2bd9 P ee463571d7ce4684a040dc2941d67251 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:25.396834 6627 raft_consensus.cc:2258] T 85792b6389944669aa5fe7b51f5e2bd9 P ee463571d7ce4684a040dc2941d67251 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:25.400435 6627 tablet_replica.cc:330] T fefc0698d17141868b9ed673cc0c5f93 P ee463571d7ce4684a040dc2941d67251: stopping tablet replica
I20260619 18:46:25.401135 6627 raft_consensus.cc:2229] T fefc0698d17141868b9ed673cc0c5f93 P ee463571d7ce4684a040dc2941d67251 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:25.401718 6627 raft_consensus.cc:2258] T fefc0698d17141868b9ed673cc0c5f93 P ee463571d7ce4684a040dc2941d67251 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:25.427366 6627 tablet_server.cc:194] TabletServer@127.6.120.193:0 shutdown complete.
I20260619 18:46:25.442072 6627 master.cc:537] Master@127.6.120.254:38235 shutting down...
I20260619 18:46:25.479319 6627 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 232645e589054a93998fa6c00f33ced6 [term 1 LEADER]: Raft consensus shutting down.
I20260619 18:46:25.479907 6627 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 232645e589054a93998fa6c00f33ced6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 18:46:25.480263 6627 tablet_replica.cc:330] T 00000000000000000000000000000000 P 232645e589054a93998fa6c00f33ced6: stopping tablet replica
I20260619 18:46:25.500484 6627 master.cc:552] Master@127.6.120.254:38235 shutdown complete.
[ OK ] Params/ClientTestImmutableColumn.TestUpsert/2 (881 ms)
[----------] 2 tests from Params/ClientTestImmutableColumn (1700 ms total)
[----------] Global test environment tear-down
[==========] 28 tests from 8 test suites ran. (102874 ms total)
[ PASSED ] 24 tests.
[ SKIPPED ] 3 tests, listed below:
[ SKIPPED ] ClientTest.TestScannerKeepAlive
[ SKIPPED ] MultiTServerClientTest.WriteWhileRestartingMultipleTabletServers
[ SKIPPED ] KeepAlivePeriodically/KeepAlivePeriodicallyTest.TestScannerKeepAlivePeriodicallyCrossServers/1
[ FAILED ] 1 test, listed below:
[ FAILED ] TableKeyRangeTest.TestGetTableKeyRange
1 FAILED TEST
I20260619 18:46:25.576252 6627 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/client/master_proxy_rpc.cc:203: suppressed but not reported on 5 messages since previous log ~3 seconds ago
I20260619 18:46:25.576606 6627 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/codegen/compilation_manager.cc:203: suppressed but not reported on 56 messages since previous log ~74 seconds ago
I20260619 18:46:25.576850 6627 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/ts_tablet_manager.cc:594: suppressed but not reported on 1 messages since previous log ~83 seconds ago
I20260619 18:46:25.577049 6627 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/ts_tablet_manager.cc:542: suppressed but not reported on 1 messages since previous log ~83 seconds ago
I20260619 18:46:25.577296 6627 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tablet/tablet_mm_ops.cc:221: suppressed but not reported on 2 messages since previous log ~639 seconds ago
I20260619 18:46:25.577497 6627 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tablet/tablet_mm_ops.cc:305: suppressed but not reported on 2 messages since previous log ~639 seconds ago
I20260619 18:46:25.577723 6627 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tablet/tablet_mm_ops.cc:140: suppressed but not reported on 366 messages since previous log ~39 seconds ago
I20260619 18:46:25.577961 6627 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tablet/tablet.cc:2369: suppressed but not reported on 20 messages since previous log ~10 seconds ago
I20260619 18:46:25.578194 6627 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/catalog_manager.cc:4584: suppressed but not reported on 2 messages since previous log ~88 seconds ago
I20260619 18:46:25.578418 6627 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 3 messages since previous log ~5 seconds ago