impl-tool:measurement

impl-tool:measurement@0.0.0

modelRunRecord

FieldTypeRequiredDefaultDescription
taskstringYesThe kind of call this was, as the runner names its tasks -- iteration for a session turn, pr_description for a pull request description
providerstringYesThe agent that served the call, by its configured name
modelstringNo""The model that answered; empty where the provider names none
attemptintegerNo1Which try at the task this call was, counted from 1
outcomeenum one of ok, invalid, errorYesHow the call ended: ok when it answered and the answer validated, invalid when it answered and the answer did not validate, error when the call itself failed
elapseddurationYesHow long the call ran
promptCharsintegerNo0Size of the prompt sent, in characters; 0 where it was not measured
responseCharsintegerNo0Size of the answer received, in characters
tokensintegerNo0Tokens the call consumed as the provider reported them, with input, output, cache reads and cache writes summed. 0 means the provider reported no usage, not that the call was free
inputTokensintegerNo0Input tokens the provider reported, counted apart from cache reads and cache writes
outputTokensintegerNo0Output tokens the provider reported
cacheReadTokensintegerNo0Tokens the provider reported as read from its prompt cache
cacheWriteTokensintegerNo0Tokens the provider reported as written to its prompt cache
scopestringNo"."The repository the call was made for: . for the top-level repository, otherwise the submodule's path
issuestringNo""The id of the issue the call was made for, as it was spelled at the time; empty where the call belonged to no issue
atstringNo""When the call ended, as an ISO 8601 timestamp to the second
detailstringNo""Why the answer was rejected or the call failed; empty for a call that succeeded
datedateNo"0001-01-01"The day the call ran, in the configured timezone
timeStartedtimeNo"00:00:00"When the call began, timezone included
timeEndedtimeNo"00:00:00"When the call finished, timezone included
weightedTokensnumberNo0The consumption in input-equivalent tokens
planCostcurrencyValueNo0The estimated share of the subscription the call consumed
tokenCostcurrencyValueNo0What the tokens cost as metered spend
iterationintegerNo-1The session turn the call belongs to, numbered from 0; -1 where no turn owns the call
incrementintegerNo-1The commit increment the call belongs to, numbered from 0; -1 where it belongs to none
succeededbooleanNofalseWhether the work landed. For a session turn: its result parsed and its commit and push completed. For any other call: the answer satisfied its contract
planObservednumberNo0Used percentage of the account's seven-day plan window, as last read when the row was written; 0 means no fresh reading was on hand
sessionUuidstringNo""Identifier of the runner session the call was made in; empty where it ran outside one
invocationUuidstringNo""Identifier of the impl-tool invocation that made or recorded the call; empty where there was none
conversationUuidstringNo""Identifier the provider gives the conversation the call belonged to; empty where the provider has none
issueUuidstringNo""The issue's permanent identifier, taken from its queue entry; empty where the run carried none
ratingnumberNo0A quality score for the run. Reserved: nothing writes it, and 0 means unrated

modelRunLog

FieldTypeRequiredDefaultDescription
runslist[modelRunRecord]No[]Every call on record, one entry per call

modelRunSummary

FieldTypeRequiredDefaultDescription
taskstringYesThe task the calls served
providerstringYesWhich backend served them
modelstringNo""Which model, empty where the provider names none
callsintegerNo0How many calls the group holds
okintegerNo0How many answers satisfied their contract
secondsnumberNo0Total elapsed over the group, in seconds
promptCharsintegerNo0Total prompt size over the group
tokensintegerNo0Total measured tokens; zero means unmeasured, not free
weightedTokensnumberNo0Total consumption in input-equivalent tokens
planObservednumberNo0The account reading stamped on the latest row
planDerivednumberNoThe tokens as a share of the plan window, once priced
planCostnumberNoThe share in subscription dollars, once priced
tokenCostnumberNo0Total metered dollars over the group
planSpentnumberNo0Total stamped plan dollars over the group

modelTiming

FieldTypeRequiredDefaultDescription
taskstringYesThe task the calls served
providerstringYesThe agent that served them
modelstringNo""The model that answered; empty where the provider names none
callsintegerYesHow many calls the group holds
okintegerNo0How many of the calls returned an answer that satisfied its contract
elapseddurationYesTotal time the calls ran, summed over the group
promptCharsintegerNo0Total prompt size over the group, in characters
tokensintegerNo0Total tokens the providers reported over the group; 0 means unmeasured, not free
weightedTokensnumberNo0Total consumption in input-equivalent tokens, each kind of token weighted by its price relative to an input token
planDerivednumberNo0The group's tokens as an estimated percentage of the plan's weekly window; 0 means not priced
planCostnumberNo0That share in subscription dollars, at the rates in force when the table was made; 0 means not priced
planSpentnumberNo0Plan dollars stamped on each call when it was made, summed over the group
tokenCostnumberNo0Metered dollars summed over the group; 0 while the account is inside its plan limits
planObservednumberNo0Used percentage of the plan window as read when the group's latest call was recorded; 0 means no fresh reading

timingDisplay

FieldTypeRequiredDefaultDescription
unitenum one of microseconds, milliseconds, seconds, minutes, hoursNo"milliseconds"The unit rendered durations are read in

column

FieldTypeRequiredDefaultDescription
namestringYesThe column's name in its table
ddlstringYesThe column's SQL declaration: its type, constraints and default
fillstringYesThe SQL literal a query fills the column with for a row that does not carry it
fieldstringNo""The record field the column stores; empty for a column that stores none
kindstringNo"plain"How a value converts between the field and the column: plain passes through, stamp stores a timestamp as text, micros stores a duration as whole microseconds, bool stores 0 or 1, and currency_value and currency_code store the two halves of a currency amount

checkRun

FieldTypeRequiredDefaultDescription
uuidstringYesThe run's own identifier, assigned when the command ran; a run is filed once under it
issuestringYesThe id of the issue the run was made for, as spelled when the row was filed
issueUuidstringNo""The issue's permanent identifier; empty where the session's launch carried none
incrementintegerNo0The commit increment of the turn that ran it; for a turn that committed nothing, the increment of the commit that lands its work
kindenum one of check, testNo"check"Whether the run was one of the gate's checks (check) or a test run (test)
namestringYesThe command and the flags it was given, as the gate names the check
argumentsstringNo""The rest of what the run was given, as it would be typed -- a test run's selection and tiers, whether it crossed into pinned repositories. A withheld or overlong argument is named without its value
repositorystringNo"."The checkout the run acted on, relative to the run's root: . for the root itself
startedAtdatetimeYesWhen the run started
elapseddurationYesHow long the run took, measured by the tool that ran it
exitCodeintegerNo0The exit code the command ended with
passedbooleanNofalseWhether the run exited 0

checkAverage

FieldTypeRequiredDefaultDescription
kindenum one of check, testNo"check"Whether the runs were of one of the gate's checks (check) or test runs (test)
namestringYesThe check as the gate names it: the command and the flags it was given
argumentsstringNo""The rest of what the runs were given, as it would be typed
repositorystringNo"."The checkout the runs acted on, relative to the run's root: . for the root itself
runsintegerYesHow many runs of the check are filed for the issue
passedintegerNo0How many of those runs exited 0
elapseddurationYesTotal time the runs took, summed; divide by runs for the average