Resource: EvaluationExpectation
An evaluation expectation represents a specific criteria to evaluate against.
| JSON representation |
|---|
{
"name": string,
"displayName": string,
"tags": [
string
],
"createTime": string,
"updateTime": string,
"etag": string,
// The following is a list of mutually exclusive fields. At most one of the
// fields will be set in a response:
"llmCriteria": {
object ( |
| Fields | |
|---|---|
name |
Identifier. The unique identifier of this evaluation expectation. Format: |
displayName |
Required. User-defined display name. Must be unique within the app. |
tags[] |
Optional. User-defined tags for expectations. Can be used to filter expectations. |
createTime |
Output only. Timestamp when the evaluation expectation was created. Uses RFC 3339, where generated output will always be Z-normalized and use 0, 3, 6 or 9 fractional digits. Offsets other than "Z" are also accepted. Examples: |
updateTime |
Output only. Timestamp when the evaluation expectation was last updated. Uses RFC 3339, where generated output will always be Z-normalized and use 0, 3, 6 or 9 fractional digits. Offsets other than "Z" are also accepted. Examples: |
etag |
Output only. Etag used to ensure the object hasn't changed during a read-modify-write operation. If the etag is empty, the update will overwrite any concurrent changes. |
| The definition of the criteria used for evaluation. The following is a list of mutually exclusive fields. At most one of the fields will be set in a response: | |
llmCriteria |
Optional. Evaluation criteria based on an LLM prompt. |
| End of mutually exclusive fields. | |
EvaluationExpectation.LlmCriteria
Configuration for LLM-based evaluation criteria.
| JSON representation |
|---|
{ "prompt": string } |
| Fields | |
|---|---|
prompt |
Required. The prompt/instructions provided to the LLM judge. |
Methods |
|
|---|---|
|
Creates an evaluation expectation. |
|
Deletes an evaluation expectation. |
|
Gets details of the specified evaluation expectation. |
|
Lists all evaluation expectations in the given app. |
|
Updates an evaluation expectation. |