Evaluation.ScenarioExpectation

The expectation to evaluate the conversation produced by the simulation.

JSON representation 
{

  // The following is a list of mutually exclusive fields. At most one of the
  // fields will be set in a response:
  "toolExpectation": {
    object (Evaluation.ScenarioExpectation.ToolExpectation)
  },
  "agentResponse": {
    object (Message)
  }
  // End of mutually exclusive fields.
}
Fields
The expectation to evaluate the conversation produced by the simulation. The following is a list of mutually exclusive fields. At most one of the fields will be set in a response:
toolExpectation

object (Evaluation.ScenarioExpectation.ToolExpectation)

Optional. The tool call and response pair to be evaluated.
agentResponse

object (Message)

Optional. The agent response to be evaluated.
End of mutually exclusive fields.

Evaluation.ScenarioExpectation.ToolExpectation

The tool call and response pair to be evaluated.

JSON representation 
{
  "expectedToolCall": {
    object (ToolCall)
  },
  "mockToolResponse": {
    object (ToolResponse)
  }
}
Fields
expectedToolCall

object (ToolCall)

Required. The expected tool call, with the parameters of interest specified. Any parameters not specified will be hallucinated by the LLM.
mockToolResponse

object (ToolResponse)

Required. The tool response to mock, with the parameters of interest specified. Any parameters not specified will be hallucinated by the LLM.