recommend_prompt_template_tests

Generate recommended test cases for a prompt template using a defined context schema and model, ensuring thorough validation for templates from codebases or new requirements.

Instructions

About this tool:

This tool is part of a toolchain that generates and provides test cases for a prompt template.
This tool generates an array of recommended tests for a given prompt template.

Parameters:

params: object
- promptTemplate: string (the prompt template to be tested)
- contextSchema: object (the context schema that defines the expected input parameters for the prompt template)
- promptOrigin: "codebase" | "requirements" (indicates whether the prompt comes from an existing codebase or from new requirements)
- model: string (the model that the prompt template will be tested against)

Example usage: { "params": { "promptTemplate": "The user wants a bedtime story about {{topic}} for a person of age {{age}} years old. Please craft a captivating tale that captivates their imagination and provides a delightful bedtime experience.", "contextSchema": { "topic": "string", "age": "number" }, "promptOrigin": "codebase" } }

The tool will return a structured array of test cases that can be used to test the prompt template.

Tool output instructions: - The tool will return a recommendedTests array that can be used to test the prompt template.

Input Schema

Name	Required	Description	Default
`params`	No

Input Schema (JSON Schema)

{
  "$schema": "http://json-schema.org/draft-07/schema#",
  "additionalProperties": false,
  "properties": {
    "params": {
      "additionalProperties": false,
      "properties": {
        "contextSchema": {
          "additionalProperties": {
            "type": "string"
          },
          "description": "The context schema that defines the expected input parameters for the prompt template. Use the `contextSchema` from the latest `create_prompt_template` tool output.",
          "type": "object"
        },
        "model": {
          "default": "gpt-4.1-mini",
          "description": "The model to use for generating actual prompt outputs for testing. Defaults to gpt-4.1-mini.",
          "type": "string"
        },
        "promptOrigin": {
          "description": "The origin of the prompt template, indicating where it came from (e.g. \"codebase\" or \"requirements\").",
          "enum": [
            "codebase",
            "requirements"
          ],
          "type": "string"
        },
        "temperature": {
          "default": 1,
          "description": "The temperature of the prompt template. Explicitly specify the temperature if it can be inferred from the codebase. Otherwise, defaults to 1.",
          "type": "number"
        },
        "template": {
          "description": "The prompt template to be tested. Use the `promptTemplate` from the latest `create_prompt_template` tool output (if available).",
          "type": "string"
        }
      },
      "required": [
        "template",
        "contextSchema",
        "promptOrigin"
      ],
      "type": "object"
    }
  },
  "type": "object"
}

CircleCI MCP Server