Advanced – AI & ML Testing
LLM Testing – ISTQB Definition
Last Updated: July 12, 2026 · SoftwareTestPilot QA Team
Official ISTQB Definition
Testing of large language model applications covering prompt behavior, hallucination rate, safety guardrails, latency, and cost.
In simple words
Testing ChatGPT-style apps — accuracy, safety, cost, and speed.
Exam tip
LLM testing typically uses evaluation datasets, LLM-as-judge scoring, and regression baselines rather than exact-match assertions.
Related terms
- AI TestingTesting apps built on AI models — including whether the model itself gives good answers.
- Prompt TestingTesting whether your prompts reliably produce the answers you want.
- HallucinationWhen the AI makes stuff up but sounds sure about it.
- Guardrail TestingTesting the safety filters that stop the AI from saying harmful or off-topic things.
Practice this term in the ISTQB Mock Test
40 CTFL v4.0 questions, 60-minute timer, instant scoring and chapter-wise breakdown.
Practice in Mock Test