Advanced Level – Cross-Cutting
Test Oracle Problem – ISTQB Definition
Last Updated: July 12, 2026 · SoftwareTestPilot QA Team
Official ISTQB Definition
The difficulty of determining whether the actual output of a test corresponds to the expected result, especially for complex systems.
In simple words
The struggle of knowing whether the test passed when the correct answer is hard to compute.
Exam tip
Metamorphic testing and property-based testing are two approaches to the oracle problem.
Related terms
- Test OracleWhatever tells you what the ‘right’ answer should be — a requirement, a spec, a previous version, or even an experienced user.
- Property-Based TestingInstead of writing example tests, describe rules that should always hold and let the tool try 1000s of inputs.
- Metamorphic TestingInstead of asserting an exact answer, assert that changing the input in a known way changes the output in a known way.
Practice this term in the ISTQB Mock Test
40 CTFL v4.0 questions, 60-minute timer, instant scoring and chapter-wise breakdown.
Practice in Mock Test