The Phoenix Checklist
I’ve created this page so I can gain quick and simple access to a set of questions I use A LOT. This list of questions was originally developed by the CIA as a way of guiding the thinking of operatives when they face a problem. I use this checklist to help form some thoughts around my test approaches and testing. It might work for you. It might not.
Why is it necessary to solve the problem?
What benefits will you receive by solving the problem?
What is the unknown?
What is it you don’t yet understand?
What is the information you have?
What isn’t the problem?
Is the information sufficient? Or is it insufficient? Or redundant? Or contradictory?
Should you draw a diagram of the problem? A figure?
Where are the boundaries of the problem?
Can you separate the various parts of the problem? Can you write them down? What are the relationships of the parts of the problem? What are the constants of the problem?
Have you seen this problem before?
Have you seen this problem in a slightly different form? Do you know a related problem?
Try to think of a familiar problem having the same or a similar unknown
Suppose you find a problem related to yours that has already been solved. Can you use it? Can you use its method?
Can you restate your problem? How many different ways can you restate it? More general? More specific? Can the rules be changed?
What are the best, worst and most probable cases you can imagine?
Can you solve the whole problem? Part of the problem?
What would you like the resolution to be? Can you picture it?
How much of the unknown can you determine?
Can you derive something useful from the information you have?
Have you used all the information?
Have you taken into account all essential notions in the problem?
Can you separate the steps in the problem-solving process? Can you determine the correctness of each step?
What creative thinking techniques can you use to generate ideas? How many different techniques?
Can you see the result? How many different kinds of results can you see?
How many different ways have you tried to solve the problem?
What have others done?
Can you intuit the solution? Can you check the result?
What should be done? How should it be done?
Where should it be done?
When should it be done?
Who should do it?
What do you need to do at this time?
Who will be responsible for what?
Can you use this problem to solve some other problem?
What is the unique set of qualities that makes this problem what it is and none other?
What milestones can best mark your progress?
How will you know when you are successful?