Five Questions to Ask Before Starting Any AI Project
Five essential questions before any AI project, including how to account for the tacit knowledge your experienced people rely on.
Why These Questions Matter Before Any AI Project
Before starting any AI project, the questions that matter most are not technical; they are foundational. We’ve seen millions spent on AI initiatives that were doomed from the start, not because the technology was wrong, but because nobody paused to think critically about the fundamentals.
Here are five questions we ask at the start of every engagement. They’re simple, but the answers are revealing.
The five questions
The fundamentals worth resolving before any technical work begins.
- Problem. What specific, measurable problem are you solving?
- Process. How are you solving it today, and what tacit knowledge holds it together?
- Success. What does success look like, defined in advance with clear metrics?
- Data. Do you have the right data, in sufficient quantity and quality?
- Users. Who will use the system, and do they want it?
1. What Specific Problem Are You Solving?
Not “we want to use AI” or “we need to be more innovative.” What specific, measurable problem is causing pain today?
Good answer: “Our review team misses 12% of issues because they’re handling 200 cases per hour.”
Bad answer: “We want to leverage AI to transform our operations.”
If you can’t articulate the problem in one sentence, you’re not ready to start.
2. How Are You Solving It Today?
Understanding the current process, including the humans involved and the expertise they bring, is essential. This tells you:
- What’s actually working (and shouldn’t change)
- Where the genuine bottlenecks are
- What expertise needs to be preserved or augmented
Pay particular attention to the knowledge that is not written down anywhere. Every organisation has people whose experience makes them disproportionately effective: who can read a situation quickly, who know which edge cases matter, whose judgement has been calibrated by years of exposure to the problem. This tacit knowledge is often the most important input to how the process actually works, and it is the part most likely to be ignored when someone maps current-state workflows on a whiteboard.
Skip this step and you risk automating the wrong things.
3. What Does Success Look Like?
Define your metrics before you build anything. Be specific:
- Accuracy: What error rate is acceptable?
- Speed: How much faster does it need to be?
- Cost: What ROI are you targeting, and over what timeframe?
- Adoption: What percentage of your team needs to use it?
Without clear success criteria, you’ll never know whether your project actually delivered value.
4. Do You Have the Right Data?
AI needs data. But not just any data: the right data, in sufficient quantity, with adequate quality. Before committing to an AI approach, assess:
- Availability: Do you actually have the data, or do you need to start collecting it?
- Quality: Is it clean, consistent, and well-labelled?
- Volume: Do you have enough for the approach you’re considering?
- Bias: Does your data represent the full range of scenarios you’ll encounter?
Data problems are the single most common reason AI projects stall after kickoff.
5. Who Will Use It, and Do They Want It?
The best AI system in the world is worthless if nobody uses it. Understanding your end users is critical:
- What’s their current skill level with technology?
- Are they threatened by or enthusiastic about AI?
- How will it integrate with their existing workflow?
- What training and support will they need?
The human element isn’t a nice-to-have; it’s the difference between a successful deployment and expensive shelfware.
Use This Framework Before Every AI Project
Print these questions out. Put them on a whiteboard. Make them the first slide in every AI project kickoff. They won’t guarantee success, but they’ll dramatically reduce the probability of failure.
If after working through them you want a more structured evaluation of your organisation’s readiness, our AI readiness assessment covers these dimensions and more in a formal engagement.
Want help working through these questions for your organisation? We’re here to help.
FAQ
Frequently asked questions
What are the most important questions to ask before starting an AI project?
The five most important questions are: what specific problem are you solving (with measurable definition), how are you solving it today, including what tacit knowledge your experienced people apply, what does success look like (defined in advance with clear metrics), do you have the right data, and who will use the system and do they want it. Answering these before any technical work dramatically reduces the risk of failure.
What is tacit knowledge and why does it matter before starting an AI project?
Tacit knowledge is the practical expertise that experienced practitioners carry: the judgements they make instinctively, the patterns they recognise before they can articulate why, the edge cases they know to watch for. It matters before starting an AI project because it often constitutes the most important part of how a process actually works, yet it is invisible on process maps and rarely captured in data. AI designed without accounting for it risks automating around the very thing that makes the current process effective.
How do you know if your organisation is ready to start an AI project?
An organisation is ready to start AI when it can clearly articulate the specific problem it is solving, has or can access the right data, has defined success criteria in advance, and understands the human expertise the system needs to work with. If any of these are unclear, a structured AI readiness assessment is worth doing before committing to build.
Work with us
Want to apply this in your organisation?
Tell us what you are working on and we will map practical next steps for your team.