How to evaluate a fractional CAIO before you sign

The fractional Chief AI Officer market has grown fast, and fast-growing markets attract people whose main qualification is having noticed the market. The title costs nothing to claim. So before you sign a retainer of $5k to $30k a month, which is the going range, you owe yourself thirty minutes of pointed questions.

We publish this list knowing we have to pass it ourselves. That is rather the point. A candidate who bristles at any question below has answered it.

If you are still comparing the role against alternatives, read Fractional CAIO vs AI consultant vs fractional CTO first. This article assumes you know you want the role and are choosing the person.

The ten questions

1. Do you earn anything from the tools you will recommend? Referral fees, reseller margin, affiliate commissions, equity in vendors. This is the single most important question on the list. An adviser who earns margin on what you buy is conflicted by design, however honourable the individual. The worrying answer is anything other than a flat no, in writing. “I sometimes partner with vendors” means the recommendations are a sales channel.

2. Who else are you working with right now? Fractional executives serve several companies, which is fine. What you need to know is whether any client is your direct competitor, what information boundaries exist, and whether their calendar has room for you. The worrying answer is vagueness about capacity, or a client list they will not characterise even in general terms.

3. What did your last engagement deliver, in numbers? Not “implemented an AI strategy”. Numbers: spend recovered, hours saved, revenue attributed, a project shipped by a named date. The worrying answer is a story with no figures in it. Anyone who has done this work can describe one engagement concretely without breaching confidence.

4. What will I hold in my hands at day 90? There is a right answer, and it is specific: an inventory of tools and spend, a ranked decision agenda, one scoped initiative in flight, a written governance baseline. We describe the full sequence in What a fractional CAIO does in the first 90 days. The worrying answer is a discovery phase of unstated length, or deliverables that are all meetings.

5. Who actually delivers? Some fractional offerings are one senior person; others are a senior face with junior delivery behind it. Neither is wrong, but you should know which you are buying, because the judgment you are paying for does not delegate. The worrying answer is discovering the team after signing.

6. What is your governance qualification? Customer questionnaires, board scrutiny, and in some markets regulation now demand written AI governance. Ask what formal grounding the candidate has, for instance the IAPP’s Artificial Intelligence Governance Professional certification, which covers AI law, risk, and governance practice. Experience can substitute for a certificate, but it must be demonstrable: ask to see a governance baseline they have written, redacted if needed. The worrying answer is treating governance as paperwork someone else handles.

7. Have you presented to a board? If board pressure is part of why you are hiring, the person must be credible in that room, and that is a skill acquired only by being in it. Ask for the shape of a board update they have given. The worrying answer is fluency about technology and silence about capital allocation.

8. When did you last tell a client not to build something? The economics of the role reward activity, so the strongest signal of independence is a documented no: a project killed, a vendor rejected, a retainer ended early because the job was finished. The worrying answer is that every engagement led to more engagement.

9. How do we exit? Notice period, handover artefacts, who owns the documents, what happens to accounts and access. A confident adviser makes leaving easy because the deliverables stand on their own. The worrying answer is a long lock-in, or documents that live in the adviser’s systems rather than yours.

10. Where does our information go when you work on it? The person advising you on AI data risk should be able to state, immediately, which tools they run your material through and under what terms. This is the question that catches performers, because it tests whether they apply their own advice. The worrying answer is a pause.

What the list is really testing

Read back through the ten and a pattern shows: every worrying answer is a version of misaligned incentive. Commissions misalign recommendations. Overbooked calendars misalign attention. Vague deliverables misalign accountability. Hard exits misalign the whole relationship. You are not testing intelligence, which most candidates will have. You are testing whether the person profits from anything other than being right.

That is also the honest disclosure of where we sit. Attain sells advice and nothing else, no implementation, no reselling, no referral income, which means this list is one we constructed to be able to pass. Ask us these questions on a fit call and compare the answers with anyone else you are evaluating. The comparison is the service, and it costs nothing.