Skip to content
Use cases · Product

AI skills test for product managers, on a real decision.

A good product manager with AI uses it to read everything, and still makes the call. They say no in writing, and the decision holds up when someone asks why.

Try it free on 3 candidates.

Who the product manager AI skills test is for

  • Product managers
  • Growth product managers

People who decide what gets built in a software product, and why. They work with design and engineering, talk to customers, read the data, and write the decision down so the team can act on it.

LevelJunior to staff

Hiring a technical or platform product manager, or for product operations?Bring your own task

An example AI skills task for product managers

One of our product tasks. Your dashboard has the rest, and you can bring your own.

The brief

Decide an onboarding release

New users drop off during onboarding. Decide what goes into the next release, and what does not, and write it up for the team.

You have 15 customer interviews, the funnel data, a feature request from sales and a compliance rule. They do not all point the same way.

Then make the same decision for your enterprise customers.

Files
  • 15 interview notes
  • Funnel data for the last quarter
  • A request from sales
  • A compliance rule
Time
  • Deadline Fri 24 Oct
Work in
  • ChatGPT
  • Claude Cowork
  • Where AI goes wrongEvery task has a few spots where AI typically gets it wrong. That’s how you see who checks the work.
  • The part that repeatsAfter the first decision, they make the same one for enterprise customers. You see whether they reuse what they built the first time, or start again by hand.
  • TimeYou set it: a deadline, a time limit, or both. We recommend a deadline and no time limit, so they work the way they would in the job.
  • Where they workChatGPT or Claude Cowork, on their own computer or in the browser.
  • All tasks

The AI skills we look for in product managers

Plus the skills for the job Read from the same task.
  • Prioritising with evidence
  • Saying no in writing
  • A decision others can follow

What you get for each product candidate

Jordan ChenProduct manager · Task: Decide an onboarding release · Claude Cowork · 3 h 05 min
Checked by Lemonsignal
72%Good match, one open question
  • Ranked the problems before asking for a plan.
  • Cut the AI’s plan down to two changes, with reasons.
  • Said no to sales in writing.
  • Understand Strong Ranked the problems by drop-off before asking for a plan. Turn 2
  • Brief Solid Gave it all four inputs and the rule that cannot move. Turn 4
  • Check Solid Tested each change against the funnel. Turn 11
  • Correct Solid Said what was wrong with the AI’s plan, and asked for two changes only. Turn 12
  • Sign off Strong Two changes, and a no to sales in writing, with the reason.
  • Reuse Partial Started the enterprise decision from scratch, and the ranking drifted. Turns 20 to 31
Skills for the job
  • Prioritising with evidenceAbove the bar
  • Saying no in writingAbove the bar
  • A decision others can followAt the bar

Questions about testing product managers’ AI skills

Does the task need product tools like Jira or Linear?

No. Everything they need is in the files. If they like to plan in Jira or Linear, they can use them too. We read their conversation with the AI and what they hand in.

Is there one right answer for a product decision?

There is a right answer on the facts, and the scoring sheet says which choices the evidence supports. Beyond that, your team judges how well the decision is argued when they watch the session.

Can we use our own product data?

Yes. Bring your own task and we set it up with you, with the places where AI tends to go wrong and the scoring sheet.

30 Interview questions to see who’s good with AIStart with the product questions, with what a good answer sounds like.

Test how well product managers use AI.

Try it free on 3 candidates.