How Do I Practice an Interview With an AI Agent That Marks My Answers?
Build an AI agent in Gumloop that asks your interview questions one at a time, waits for your answer, and marks it against a rubric you wrote.
Give a Gumloop AI agent your question list for one role and a three-line rubric you wrote. It asks one question at a time in the chat, waits for your typed or dictated answer, marks it against your rubric and quotes your own words back. Its instructions tell it not to predict whether you'll get the job.
You're deep into an answer when you see the interviewer stop writing. The question was about a time you disagreed with a manager, and somewhere early on you started giving the history of the whole project. From inside the answer, you couldn't see where it should have ended.
Practice fixes this, but only when something marks the answer against a standard you set before you started. A friend says "that was good", and you still don't know whether it had a result or ran long.
What should a three-line rubric ask of an answer?
One sentence per line, written by you. Did the answer respond to the question that was asked? Was there a result? How long did it run?
The first two need your definitions. For the first, write the test, such as "the opening sentence responds to what was asked". For the second, say what counts, such as a number or a decision someone made. Length needs a word limit.
Length is counted in words because the AI agent receives the text of what you dictate and not the recording. To set the limit, say aloud an answer you'd be glad to give in the room, count its words, and use that count.
What do you paste into the instructions for the practice interview?
Brackets are yours to fill.
You're my practice interviewer for the [ROLE TITLE] role at [COMPANY]. I'll give you a numbered list of questions in my first message. Ask one question at a time, in the order I gave them, and then stop and wait for my answer. I'll type it or dictate it. Don't answer for me, and don't offer a better answer unless I ask. After each answer, mark it against my rubric. Add no criteria of your own. Answered the question: [YOUR TEST FOR AN ANSWER THAT RESPONDS TO WHAT WAS ASKED]. Mark yes, partly or no. Result: [WHAT COUNTS AS A RESULT]. Mark yes or no. Length: my limit is [WORD LIMIT] words. Count the words in my answer, give the count, and mark over or within. Under each mark, quote the words of mine that earned it, or write "no words of mine support this". Then ask whether I want to try that question again or move to the next one. Don't predict whether I'll be hired, and don't compare me with other candidates. Don't search the web and don't contact anyone. If I ask for a question that isn't on my list, say so and ask whether to add it.
How do you get from a blank AI agent to the first question?
- 01
Write the questions for one named role.
List the questions you expect, numbered, for a single role at a single company. How Do I Decode a Job Posting With an AI Agent? ranks what the posting asks. Put the pay question on the list too, and How Do I Script a Salary Counter-Offer With an AI Agent? covers the answer.
- 02
Write the three rubric lines before you open anything.
Settle your test for an answer that responds, what counts as a result and the word limit from the section above, and type them into the brackets of the block.
- 03
Start the AI agent and paste the block.
Open Gumloop, start a new AI agent and paste the filled block into the instructions box on the tab named Agent, then press Save. Checked on 2026-11-09 against Gumloop's AI agent documentation.
- 04
Switch off Ask Question, Web Search and Web Fetch.
Ask Question lets the AI agent pause and ask a structured, multiple-choice question. Your practice runs in the chat, where you answer in your own words, so turn it off in the Abilities section of the tab named Agent, along with Web Search and Web Fetch. Add no connectors. Checked on 2026-11-09 against the abilities table in Gumloop's AI agent documentation.
- 05
Stop "go easier on me" from rewriting your rubric.
The Edit Own Instructions toggle sits below the instructions box and is on by default. With it on, a correction you give in the chat can be written into the instructions and keep applying to later tasks. "Go easier on me" is a correction. Turn it off, press Save again, and sharpen the rubric by editing the box. Checked on 2026-11-11 against the builder and self-improving instructions sections of Gumloop's AI agent documentation.
- 06
Answer the question you know you ramble on.
Start a task and paste your numbered list as the first message. Pick the question where you know you run long, click the microphone button at the right of the message bar and answer aloud. Select Stop dictation, read the draft that streamed in, and send it. The length mark should say over. Paste your answer into any word counter and compare it with the count the AI agent gave. Checked on 2026-11-09 against the voice input section of Gumloop's AI agent documentation.
I am an ambassador for Gumloop. Code JOBSEARCHAGENTS takes 20% off your first month.
Which marks should you trust?
Trust the quotes first. A quote under a mark that isn't in your answer makes that mark no good. Reread the other marks on that answer against your rubric.
Test the result line against a real answer. Take one answer you gave that had a result and one that didn't, and see whether "Result" agrees with your own definition. If it marks a result where you only had a good feeling, tighten what counts in the block.
Retry the same question and watch the length mark. A second attempt should bring the word count down.
Once the questions feel steady, read How Do I Draft a 30-60-90 Day Plan for a Final Round With an AI Agent? for the question a final round adds.
Frequently asked questions
Can it ask follow-up questions the way a real interviewer would?
It's told to ask from your list, so add the follow-ups you expect. If you ask for a question that isn't there, it says so and asks whether to add it.
What if I'd rather type than talk?
Type. The marks work the same either way. Use the microphone when you want to practice saying the answer aloud.
Does a good mark mean I'll do well in the real interview?
A mark says your answer met the three tests you wrote. The AI agent has no view of what an interviewer will weigh.