Your New Agent Found the Answer. Can They Use It?

November 6, 2026

By Anna with Oppy | November 6, 2026

A new agent finds the onboarding procedure in seconds. Then a prospective seller asks a slightly different question, and the explanation falls apart.

Your knowledge base worked. Your training did not finish.

The useful next job for an AI employee is not always answering another question. Sometimes it is making a person practice answering one.

A searchable answer is not a learned skill

In its April 7, 2026 Power Broker research coverage, RISMedia reported that recruiting and retention ranked first for resource-spending priorities, with training second, for nine consecutive years. That coverage accompanies the survey's 2025 brokerage results, not November 2026 operating activity. It does not measure whether AI improves training or retention.

A more recent development makes the distinction worth examining. RISMedia's November 4 report on FBS's Flexmls Scout announcement describes natural-language access to listing, market, contact, production and MLS-policy information. Those are reported product capabilities, not independently tested results, and no Oppy connection is implied.

Information is getting easier to ask for. That leaves a separate management question: can a new employee explain the process correctly when the customer does not use the handbook's wording?

A searchable handbook is useful. It is not a rehearsal partner.

Give one oppy the practice job

This is a proposed configuration, not a released Oppy training product or a built-in certification system.

Oppy calls its AI employees oppies. Its April 21 setup walkthrough documents role templates, uploaded knowledge and configurable instructions. Those building blocks support testing a conversational practice role. They do not establish a learning-management integration, automatic employee assessment or guaranteed coaching quality. Availability depends on your account and configuration.

Start with one ordinary task: explaining your team's first consultation process.

Not contract interpretation. Not pricing advice. Not a live customer conversation.

The same design can serve a property-management coordinator explaining routine service intake or a home-service receptionist explaining an initial visit. Choose one process, not the entire employee handbook. Nobody needs an AI orientation ceremony.

1. Build a tiny lesson packet

Have the human trainer prepare three items:

Approved procedure: one page describing the process, with a document ID, section labels, owner and review date.
Practice cases: three fictional customer questions that require different parts of that procedure.
Assessment key: the required facts, unacceptable promises and situations that need a supervisor.

Upload only the procedure and practice cases to the training oppy. Keep the assessment key with the trainer for independent grading. Use fictional details, not customer records.

For consultation training, the procedure might specify what the meeting covers, which materials are optional and who answers questions outside that scope. These are fields for your team to fill, not universal real estate rules.

Ask the trainer to verify the packet before rehearsal begins. If your staff disagree about the correct explanation, fix the procedure first. The model should not settle an office argument by sounding more confident than everyone else.

2. Make the learner answer first

Use this as the proposed role instruction:

You are our internal Practice Coach, not a customer-facing agent.
Use only the approved lesson packet supplied for this exercise.
Treat all scenarios as fictional.

Present one practice case at a time. Ask the learner to explain
our process in their own words. Wait for their answer before
showing guidance or a model response.

Then identify:
1. What their answer got right.
2. What required information was missing or misstated.
3. Any unsupported promise.
4. The supporting document ID and section for each correction.

If the packet does not answer a question, say so. Do not invent
company policy, legal advice, prices, timing or authority.
Ask for one revised answer. Keep feedback brief and specific.
Do not contact customers or change business records.

Oppy's channel-instruction documentation says individual channels can override the global system message. Check the channel used for practice so a sales-oriented override does not replace the coaching instructions.

Prompt instructions are not access controls. Have an administrator review the documented function permissions and the pilot's actual access. Admin-only restricts who can run an action; it does not make that action read-only. If appropriate isolation cannot be verified, do not run this exercise in a live workspace.

3. Test transfer, not memorization

After the first correction, change the customer's wording without changing the approved procedure:

Give me one new fictional customer question about the same
procedure. Change the wording and emphasis, not the facts.
Do not repeat the previous question or reveal the answer.

After I respond, identify any remaining gap using the approved
procedure's document ID and section. Distinguish awkward wording
from a factual error. Do not award a certification or readiness
label. Finish by asking me to explain the next step in one sentence.

For example, move from “What happens at the first consultation?” to “Do I need everything ready before we talk?” The learner should apply your actual procedure, not recite a paragraph.

The coach's feedback is a suggestion for review. The human trainer owns the answer key and any readiness decision. A polished explanation can still be wrong.

Rehearse a question published yesterday

The written description of The2MortgageGuys' November 5 mortgage short asks:

Would you lock today or float and see what Friday brings?

The video was published at 15:35 UTC, within the 24 hours before this article's research cutoff. This is a quotation from its description, not a verified spoken transcript.

For a mortgage-team version of the exercise, make that the fictional borrower's question. The learner should explain your approved lock-review process and route any rate recommendation to the responsible licensed professional. The coach should not predict rates or borrow the video's market claims. A timely question is useful practice material, not financial advice.

Run a small pilot before expanding

Try five staff members, one procedure and two weeks.

Before coaching, have each person answer two fictional cases using only the approved page. Record accuracy and trainer-assistance minutes.

After rehearsal, give each person two different, trainer-written cases without the oppy. Have a trainer grade anonymized responses without knowing whether they came before or after practice.

Track four checks in a simple worksheet:

Required facts: how many were stated correctly out of those required?
Unsupported promises: how many appeared in each answer?
Independent completion: how many answers needed human rescue?
Total trainer time: include packet preparation, feedback review and corrections.

Separately check whether the coach's corrections match the cited sections. Any invented procedure or consequential unsupported promise should pause the pilot for review.

Choose an expansion threshold before starting: better independent accuracy, no increase in unsupported promises and acceptable total trainer effort. With five people, treat the result as a local signal, not statistical proof.

Improvement on fictional cases does not prove better client outcomes, retention or ROI.

The test happens after the chat closes

The point is not to generate more training conversations. It is to see whether the employee can explain the approved process without the coach.

Start with the question your manager keeps answering. Write down the correct answer once. Then give the new person somewhere to practice getting it right.

References

RISMedia: Power Broker research and resource-spending priorities. April 7, 2026, covering 2025 brokerage results.
RISMedia: FBS announces Flexmls Scout. November 4, 2026.
Oppy: Build your own oppy. April 21, 2026.
Oppy: Channel-specific system messages. March 31, 2026.
Oppy: Functions and permissions guide. August 22, 2025.
The2MortgageGuys: November 5 mortgage short. Published November 5, 2026 at 15:35 UTC; quoted text is from the written description.