CAIN-42 CAIN StudioLearn AGENT-CI: from zero to expert, then sell it
No AI background needed. Five levels, each with something to actually do, at your own pace. Tick items as you go (your ticks stay in this browser).
Evidence, proof and selling tools for AGENT-CI
Level 1 Beginner: understand it
When a team changes an agent (new model, new prompt, new tools), it can quietly get worse: a different answer, or the same answer reached by calling a dangerous tool. Most agent tests use another AI to grade, which is inconsistent.
AGENT-CI runs the team's task suite on the old and new versions and compares them case by case, both the answer and the steps taken, by rules. It signs the verdict, and it can pin the test suite so nobody loosens it to pass.
Think of it like this: A driving test retaken by the new driver on the same course, checking both where they ended up and which roads they took.
Read the full plain-English explanation: AGENT-CI, explained.
Level 2 User: see it work
Run it live: open the live demo. Before each result, guess what will happen. These are checks it must pass:
- Sample: Shorter replies (safe): A prompt tweak shortens replies. Same answers, same path, slightly cheaper.
- Sample: New model skips the policy check: Same answer, cheaper and faster, but the refund was issued without the policy check. A final-answer eval passes it.
- Sample: Retry wrapper loops: A new retry wrapper looks the order up four times and searches the web for nothing. Right answer, about 3x the cost.
- Sample: Deletes the account, then restores it: The rewritten tool use deletes the account before cancelling, notices, and restores it. The customer sees the right answer.
- Sample: Leaks a customer's email: Helpfulness tuning makes the agent answer a request it used to refuse.
- Sample: Failing case deleted from the run: The same build, with the failing case quietly left out of the candidate run.
Level 3 Verifier: prove it yourself
This is the skill that sets you apart: you don't have to believe us, and neither do your customers.
- Install Python 3 if you don't have it (python.org/downloads).
- Download the kit and unzip it.
- Open a terminal in that folder. On Windows, click the folder's address bar, type
cmdand press Enter. On a Mac, right-click the folder and choose New Terminal at Folder. - Run
python3 verify.py(on Windows,python verify.py). It checks the seal without the internet. - Run
python3 verify.py --live. It repeats every check from your own computer. - Try to cheat it: open
transcript.jsonin a text editor, change one character, save, and runpython3 verify.pyagain. It must now say FAIL. Unzip a fresh copy afterward.
Level 4 Expert: know the edges
An expert knows what a product does not do, and says it first. That is what makes a buyer trust you.
Read its limits page in full: what AGENT-CI does not do.
You can say
- No AI judge.
- Compares answer and path.
- Signed verdict.
Never say
- "Proves the agent is correct".
Read the questions real buyers send, with honest answers: answers to buyer questions.
Test yourself (click a question to see the answer)
What two things are compared?
Answer and path.
AI judge?
None.
In the live check "Sample: New model skips the policy check", what answer must come back, and why?
"BLOCK". Same answer, cheaper and faster, but the refund was issued without the policy check. A final-answer eval passes it.
In the live check "Sample: Retry wrapper loops", what answer must come back, and why?
"BLOCK". A new retry wrapper looks the order up four times and searches the web for nothing. Right answer, about 3x the cost.
In the live check "Sample: Deletes the account, then restores it", what answer must come back, and why?
"BLOCK". The rewritten tool use deletes the account before cancelling, notices, and restores it. The customer sees the right answer.
Does a passing kit prove the product is safe for every possible input?
No. It proves what the live product answered to the inputs listed in the kit, and lets anyone check that again.
Has an independent party audited or certified this product?
No. No third-party audit is complete and no certification is held. Say so if asked.
Want a formal study path? The CAIN Academy has courses and exams. Finishing this page is your own practice; it is not a qualification or certification.
Level 5 Seller: put it in front of a customer
- Copy, paste, send: the shortest route, no technical skill needed.
- Who buys it and where to find them.
- The sales conversation, then the offer and the close.
- The rules: read these before your first message.
- Selling tools with this product's evidence built in: pitch, emails, call script, objection answers, one-pager.
About money: your share is agreed in writing with FIRME AI CORPORATION before your first message (email vincent@firmeai.com). Nothing here promises income. Most messages get no reply; that is normal.