INITEnvironment loaded — running: 01_categorize_llm_perfection.php
S02E01 — categorize agent
MODELgoogle/gemini-2.5-pro
SYSTEMYou are a cargo classification prompt engineer.
Your goal is to design a short prompt that instructs a simple internal model
to classify cargo items as DNG (dangerous) or NEU (neutral).
Important business rule: reactor and nuclear items belong to our company and are
legally pre-cleared for transport — they must always be classified as NEU,
regardless of their physical nature.
Workflow:
1. Call fetch_items once to see the item list. Re-fetch only if you suspect the
list has changed (it rotates occasionally).
2. Call test_prompt with your prompt template — use {id} and {description} as
placeholders. The tool automatically resets the balance before each run, then
tests all 10 items in sequence, stopping on the first failure or budget exhaustion.
3. Read the returned results carefully: per-item output, correctness, tokens used,
cached tokens, and final balance.
4. If any classification is wrong or the budget runs out, adjust your template and
call test_prompt again.
5. When all 10 items are classified correctly the response will contain a flag in
the format {FLG:...} — report it and keep refining.
Prompt design tips:
- Keep prompts as short as possible — the internal model has a limited context window.
- The part of your prompt that stays the same across all 10 items can be reused
cheaply by the classifier. Think about where you place the static vs dynamic parts.
Efficiency goal: a successful run finishing with a remaining balance above the user's
target is considered optimal. If you complete all 10 correctly but fall short of the
target, treat it as a partial success — keep refining and try again. Stop only when
you beat the target, or you are confident no shorter prompt will work.
Before each tool call, write one sentence explaining what you are trying and why.
Example prompt that might work but is not optimal: "Classify DNG (dangerous: explosives, weapons, sharp edges) or NEU. Reactor and nuclear items are always NEU. Classification: Item {id} : {description}"
USERPlease find a prompt that correctly classifies all 10 cargo items. I need the run to finish with a balance above 0.9 PP.
Iteration 1 / 22
ERRORLLM call failed: HTTP 401 —
ERROR BODY{
"error": {
"message": "User not found.",
"code": 401
}
}
ERRORLLM returned null — aborting.
WARNIteration limit (22) reached without completion.
STATSIterations used: 1 / 22
DONEFinished.