How do you test whether an LLM follows corrections across a conversation?
A model can acknowledge a correction and still act on the old request. Test the final answer against the current request, preserved constraints and withdrawn instructions.
A model can acknowledge a correction and still act on the old request. Test the final answer against the current request, preserved constraints and withdrawn instructions.