Interrogating generative NPCs
Can an LLM-driven character hold up under pressure? Building a framework to find out.
Generative NPCs can contradict themselves, reveal knowledge the character should not have, absorb unwanted bias, or simply stop being the person they were written as. We are developing a structured way to probe those failures deliberately rather than waiting for players to find them, and to score a character’s responses along several dimensions of consistency.