• Computer Science > Human-Computer Interaction [Submitted on 3 Jan 2026] Title:What Persona Are We Missing? • Identifying Unknown Relevant Personas for Faithful User Simulation View PDF HTML (experimental)Abstract:Existing user simulations, where models generate user-like responses in dialogue, often lack verification that sufficient user personas are provided, questioning the validity of the simulations. • To address this core concern, this work explores the task of identifying relevant but unknown personas of the simulation target for a given simulation context. • We introduce PICQ, a novel dataset of context-aware choice questions, annotated with unknown personas (e.g., ‘‘Is the user price-sensitive?’’) that may influence user choices, and propose a multi-faceted evaluation scheme assessing fidelity, influence, and inaccessibility. • Our benchmark of leading LLMs reveals a complex ‘‘Fidelity vs. • Insight’’ dilemma governed by model scale: while influence generally scales with model size, fidelity to human patterns follows an inverted U-shaped curve.
Article Summaries:
- Computer Science > Human-Computer Interaction [Submitted on 3 Jan 2026] Title:What Persona Are We Missing? Identifying Unknown Relevant Personas for Faithful User Simulation View PDF HTML (experimental)Abstract:Existing user simulations, where models generate user-like responses in dialogue, often lack verification that sufficient user personas are provided, questioning the validity of the simulations. To address this core concern, this work explores the task of identifying relevant but unknown personas of the simulation target for a given simulation context. We introduce PICQ, a novel dataset
Sources: