Papers for

ai chatbot designers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Scientific agents adapt their collaboration style to diverse researcher personas

PersonaScienceBench: Evaluating Scientific Agents with Diverse Simulated Researchers

Abstract: Scientific agents collaborate with researchers whose expertise and preferences differ, but benchmarks usually hold the collaborator fixed. We introduce PersonaScienceBench: 200 tasks from five benchmarks across four scientific domains. Simulated researchers provide context and feedback according to persona profiles, while task objectives and grading remain fixed. Agents encounter researcher preferences only through conversation. Across eighteen modelconfigurations, task performance, fact recovery, and self-repetition reveal different strengths. Detailed GPT 6 Astra analyses show distinct agent responses across researcher profiles; interaction traces illustrate targeted clar ification and workflow revision. These behaviors can differ even when final scores match. PersonaScienceBench therefore evaluates how agents collaborate with diverse researchers alongside whether they complete the task.

Fri 23 OctArtificial Intelligence
The gist
Most AI tools for science work with a fixed type of partner, ignoring that real researchers have different ways of working and preferences. The authors created PersonaScienceBench, which uses simulated researchers with various personas to test how well scientific AI agents adapt their communication and problem solving. They found that agents show different strengths depending on the simulated researcher they interact with, even if final answers score similarly. This helps understand how AI can better collaborate with diverse human researchers.
Open → 2610.32106v1