Author
University of Southern California
We have 2 of 27 papers
We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.
Not the right person? Other researchers publish under this name.
AppWorld-UL is introduced, a ``user-in-the-loop''benchmark of 516 challenging tasks requiring diverse agent-user interactions that systematically modify original tasks to introduce ambiguities and constraints that necessitate various types of agent-user interaction.
This work introduces AcCoRD, a user-agent collaboration benchmark requiring agents to handle diverse user preference dynamics in two domains: online shopping and travel planning, and evaluates five frontier LLMs under two prompting strategies: vanilla ReAct, and an uncertainty-guided variant that prompts models to identify and resolve ambiguity about user preferences.
We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.
