发现信息
- 作者:Zeyi Zhang, Zixi Kang, Ruijie Zhao, Yusen Feng, Biao Jiang, Hanyu Ji, Libin Liu
- 年份:2026
- 发表源:ACM Transactions on Graphics
- OpenAlex ID:https://openalex.org/W7129201484
- DOI:https://doi.org/10.1145/3842576
- arXiv:待核验
- 检索主题:memory-evaluation
- OpenAlex 引用数快照:8(2026-11-12)
摘要线索
Real-time embodied social interaction places two equally demanding requirements on an agent: continuously generating fluent multimodal interaction behavior, and proactively reasoning over accumulated dialogue and visual context to decide when to take initiative. These requirements must both be satisfied under a strict latency budget, making them difficult to meet simultaneously. We present ProAct , a dual-system framework that manages these time-critical requirements by integrating a low-latency Behavioral System for streaming multimodal interaction with a slower Cognitive System that performs long-horizon social reasoning and produces high-level proactive intentions. The Cognitive System incorporates an efficient memory mechanism and a user-motivation prediction module to reason over accumulated dialogue and visual context and determine when proactive intervention is appropriate. The Behavioral System further includes an intention-conditioned streaming flow-matching motion generator with a disentangled Control-Net branch, which translates deliberative intentions into continuous nonverbal behavior without disrupting interaction fluency. We deploy ProAct on a physical humanoid robot and validate the framework through comprehensive experiments, including real-world user studies, motion-generation benchmarks, and evaluation on ProActBench , a new, targeted benchmark for evaluating proactive trigger detection and restraint in embodied interaction. Code and ProActBench will be released at https://proactrobot.github.io/.
核验与筛选
- 当前状态:待筛选、去重和一手来源核验。
- OpenAlex 元数据和引用数只用于发现,不作为正式引文或质量判断。
- 记录正式版本、venue、方法细节、实验协议和局限后,才迁入稳定论文卡片。