BOOSTING AI AGENTS' GAMEPLAY WITH TASK GUIDANCE

Summary from the TLDR AI newsletter

This paper explores the development of a generalist AI agent capable of understanding and following gameplay instructions, a step towards "read-to-play" abilities. The researchers enhance the agent's multitasking and generalization skills by integrating multimodal game instructions into a decision transformer.