Ask a Question

Prefer a chat interface with context about you and your work?

Elements of World Knowledge (EWOK): A cognition-inspired framework for evaluating basic world knowledge in language models

Elements of World Knowledge (EWOK): A cognition-inspired framework for evaluating basic world knowledge in language models

The ability to build and leverage world models is essential for a general-purpose AI agent. Testing such capabilities is hard, in part because the building blocks of world models are ill-defined. We present Elements of World Knowledge (EWOK), a framework for evaluating world modeling in language models by testing their …