AdaJEPA: An Adaptive Latent World Model

Ying Wang, Oumayma Bounou, Yann LeCun, Mengye Ren

Latent world models enable planning from high-dimensional observations by predicting future states in a compact latent space. However, these models are typically kept frozen at test time: when their predictions become inaccurate, planning can fail, especially under test-time distribution shift. To address this, we propose AdaJEPA, an adaptive latent world model that performs test-time adaptation within the closed loop of model predictive control (MPC). After training, AdaJEPA plans and executes the first action chunk, uses the observed next-state transition as a self-supervised adaptation signal, and replans with the updated model. This closed-loop update continuously recalibrates the world model without additional expert demonstrations. Across a range of goal-reaching tasks, AdaJEPA substantially improves planning success with as few as one gradient step per MPC replanning step.

Open Source

Research Brief

AdaJEPA introduces a continuously adapting latent world model that self-corrects its predictions during execution, significantly improving planning success in dynamic environments.

Latent world models are crucial for autonomous systems, enabling them to plan actions by predicting future outcomes in a simplified, internal representation of the world. Traditionally, these models are fixed after initial training, leading to potential failures when the real-world environment deviates from what the model learned (a 'distribution shift'). AdaJEPA addresses this limitation by developing an adaptive latent world model that performs real-time adjustments. Within a closed-loop control system (Model Predictive Control or MPC), AdaJEPA plans an action, executes it, observes the actual outcome, and then uses this discrepancy as a self-supervised signal to update and recalibrate its internal world model. This continuous adaptation allows the system to replan with a more accurate understanding of its environment, improving its ability to reach goals without needing additional human input or expert demonstrations. The paper demonstrates that even a single gradient step of adaptation per replanning cycle can substantially enhance planning success.

Potential Applications

Autonomous driving in unpredictable urban or off-road conditions.
Robotic manipulation and assembly in dynamic industrial settings with varying object properties or unexpected obstructions.
Exploration and navigation for search-and-rescue robots in unknown or changing environments.
Adaptive control systems for drones or other aerial vehicles operating under shifting weather patterns.

50/100

Paper Trustworthiness Index

Medium Skepticism

Moderately Trustworthy

This is a preprint publication or lacks formal peer review. It is part of the research pipeline but needs caution.

Verified AI Assessment: This credibility analysis was generated by Gemini 2.5 Flash analyzing the full paper text, references, and metadata.

Core Pillars Breakdown

Author & Institutional Track Record

15 / 25

No author or institutional information is provided in the abstract, so a neutral-to-good score is assigned, assuming it originates from a standard academic research context. Without explicit affiliations, it's impossible to confirm prestige or funding directly from the abstract.

Technical Rigor & Methodology

25 / 30

The abstract clearly outlines a methodological approach: 'closed-loop update,' 'self-supervised adaptation signal,' and 'one gradient step per MPC replanning step.' It also mentions evaluation 'across a range of goal-reaching tasks' and 'substantially improves planning success,' suggesting empirical validation of the proposed system.

Reproducibility & Openness

5 / 25

The abstract provides no information regarding the public availability of code, data, or trained model weights. This makes it impossible to assess reproducibility based solely on the provided text.

Community Vetting & Peer Review

5 / 20

The abstract does not specify if the paper has been peer-reviewed or accepted at a conference or journal. Therefore, it is treated as a potential preprint, lacking formal community vetting at this stage.

Detailed Evidence Assessment

Verified Evidence & Citations

Latent world models predict future states in a compact latent space.

“Abstract: "Latent world models enable planning from high-dimensional observations by predicting future states in a compact latent space."”

Traditional world models are typically frozen at test time.

“Abstract: "However, these models are typically kept frozen at test time"”

AdaJEPA performs test-time adaptation within the closed loop of MPC.

“Abstract: "we propose AdaJEPA, an adaptive latent world model that performs test-time adaptation within the closed loop of model predictive control (MPC)."”

AdaJEPA uses the observed next-state transition as a self-supervised adaptation signal.

“Abstract: "uses the observed next-state transition as a self-supervised adaptation signal"”

Uncertainties & Omissions

• Omission:Specific datasets used for training and evaluation.

• Omission:Details on the architecture of AdaJEPA (e.g., specific neural network types).

• Omission:Quantitative results (e.g., percentage improvement in planning success, specific metrics).

• Omission:Comparison against all relevant state-of-the-art baselines.

• Omission:Discussion of computational cost for test-time adaptation.

• Omission:Information on the funding sources or affiliations of the authors.

• Omission:A link to a code repository or project page.

• Uncertainty:The exact scope and complexity of 'a range of goal-reaching tasks' tested.

• Uncertainty:The generalizability of 'as few as one gradient step per MPC replanning step' across all possible distribution shifts or task complexities.

• Uncertainty:The robustness of the adaptation signal to noisy or imperfect observations.