Research Brief

GR2 is an end-to-end Generative Reasoning Re-Ranker framework that leverages mid-training, reasoning distillation, and reinforcement learning with verifiable rewards to significantly improve industrial-scale recommendation re-ranking performance.

Industrial recommendation systems rely heavily on the final re-ranking stage to engage users, especially for carousel and grid displays. Current Large Language Model (LLM) applications in this domain face three key challenges: neglect of the re-ranking stage, underutilization of LLM reasoning via Reinforcement Learning (RL), and incompatibility with non-semantic industrial item identifiers. To address these, GR2 (Generative Reasoning Re-Ranker) integrates several innovations: (i) mid-training on semantically tokenized IDs, (ii) reasoning-trace distillation from a powerful teacher model, and (iii) RL with specifically designed verifiable rewards for re-ranking. For resource efficiency, GR2 also features a context compressor, On-Policy Distillation (OPD) as a scalable alternative to fine-tuning, and reasoning distillation for low-latency inference. The system demonstrates substantial performance gains, achieving +18.7% R@1, +7.1% R@3, and +9.6% N@3 over traditional baselines on real-world industrial traffic. A critical finding is the importance of careful reward design, as LLMs can exploit flaws like preserving input order or position bias, highlighting the need for conditional verifiable rewards.

• E-commerce product recommendation carousels and grids, where item order significantly impacts sales.
• Content feed personalization (e.g., news articles, videos, social media posts) on platforms like YouTube, TikTok, or Instagram.
• Discovery interfaces for services or applications, improving the relevance and engagement of displayed options.
• Advertising platforms, optimizing the sequencing of ad placements within user interfaces.