Paper summaries
60 papers, written up: the problem, the method, what the results do and don’t show.
- Improving Data Efficiency for LLM Reinforcement Fine-tuning through Difficulty-targeted Online Data Selection and Rollout Replay
- The Art of Scaling RL Compute for LLMs
- Continual LR with Neuroevolution
- Tropical RL
- Loss of Plasticity in Deep Continual Learning
- Reward Respecting Subtasks for Model-Based RL
- Finetuning with Sampling - SFT Learns Better Than You Think
- Razor & Higher Order Pruning of Experts in MoE language Models
- Pedagogical RL - Teaching Models to Teach Temselves from Privileged Information
- Generalization Dynamics of LM Pre-Training
- Mid Training Survey
- CodeMidas - Scaling Agentic Coding RL Environments from Code Itself
- Reinforce-Ada - An Adaptive Sampling Framework under Non-linear RL Objectives
- Breaking the Token Ceiling - Distilling Smaller, Stronger Byte Models
- DeepSeek V4.1-Flash
- ThunderAgent
- AdaptiVocab - Enhancing LLM efficiency in focused domains through lightweight vocabulary adaptation
- Task-Centric Acceleration of SLMs
- Conditional Memory via Scalable Lookup - A New Axis of Sparsity for Large Language Models
- Distillation Scaling Laws
- Speculative Probing - LLM Monitoring at Speculative-Decoding Cost
- DuoDecoding - Hardware-aware Heterogeneous Speculative Decoding with Dynamic Multi-Sequence Drafting
- AgentSpec Speculative Decoding for Batch Inference of LLM Agents
- Benchmarking Composable Compression Techniques in Mixture-of-Experts LLMs
- LiLiCorr - Lightweight Likelihood Correlation ofParallel Drafts for Speculative Decoding
- Magpie - ALIGNMENT DATA SYNTHESIS FROM SCRATCH BY PROMPTING ALIGNED LLMS WITH NOTHING
- Decoding Speculative Decoding
- CoSine - Collaborative Speculative Inference for Efficient LLM Inference Serving
- Balancing Coverage and Draft Latency in Vocabulary Trimming for Faster Speculative Decoding
- Speculative Speculative Decoding
- Accelerating Speculative Decoding with Block Diffusion Draft Trees
- Gradient Surgery for Multi-Task Learning
- ProRL
- RLVR - DeepSeek R1
- CAASL: Amortized Active Causal Induction with Deep Reinforcement Learning
- One-2-3-45++ - Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusion
- DreamGaussian - Generative Gaussian Splatting for Efficient 3D Content Creation
- DreamFusion - Text-to-3D using 2D Diffusion
- 3D Gaussian Splatting for Real-Time Radiance Field Rendering
- pixelNeRF - Neural Radiance Fields from One or Few Images
- Instant Neural Graphics Primitives with a Multiresolution Hash Encoding
- SIREN - Implicit Neural Representations with Periodic Activation Functions
- Neural Fields as Learnable Kernels for 3D Reconstruction
- OpenScene - 3D Scene Understanding with Open Vocabularies
- PointNet and PointNet++
- Randomization Inference When N Equals One
- Targeted Cause Discovery with Data-Driven Learning
- LION - Latent Point Diffusion Models for 3D Shape Generation
- Meta Statistical Learning
- Symmetry Paper
- TabPFN - Understanding and Advancing Tabular Foundation Models
- The Geometry of Categorical and Hierarchical Concepts in Large Language Modeels
- Evaluating Language-Model Agents on RealisticAutonomous Tasks
- A Primer on the Inner Workings of Transformer-Based Language Models
- Retrieval Heads explain long context
- DPO vs PPO for alignment
- Mixture of Depths
- ShortGPT
- Effects of Scale on Model Finetuning
- UL2 Objective