Efficient Prediction of Pass@k Scaling in Language Models

Joshua Kazdan, Rylan Schaeffer, Youssef Allouah, Colin Sullivan, Kyssen Yu, Noam Levi, Sanmi Koyejo

arXiv preprint Under Review

October 2025

Language Models Scaling Laws Pass-at-k Generative Evaluation

arXiv

Abstract

Summary

Efficient methods for predicting pass@k scaling behavior in large language models.