Test-time compute
Test-time compute: Additional computation used during inference to improve a response without changing model parameters. It includes multiple samples, search, verification and extended reasoning. Returns must be measured against cost and latency because more attempts do not always improve the solution.
In italiano: Test-Time ComputeLegge III · Come una rete impara dai datiIt includes multiple samples, search, verification and extended reasoning. Returns must be measured against cost and latency because more attempts do not always improve the solution.
Examples
- Best-of-N with a verifier
- Search across solution branches
- Variable reasoning budget