Indian Flag
Government Of India
A-
A
A+
UpvoteUpvote
0

Test-Time-Compute-Scaling-Risk-Dataset

Simulated true-accuracy-vs-search-width curves for 180 configurations across 5 reasoning tasks and 6 test-time-compute methods (weak/strong-verifier best-of-N, beam search, self-consistency, PRM-guided search, verification-based finetuning), grounded in 2023-2026 research on search-time reward overoptimization. Forward-looking task predicts overoptimization at a large search budget from a cheap small-budget check.
4.50
AI Score infoDownload score report
  • Upvotes0upvotes
  • Downloads0downloads
  • Views36views
  • File size337.10 KB
  • Shares0Shares
  • Last updatedupdated 12 Aug 2026
UpvoteUpvote
0
COVERAGE India
LICENSE Attribution 4.0 International (CC BY- 4.0)
FORMAT Synthetic
TYPE Structured
SECTOR Science, Technology and Research
UPDATES NA

About Dataset

Simulates a search-time instance of Goodhart's Law: the verifier/proxy score always rises with more search, but true accuracy rises then declines past a critical width for most methods. 180 configs, 6 methods. Ten sources (2021-2026) in test_time_compute_theory.py, including Gao et al.'s reward-overoptimization scaling laws, a formal best-of-N analysis, an ICML 2025 spotlight paper, and a 2026 paper extending the finding to beam search via extreme value theory.

Tags

  • Large Language Model

Related Datasets Related Datasets

Chat-Dataset
Chat-Dataset
4.8Information•Updated 5 day(s) ago
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters2
  • Downloads3
  • Views53
  • File Size777.41 KB

SOCIETY FOR ELECTRONIC TRANSACTIONS AND SECURITY (SETS), UNDER OFFICE OF PSA TO GOVT. OF INDIA
  • See Upvoters0
  • Downloads13
  • Views127
  • File Size27.06 GB

SOCIETY FOR ELECTRONIC TRANSACTIONS AND SECURITY (SETS), UNDER OFFICE OF PSA TO GOVT. OF INDIA
  • See Upvoters0
  • Downloads8
  • Views74
  • File Size43.39 GB

SOCIETY FOR ELECTRONIC TRANSACTIONS AND SECURITY (SETS), UNDER OFFICE OF PSA TO GOVT. OF INDIA
  • See Upvoters0
  • Downloads10
  • Views76
  • File Size26.69 GB

SPICOR TTS 3 Sourashtra Corpus
SPICOR TTS 3 Sourashtra Corpus
-Information•Updated 1 month(s) ago
DIGITAL INDIA BHASHINI DIVISION
  • See Upvoters0
  • Downloads13
  • Views91
  • File Size0

SPICOR TTS_1.0 Indian English Corpus
SPICOR TTS_1.0 Indian English Corpus
-Information•Updated 1 month(s) ago
DIGITAL INDIA BHASHINI DIVISION
  • See Upvoters0
  • Downloads2
  • Views39
  • File Size0

SPICOR TTS_2.0 Gujarati Corpus
SPICOR TTS_2.0 Gujarati Corpus
-Information•Updated 1 month(s) ago
DIGITAL INDIA BHASHINI DIVISION
  • See Upvoters0
  • Downloads1
  • Views28
  • File Size0

SOCIETY FOR ELECTRONIC TRANSACTIONS AND SECURITY (SETS), UNDER OFFICE OF PSA TO GOVT. OF INDIA
  • See Upvoters0
  • Downloads1
  • Views40
  • File Size3.82 GB

SOCIETY FOR ELECTRONIC TRANSACTIONS AND SECURITY (SETS), UNDER OFFICE OF PSA TO GOVT. OF INDIA
  • See Upvoters0
  • Downloads1
  • Views38
  • File Size13.78 GB

SETS-THIRAL-PRINCE-EM-Protected-TI-FPGA
SETS-THIRAL-PRINCE-EM-Protected-TI-FPGA
4.8Information•Updated 1 month(s) ago
SOCIETY FOR ELECTRONIC TRANSACTIONS AND SECURITY (SETS), UNDER OFFICE OF PSA TO GOVT. OF INDIA
  • See Upvoters0
  • Downloads3
  • Views36
  • File Size4.79 GB


Related Datasets by Organization Related Datasets by Organization

Chat-Dataset
Chat-Dataset
4.8Information•Updated 5 day(s) ago
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters2
  • Downloads3
  • Views53
  • File Size777.41 KB

SOCIETY FOR ELECTRONIC TRANSACTIONS AND SECURITY (SETS), UNDER OFFICE OF PSA TO GOVT. OF INDIA
  • See Upvoters0
  • Downloads13
  • Views127
  • File Size27.06 GB

SOCIETY FOR ELECTRONIC TRANSACTIONS AND SECURITY (SETS), UNDER OFFICE OF PSA TO GOVT. OF INDIA
  • See Upvoters0
  • Downloads8
  • Views74
  • File Size43.39 GB

SOCIETY FOR ELECTRONIC TRANSACTIONS AND SECURITY (SETS), UNDER OFFICE OF PSA TO GOVT. OF INDIA
  • See Upvoters0
  • Downloads10
  • Views76
  • File Size26.69 GB

SPICOR TTS 3 Sourashtra Corpus
SPICOR TTS 3 Sourashtra Corpus
-Information•Updated 1 month(s) ago
DIGITAL INDIA BHASHINI DIVISION
  • See Upvoters0
  • Downloads13
  • Views91
  • File Size0

SPICOR TTS_1.0 Indian English Corpus
SPICOR TTS_1.0 Indian English Corpus
-Information•Updated 1 month(s) ago
DIGITAL INDIA BHASHINI DIVISION
  • See Upvoters0
  • Downloads2
  • Views39
  • File Size0

SPICOR TTS_2.0 Gujarati Corpus
SPICOR TTS_2.0 Gujarati Corpus
-Information•Updated 1 month(s) ago
DIGITAL INDIA BHASHINI DIVISION
  • See Upvoters0
  • Downloads1
  • Views28
  • File Size0

SOCIETY FOR ELECTRONIC TRANSACTIONS AND SECURITY (SETS), UNDER OFFICE OF PSA TO GOVT. OF INDIA
  • See Upvoters0
  • Downloads1
  • Views40
  • File Size3.82 GB

SOCIETY FOR ELECTRONIC TRANSACTIONS AND SECURITY (SETS), UNDER OFFICE OF PSA TO GOVT. OF INDIA
  • See Upvoters0
  • Downloads1
  • Views38
  • File Size13.78 GB

SETS-THIRAL-PRINCE-EM-Protected-TI-FPGA
SETS-THIRAL-PRINCE-EM-Protected-TI-FPGA
4.8Information•Updated 1 month(s) ago
SOCIETY FOR ELECTRONIC TRANSACTIONS AND SECURITY (SETS), UNDER OFFICE OF PSA TO GOVT. OF INDIA
  • See Upvoters0
  • Downloads3
  • Views36
  • File Size4.79 GB


Related Datasets by Sector Related Datasets by Sector

Chat-Dataset
Chat-Dataset
4.8Information•Updated 5 day(s) ago
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters2
  • Downloads3
  • Views53
  • File Size777.41 KB

SOCIETY FOR ELECTRONIC TRANSACTIONS AND SECURITY (SETS), UNDER OFFICE OF PSA TO GOVT. OF INDIA
  • See Upvoters0
  • Downloads13
  • Views127
  • File Size27.06 GB

SOCIETY FOR ELECTRONIC TRANSACTIONS AND SECURITY (SETS), UNDER OFFICE OF PSA TO GOVT. OF INDIA
  • See Upvoters0
  • Downloads8
  • Views74
  • File Size43.39 GB

SOCIETY FOR ELECTRONIC TRANSACTIONS AND SECURITY (SETS), UNDER OFFICE OF PSA TO GOVT. OF INDIA
  • See Upvoters0
  • Downloads10
  • Views76
  • File Size26.69 GB

SPICOR TTS 3 Sourashtra Corpus
SPICOR TTS 3 Sourashtra Corpus
-Information•Updated 1 month(s) ago
DIGITAL INDIA BHASHINI DIVISION
  • See Upvoters0
  • Downloads13
  • Views91
  • File Size0

SPICOR TTS_1.0 Indian English Corpus
SPICOR TTS_1.0 Indian English Corpus
-Information•Updated 1 month(s) ago
DIGITAL INDIA BHASHINI DIVISION
  • See Upvoters0
  • Downloads2
  • Views39
  • File Size0

SPICOR TTS_2.0 Gujarati Corpus
SPICOR TTS_2.0 Gujarati Corpus
-Information•Updated 1 month(s) ago
DIGITAL INDIA BHASHINI DIVISION
  • See Upvoters0
  • Downloads1
  • Views28
  • File Size0

SOCIETY FOR ELECTRONIC TRANSACTIONS AND SECURITY (SETS), UNDER OFFICE OF PSA TO GOVT. OF INDIA
  • See Upvoters0
  • Downloads1
  • Views40
  • File Size3.82 GB

SOCIETY FOR ELECTRONIC TRANSACTIONS AND SECURITY (SETS), UNDER OFFICE OF PSA TO GOVT. OF INDIA
  • See Upvoters0
  • Downloads1
  • Views38
  • File Size13.78 GB

SETS-THIRAL-PRINCE-EM-Protected-TI-FPGA
SETS-THIRAL-PRINCE-EM-Protected-TI-FPGA
4.8Information•Updated 1 month(s) ago
SOCIETY FOR ELECTRONIC TRANSACTIONS AND SECURITY (SETS), UNDER OFFICE OF PSA TO GOVT. OF INDIA
  • See Upvoters0
  • Downloads3
  • Views36
  • File Size4.79 GB


Related Datasets by Task Type Related Datasets by Task Type

Chat-Dataset
Chat-Dataset
4.8Information•Updated 5 day(s) ago
AIKOSH OPENSOURCE COMMUNITY
  • See Upvoters2
  • Downloads3
  • Views53
  • File Size777.41 KB

SOCIETY FOR ELECTRONIC TRANSACTIONS AND SECURITY (SETS), UNDER OFFICE OF PSA TO GOVT. OF INDIA
  • See Upvoters0
  • Downloads13
  • Views127
  • File Size27.06 GB

SOCIETY FOR ELECTRONIC TRANSACTIONS AND SECURITY (SETS), UNDER OFFICE OF PSA TO GOVT. OF INDIA
  • See Upvoters0
  • Downloads8
  • Views74
  • File Size43.39 GB

SOCIETY FOR ELECTRONIC TRANSACTIONS AND SECURITY (SETS), UNDER OFFICE OF PSA TO GOVT. OF INDIA
  • See Upvoters0
  • Downloads10
  • Views76
  • File Size26.69 GB

SPICOR TTS 3 Sourashtra Corpus
SPICOR TTS 3 Sourashtra Corpus
-Information•Updated 1 month(s) ago
DIGITAL INDIA BHASHINI DIVISION
  • See Upvoters0
  • Downloads13
  • Views91
  • File Size0

SPICOR TTS_1.0 Indian English Corpus
SPICOR TTS_1.0 Indian English Corpus
-Information•Updated 1 month(s) ago
DIGITAL INDIA BHASHINI DIVISION
  • See Upvoters0
  • Downloads2
  • Views39
  • File Size0

SPICOR TTS_2.0 Gujarati Corpus
SPICOR TTS_2.0 Gujarati Corpus
-Information•Updated 1 month(s) ago
DIGITAL INDIA BHASHINI DIVISION
  • See Upvoters0
  • Downloads1
  • Views28
  • File Size0

SOCIETY FOR ELECTRONIC TRANSACTIONS AND SECURITY (SETS), UNDER OFFICE OF PSA TO GOVT. OF INDIA
  • See Upvoters0
  • Downloads1
  • Views40
  • File Size3.82 GB

SOCIETY FOR ELECTRONIC TRANSACTIONS AND SECURITY (SETS), UNDER OFFICE OF PSA TO GOVT. OF INDIA
  • See Upvoters0
  • Downloads1
  • Views38
  • File Size13.78 GB

SETS-THIRAL-PRINCE-EM-Protected-TI-FPGA
SETS-THIRAL-PRINCE-EM-Protected-TI-FPGA
4.8Information•Updated 1 month(s) ago
SOCIETY FOR ELECTRONIC TRANSACTIONS AND SECURITY (SETS), UNDER OFFICE OF PSA TO GOVT. OF INDIA
  • See Upvoters0
  • Downloads3
  • Views36
  • File Size4.79 GB