gpt_engineer.benchmark.benchmarks.load.get_benchmark

gpt_engineer.benchmark.benchmarks.load.get_benchmark(name: str, config: BenchConfig) → Benchmark[source]

Retrieves a Benchmark object by name. Raises ValueError if the benchmark is unknown.

Parameters:

name (str) – The name of the benchmark to retrieve.
config (BenchConfig) – Configuration object for the benchmarks.

Returns:

The Benchmark object corresponding to the given name.

Return type:

Benchmark

Raises:

ValueError – If the benchmark name is not found in the BENCHMARKS mapping.