GET STARTED:
USER GUIDES:
CONTRIBUTE:
PACKAGE API:
gpt_engineer.applications
gpt_engineer.benchmark
gpt_engineer.core
gpt_engineer.tools
Loads the MBPP benchmark, which consists of a series coding problems.
A Benchmark object containing a list of Task objects for the MBPP evaluation.
Benchmark