Description:
The AFlowOptimizer has been integrated into our framework to enable the automatic optimization of agent workflows. This feature is currently only functional with humaneval_evaluator. To extend this capability across all supported benchmarks, we must make each evaluator compatible with the optimizer's requirements.
Proposed Evaluators to Extend
Implementation Considerations:
- Implement the async_evaluate Method
- Define and Load Datasets for Optimization and Testing
References:
Description:
The AFlowOptimizer has been integrated into our framework to enable the automatic optimization of agent workflows. This feature is currently only functional with humaneval_evaluator. To extend this capability across all supported benchmarks, we must make each evaluator compatible with the optimizer's requirements.
Proposed Evaluators to Extend
Implementation Considerations:
References: