Skip to content

Integration: Clarvia AEO scoring for agent tool quality validation #592

@digitamaz

Description

@digitamaz

Integration Request: Clarvia AEO for ChatDev Agent Tool Quality

About Clarvia

Clarvia is an AEO (Agent Experience Optimization) platform that scores 27,000+ tools and APIs for autonomous agent use. Score 0-100: 60+ = reliable for production agents.

Why ChatDev?

ChatDev's multi-role agents (CEO, CTO, Programmer, Reviewer) collaborate to build software. When these agents need external tools or APIs during development, Clarvia can pre-qualify tool quality.

Simple Integration

import requests

def check_tool_before_use(tool_name: str) -> bool:
    """Pre-flight check: is this tool agent-ready?"""
    try:
        data = requests.get(
            f"https://clarvia-api.onrender.com/v1/check/{tool_name}",
            timeout=3
        ).json()
        return data.get("score", 0) >= 50
    except:
        return True  # Don't block if unavailable

# Example usage
if check_tool_before_use("github-api"):
    # Use tool normally
    pass

MCP Server

ChatDev can also use Clarvia as an MCP server:

npx -y clarvia-mcp-server@latest

Remote: https://clarvia-api.onrender.com/mcp/

Stats: 27,000+ indexed tools, 714 npm weekly downloads
GitHub: https://github.com/clarvia-project/clarvia-mcp-server

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions