Skip to content

Add support for non-OpenAI models #63

@Cali0707

Description

@Cali0707

Currently when running evals with the builtin direct-model agent (rather than using off the shelf agents like Claude Code), there is a requirement that the model is hosted at an OpenAI compliant endpoint.

Many models have their own APIs, and we should move from using the OpenAI client package to a more general one that handles that complexity for us.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions