Skip to content

Providers

GoAI ships 20 providers organized by tier.

Tier 1

Dedicated implementations with extended API support.

ProviderAPIFeatures
OpenAIChat Completions + Responses APIEmbedding, Image, 4 provider tools
AnthropicMessages API10 provider tools, thinking, cache control
GoogleGemini REST APIEmbedding, Image, 3 provider tools, thinking
BedrockAWS Converse APISigV4, EventStream, multi-vendor
AzureMulti-endpoint routingOpenAI + Claude + AI Services, Image
Vertex AIVertex AI + Gemini fallbackEmbedding, Image, ADC auth

Tier 2

ProviderAPIFeatures
CohereNative Chat v2 + Embed APIEmbedding, citations, reasoning
MistralOpenAI-compatible
xAI (Grok)OpenAI-compatible2 provider tools (pending Responses API)
GroqOpenAI-compatibleBrowserSearch tool
DeepSeekOpenAI-compatibleReasoning (R1)

Tier 3

All use the shared internal/openaicompat codec.

ProviderEndpointSpecial Features
Fireworksapi.fireworks.ai
Togetherapi.together.xyz
DeepInfraapi.deepinfra.com
OpenRouteropenrouter.aiMulti-provider routing
Perplexityapi.perplexity.aiSearch-augmented, citations
Cerebrasapi.cerebras.ai

Local / Custom

ProviderDefault EndpointFeatures
Ollamalocalhost:11434Embedding, no auth required
vLLMlocalhost:8000Embedding, optional auth
Generic Compatible(required)Any OpenAI-compatible endpoint

Common Options

All providers support these options (except where noted):

go
openai.WithAPIKey(key)        // Static API key
openai.WithTokenSource(ts)    // Dynamic auth (OAuth, service accounts)
openai.WithBaseURL(url)       // Override endpoint
openai.WithHeaders(h)         // Custom HTTP headers
openai.WithHTTPClient(c)      // Custom HTTP transport

Each provider package exports its own With* functions with the same signatures.

Released under the MIT License.