Cloud Providers

This page will help you set up cloud based providers with LLM Vision

OpenAI

Obtain an API key from OpenAIarrow-up-right and enter it during setup. You will need to add credits to you account before making requests.

circle-info

A pricing calculator is available here: https://openai.com/api/pricingarrow-up-right

Anthropic

Obtain an API key from Anthropicarrow-up-right and enter it during setup. You will need to add credits to you account before making requests.

Google

To use Google Gemini you need to have a Google account and obtain an API key from the AI Studioarrow-up-right. Depending on your region, you may need to enable billing.

circle-info

Pricing is available here: https://ai.google.dev/pricingarrow-up-right

OpenRouter

Obtain an API key from OpenRouter and enter it during setup. You will need to set up billing for you account before making requests.

AWS Bedrock

To deploy a model on AWS, your first must request access to models: https://us-east-1.console.aws.amazon.com/bedrock/home?region=us-east-1#/modelaccessarrow-up-right.

Once you have access, create an access key here: https://us-east-1.console.aws.amazon.com/iam/home?region=us-east-1#/security_credentialsarrow-up-right

To use this deployment with LLM Vision you will need:

  • Region String

  • Access Key

  • Secret

Enter these during setup.

Azure AI Foundry

To deploy a model on Azure AI Foundry follow this guide: https://ai.azure.com/doc/azure/ai-foundry/how-to/create-projects?tid=b7091c05-52c5-48a7-a4ef-67c41f1cf3a2#prerequisitesarrow-up-right

To use this deployment with LLM Vision you will need:

  • API key

  • Azure OpenAI Endpoint (e.g. https://llmvision.openai.azure.com/)

  • Deployment name (e.g. gpt-4o-mini)

Enter these during setup.

Groq

Obtain an API key from Groq arrow-up-rightand enter it during setup to get started with Groq.

circle-info

Groq is free to use but limits apply. You can check them here: https://console.groq.com/settings/limitsarrow-up-right

Note: Groq does not support video and stream analyzers.

Last updated