> For the complete documentation index, see [llms.txt](https://karini-ai.gitbook.io/karini-ai-documentation/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://karini-ai.gitbook.io/karini-ai-documentation/model-hub/embeddings-models.md).

# Embeddings Models

Karini AI supports integrations with the following Embeddings Model providers and custom models. Using these models, users can create model endpoints in Karini AI model hub.&#x20;

1. Amazon Bedrock
2. OpenAI
3. Azure OpenAI
4. Databricks
5. Amazon SageMaker

### Add New Model Endpoint

To add a new model endpoint to the model hub, do the following:&#x20;

1. On the **Model Endpoints** menu, select **Embeddings model endpoint** tab and click **Add New**.&#x20;
2. Select a model provider and associated model id in the list.&#x20;
3. User has option to override default configurations such as max tokens and pricing. Refer to this [table](#model-endpoint-configurations) for detailed configuration parameter information for each model provider.
4. By default, the organization level credentials are used to access the model. User can optionally **overwrite credentials** with a new set of model credentials.
5. User can test the model endpoint request and response by using the **Test endpoint** button.&#x20;

### Review Model Endpoints

User can review the created model endpoints under **Embeddings model endpoint** ta&#x62;**.** It includes following information:

1. Model provider and model id.
2. Dimensions, max tokens and tokenizer: The default values are displayed based on model specifications from the model provider. &#x20;
3. Model Price: The default price displays public pricing of the model inference per 1000 output tokens. This price is used in Karini AI [Dashboards](/karini-ai-documentation/dashboard-overview.md) to calculate cost. User has the ability to override this price if needed - such as in case of special pricing agreement with the model provider.&#x20;
4. Link to view the the recipes in which the model endpoint is used.&#x20;
5. Link to view the model information including the cost and usage dashboard for the model endpoint.&#x20;

### Model Endpoint Configurations

The following table describes model endpoint configurations for each model provider. It also includes links to model provider reference documentation offering detailed information on model specifications, usage instructions, and API endpoints for effective integration and utilization.

<table><thead><tr><th width="138">Provider</th><th>Model</th><th>Config Parameters</th><th>Reference</th></tr></thead><tbody><tr><td>Amazon Bedrock</td><td>Titan Embeddings G1 - Text</td><td><ol><li><strong>Tokenizer:</strong> cl100k_base</li><li><strong>Embedding Dimensions:</strong> 1536 </li><li><strong>Max Tokens:</strong> 8000</li></ol></td><td><a href="https://docs.aws.amazon.com/bedrock/latest/userguide/model-access.html">https://docs.aws.amazon.com/bedrock/latest/userguide/model-access.html</a><br><br><a href="https://docs.aws.amazon.com/bedrock/latest/userguide/titan-embedding-models.html ">https://docs.aws.amazon.com/bedrock/latest/userguide/titan-embedding-models.html </a></td></tr><tr><td>Amazon Bedrock</td><td>cohere.embed-multilingual-v3</td><td><p></p><ol><li><strong>Tokenizer:</strong> cl100k_base</li><li><strong>Embedding Dimensions:</strong> 1024</li><li><strong>Max Tokens:</strong> 8191</li></ol></td><td><a href="https://docs.aws.amazon.com/bedrock/latest/userguide/model-access.html">https://docs.aws.amazon.com/bedrock/latest/userguide/model-access.html</a><br><br><a href="https://aws.amazon.com/bedrock/cohere-command-embed/">https://aws.amazon.com/bedrock/cohere-command-embed/</a><br></td></tr><tr><td>OpenAI</td><td>Text-Embeddings-3-Small</td><td><ol><li><strong>Tokenizer:</strong> cl100k_base</li><li><strong>Embedding Dimension:</strong> 1536</li><li><strong>Max Tokens:</strong> 8191</li></ol></td><td><a href="https://platform.openai.com/docs/guides/embeddings">https://platform.openai.com/docs/guides</a>/</td></tr><tr><td>OpenAI</td><td>Text-Embeddings-3-Large</td><td><ol><li><strong>Tokenizer:</strong> cl100k_base</li><li><strong>Embedding Dimension:</strong> 3072</li><li><strong>Max Tokens:</strong> 8191</li></ol></td><td><a href="https://platform.openai.com/docs/guides/embeddings">https://platform.openai.com/docs/guides/embeddings</a></td></tr><tr><td>OpenAI</td><td>Text-Embeddings-ADA-002</td><td><ol><li><strong>Tokenizer:</strong> cl100k_base</li><li><strong>Embedding Dimension:</strong> 1536</li><li><strong>Max Tokens:</strong> 8191</li></ol></td><td><a href="https://platform.openai.com/docs/guides/embeddings">https://platform.openai.com/docs/guides/embeddings</a></td></tr><tr><td>Azure OpenAI</td><td>Text-Embeddings-3-Small</td><td><ol><li><strong>Azure OpenAI API Base:</strong> Specific Azure OpenAI API Base URL</li><li><strong>Azure OpenAI Deployment Name:</strong> Name of the deployment resource within  Azure OpenAI service.</li><li><strong>Tokenizer:</strong> cl100k_base</li><li><strong>Embedding Dimension:</strong>1536</li><li><strong>Max Tokens:</strong>8191</li></ol></td><td><a href="https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/models">https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/models</a></td></tr><tr><td>Azure OpenAI</td><td>Text-Embeddings-3-Large</td><td><p></p><p></p><ol><li><strong>Azure OpenAI API Base:</strong> Specific Azure OpenAI API Base URL</li></ol><p></p><ol start="2"><li><strong>Azure OpenAI Deployment Name:</strong> Name of the deployment resource within  Azure OpenAI service.</li></ol><p></p><ol start="3"><li><strong>Tokenizer:</strong> cl100k_base</li></ol><p></p><ol start="4"><li><strong>Embedding Dimension:</strong>1536</li></ol><p></p><ol start="5"><li><strong>Max Tokens:</strong>8191</li></ol></td><td><a href="https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/models">https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/models</a></td></tr><tr><td>Azure OpenAI</td><td>Text-Embeddings-ADA-002</td><td><p></p><ol><li><strong>Azure OpenAI API Base:</strong> Specific Azure OpenAI API Base URL</li></ol><p></p><ol start="2"><li><strong>Azure OpenAI Deployment Name:</strong> Name of the deployment resource within  Azure OpenAI service.</li></ol><p></p><ol start="3"><li><strong>Tokenizer:</strong> cl100k_base</li></ol><p></p><ol start="4"><li><strong>Embedding Dimension:</strong>1536</li></ol><p></p><ol start="5"><li><strong>Max Tokens:</strong>8191</li></ol></td><td><a href="https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/models">https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/models</a></td></tr><tr><td>Databricks</td><td></td><td><ol><li><strong>Tokenizer:</strong> cl100k_base</li><li><strong>Embedding Dimension:</strong> 1024</li><li><strong>Model Id:</strong> Unique Id of the model.</li><li><strong>Model Endpoint Name:</strong> Name of the model endpoint.</li></ol></td><td></td></tr><tr><td>Amazon SageMaker</td><td></td><td><ol><li><strong>Tokenizer:</strong> cl100k_base</li><li><strong>Embedding Dimension:</strong> </li><li><strong>Model Endpoint Name:</strong> Name of the model endpoint</li><li><strong>Max Tokens:</strong> </li></ol></td><td></td></tr></tbody></table>


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter, and the optional `goal` query parameter:

```
GET https://karini-ai.gitbook.io/karini-ai-documentation/model-hub/embeddings-models.md?ask=<question>&goal=<endgoal>
```

`ask` is the immediate question: it should be specific, self-contained, and written in natural language.
`goal` is optional and describes the broader end goal you are ultimately trying to accomplish on behalf of the user. GitBook uses it to tailor the answer towards what is most useful for that goal.

The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.
