> For the complete documentation index, see [llms.txt](https://help.zipcaptions.app/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://help.zipcaptions.app/settings/ai-captions.md).

# AI Captions

Zip Captions supports AI Cloud based captions which are more accurate than our regular captioning offering. We are currently using the Azure AI Speech to Text Service from Microsoft.

{% hint style="danger" %}
AI Captions are only available for paying subscribers on Patreon.

Join Zip Captions on Patreon [here](https://patreon.com/zipcaptions).

View the pricing structure for AI Captions [here](https://zipsolutions.org/pricing.html).
{% endhint %}

To get started with AI Captions you must first enable them in the settings.

1. Click on the **three lines**
2. Click on **Settings**
3. Click on the **Engine** option
4. Click on the drop down menu\ <img src="https://1608469805-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FCUIvSrSYUotCp2ajUEtk%2Fuploads%2F6gH8io2PTOkhltZrQyOx%2FScreenshot%202025-02-18%20at%208.44.05%E2%80%AFPM.png?alt=media&amp;token=a1dbcf2e-5831-4f8a-b70f-07206d6a3139" alt="" data-size="original">
5. Choose **Azure Cognitive Services** from the drop down list\
   ![](https://1608469805-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FCUIvSrSYUotCp2ajUEtk%2Fuploads%2FbjJMlDldqT8uTTUlnVle%2FScreenshot%202025-02-18%20at%208.44.41%E2%80%AFPM.png?alt=media\&token=1487ca7a-4309-44cf-958f-dddb3bc373d0)
6. You will see your current balance shown under the description, this is shown in hours and minutes. This is updated live as you use your tokens assigned.
7. You can improve the accuracy of your captioning by choosing a dialect for the chosen language. *(Language dialects are shown based on the language chosen for your interface and captioning language from the* [***Look & Feel***](https://zipcaptions.app/settings?tabIndex=0) *menu)*
8. Click **Save** to enable your captioning engine. The Save button will now be greyed out.\
   ![](https://1608469805-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FCUIvSrSYUotCp2ajUEtk%2Fuploads%2FeES4i2qiHPaXihRJykiW%2FScreenshot%202025-02-18%20at%208.47.35%E2%80%AFPM.png?alt=media\&token=4b20f9f4-8e4a-4683-8342-df078eb45e6c)
9. You will now see the Microphone button has been converted to the AI Microphone\\

   <figure><img src="https://1608469805-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FCUIvSrSYUotCp2ajUEtk%2Fuploads%2FVMMwKsnChRhdMywYDZtw%2FScreenshot%202025-02-18%20at%208.47.51%E2%80%AFPM.png?alt=media&amp;token=e062bd2b-fb3a-4317-964b-a0aa1a48cc10" alt=""><figcaption><p>The microphone button shows the AI stars when the AI engine is enabled</p></figcaption></figure>
10. To switch back to the regular captioning engine, simply choose the **Browser** option from the drop down list and click on **Save**.

{% hint style="info" %}
**Bilingual Speech Recognition & Live Translation**

Certain Azure dialects—including **French (Canada)** (`fr-CA`), **Spanish (United States)** (`es-US`), and 16 **Arabic** dialects—natively recognize **both the selected language and English** within the same session! When combined with [Live Translation](/translation/broadcasting-and-obs-translation.md#bilingual-speech-recognition-with-azure-ai-captions), Zip Captions automatically detects which language was spoken in each phrase and routes it to the matching language pane.
{% endhint %}


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation by asking a question.

Perform an HTTP GET request on the following URL with the `ask` and `goal` query parameters:

```
GET https://help.zipcaptions.app/settings/ai-captions.md?ask=<question>&goal=<user_goal>
```

`ask` is the immediate question: it should be specific, self-contained, and written in natural language.
`goal` is what the user is ultimately trying to achieve, the reason they need the answer. Sharing it helps GitBook give you a better, more relevant answer. A goal is most helpful when it describes the outcome the user wants rather than restating the question. For example, with `ask=how do I create an API token`, a goal like `automate deployments from our CI pipeline` lets GitBook tailor the answer to that use case.

The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.