| Spotting | Detect and recognize text in the image, and output the text coordinates in a formatted manner. | 检测并识别图片中的文字，将文本坐标格式化输出。|
| Parsing | 1. Identify the formula in the image and represent it using LaTeX format. <br> 2.Parse the table in the image into HTML. <br> 3. Parse the chart in the image; use Mermaid format for flowcharts and Markdown for other charts. <br> 4.Extract all information from the main body of the document image and represent it in markdown format, ignoring headers and footers. Tables should be expressed in HTML format, formulas in the document should be represented using LaTeX format, and the parsing should be organized according to the reading order. | 1. 识别图片中的公式，用 LaTeX 格式表示。 <br> 2. 把图中的表格解析为 HTML。 <br> 3. 解析图中的图表，对于流程图使用 Mermaid 格式表示，其他图表使用 Markdown 格式表示。 <br> 4. 提取文档图片中正文的所有信息用 markdown 格式表示，其中页眉、页脚部分忽略，表格用 html 格式表达，文档中公式用 latex 格式表示，按照阅读顺序组织进行解析。 |
| Information Extraction | 1. Output the value of Key. <br> 2. Extract the content of the fields: ['key1','key2', ...] from the image and return it in JSON format. <br> 3. Extract the subtitles from the image. | 1. 输出 Key 的值。 <br> 2. 提取图片中的: ['key1','key2', ...] 的字段内容，并按照 JSON 格式返回。 <br> 3. 提取图片中的字幕。 |
| Translation | First extract the text, then translate the text content into English. If it is a document, ignore the header and footer. Formulas should be represented in LaTeX format, and tables should be represented in HTML format. | 先提取文字，再将文字内容翻译为英文。若是文档，则其中页眉、页脚忽略。公式用latex格式表示，表格用html格式表示。 |
Here is the continuation for the English [model-card.md](file:///home/jhq/rust_code/aha/docs/model-card.md) file, translating and adapting the content from the Chinese version regarding VoxCPM models.
# TTS
## VoxCPM (0.5B / 1.5)
#### Mode Description
***Zero-shot TTS (Default)**: Generates speech directly without reference audio.
***Voice Cloning**: Requires reference audio (`audio_url`) and its corresponding transcript (`prompt_text`).
***Note**: For versions 0.5B/1.5, if `audio_url` is provided, `prompt_text`**must** be provided in `metadata`. Conversely, if there is no `audio_url`, `prompt_text` should not be provided.
#### Metadata Parameters
| Parameter | Type | Required | Description |
| :--- | :--- | :--- | :--- |
| `prompt_text` | String | Conditional | **Required for Cloning**. The transcript of the reference audio. Used to extract speaker characteristics. |
***Metadata**: Optional `control_instruction` to adjust style (emotion, pace, etc.). **`prompt_text` is NOT required.**
#### Example:
```json
{
"model":"OpenBMB/VoxCPM2",
"messages":[
{
"role":"user",
"content":[
{
"type":"audio",
"audio_url":{
"url":"https://example.com/short_clip.wav"
}
},
{
"type":"text",
"text":"This news broadcast needs to be more serious and calm."
}
]
}
],
"metadata":{
"control_instruction":"serious, slow pace"
}
}
```
### 3. Ultimate Cloning
Provide reference audio and its verbatim transcript for audio-continuation cloning or high-fidelity cloning. Every vocal nuance is faithfully reproduced.
***Metadata**: **Must** provide `prompt_text` (accurate transcript of the reference audio).
#### Example:
```json
{
"model":"OpenBMB/VoxCPM2",
"messages":[
{
"role":"user",
"content":[
{
"type":"audio",
"audio_url":{
"url":"https://example.com/reference.wav"
}
},
{
"type":"text",
"text":"This is the new content to be spoken next."
}
]
}
],
"metadata":{
"prompt_text":"This is the actual text spoken in the reference audio."
}
}
```
#### General Metadata Parameters (Applicable to all VoxCPM2 modes)
| Parameter | Type | Required | Description |
| :--- | :--- | :--- | :--- |
| `prompt_text` | String | Ultimate Cloning Only | Verbatim transcript of the reference audio. Required only for Ultimate Cloning mode. |
| `control_instruction` | String | No | Natural language instruction to control style for Voice Design or Controllable Cloning (e.g., "angry", "whispering", "fast"). |
