添加 All-MiniLM-L6-v2-Embedding 模型

This commit is contained in:
273265088@qq.com
2026-03-26 13:40:24 +08:00
parent a74b67c93f
commit b6b970fd25
16 changed files with 1670 additions and 10 deletions
+10
View File
@@ -97,6 +97,15 @@ aha -m qwen3asr-0.6b
# Run inference directly (without starting service)
aha run -m qwen3asr-0.6b -i "audio.wav"
# Run local all-MiniLM-L6-v2 embedding (native safetensors)
aha run -m all-minilm-l6-v2 -i "Rust embedding test" --weight-path D:\model_download\all-MiniLM-L6-v2
# Run local all-MiniLM-L6-v2 embedding (GGUF)
aha run -m all-minilm-l6-v2 -i "Rust embedding test" --artifact-format gguf --gguf-path D:\model_download\All-MiniLM-L6-v2-Embedding-GGUF --tokenizer-dir D:\model_download\all-MiniLM-L6-v2
# Run local all-MiniLM-L6-v2 embedding (ONNX)
aha run -m all-minilm-l6-v2 -i "Rust embedding test" --artifact-format onnx --onnx-path D:\model_download\all-MiniLM-L6-v2\onnx --tokenizer-dir D:\model_download\all-MiniLM-L6-v2
# Start service only (model already downloaded)
aha serv -m qwen3asr-0.6b -p 10100
@@ -126,6 +135,7 @@ curl http://localhost:10100/chat/completions \
| Category | Models |
|----------|--------|
| **Text** | Qwen3, MiniCPM4 |
| **Embedding** | Qwen3-Embedding, all-MiniLM-L6-v2 |
| **Vision** | Qwen2.5-VL, Qwen3-VL |
| **OCR** | DeepSeek-OCR, Hunyuan-OCR, PaddleOCR-VL |
| **ASR** | GLM-ASR-Nano, Fun-ASR-Nano, Qwen3-ASR |