添加 All-MiniLM-L6-v2-Embedding 模型
This commit is contained in:
@@ -97,6 +97,15 @@ aha -m qwen3asr-0.6b
|
||||
# Run inference directly (without starting service)
|
||||
aha run -m qwen3asr-0.6b -i "audio.wav"
|
||||
|
||||
# Run local all-MiniLM-L6-v2 embedding (native safetensors)
|
||||
aha run -m all-minilm-l6-v2 -i "Rust embedding test" --weight-path D:\model_download\all-MiniLM-L6-v2
|
||||
|
||||
# Run local all-MiniLM-L6-v2 embedding (GGUF)
|
||||
aha run -m all-minilm-l6-v2 -i "Rust embedding test" --artifact-format gguf --gguf-path D:\model_download\All-MiniLM-L6-v2-Embedding-GGUF --tokenizer-dir D:\model_download\all-MiniLM-L6-v2
|
||||
|
||||
# Run local all-MiniLM-L6-v2 embedding (ONNX)
|
||||
aha run -m all-minilm-l6-v2 -i "Rust embedding test" --artifact-format onnx --onnx-path D:\model_download\all-MiniLM-L6-v2\onnx --tokenizer-dir D:\model_download\all-MiniLM-L6-v2
|
||||
|
||||
# Start service only (model already downloaded)
|
||||
aha serv -m qwen3asr-0.6b -p 10100
|
||||
|
||||
@@ -126,6 +135,7 @@ curl http://localhost:10100/chat/completions \
|
||||
| Category | Models |
|
||||
|----------|--------|
|
||||
| **Text** | Qwen3, MiniCPM4 |
|
||||
| **Embedding** | Qwen3-Embedding, all-MiniLM-L6-v2 |
|
||||
| **Vision** | Qwen2.5-VL, Qwen3-VL |
|
||||
| **OCR** | DeepSeek-OCR, Hunyuan-OCR, PaddleOCR-VL |
|
||||
| **ASR** | GLM-ASR-Nano, Fun-ASR-Nano, Qwen3-ASR |
|
||||
|
||||
Reference in New Issue
Block a user