Embeddings Hardware Recommendations
BAAI/bge-m3 GPU Requirements
Running BAAI/bge-m3 through TEI for Easy8 AI retrieval is supported only on NVIDIA GPU infrastructure.
Minimum supported configuration
| Item | Requirement |
|---|---|
| GPU | 1 NVIDIA GPU |
| VRAM | 4 GB minimum |
| Host requirements | NVIDIA drivers installed |
| Container runtime | Docker with NVIDIA Container Toolkit configured (for GPU access inside containers) |
| Deployment mode | GPU only |
CPU-only deployment is not supported.
Recommended configuration
| Item | Recommendation |
|---|---|
| GPU | 1 NVIDIA GPU |
| VRAM | 8 GB or more |
| Use case | Faster indexing and higher throughput |
Notes
BAAI/bge-m3is served through a TEI endpoint configured byEMBEDDINGS_URL- higher VRAM gives more headroom for larger batches and faster indexing
- use this guidance together with the scenario page for Easy8 AI Knowledge assistant PRO / Easy8 AI Helpdesk - Self-Hosted AI