Skip to content

Embeddings Hardware Recommendations

BAAI/bge-m3 GPU Requirements

Running BAAI/bge-m3 through TEI for Easy8 AI retrieval is supported only on NVIDIA GPU infrastructure.

Minimum supported configuration

Item Requirement
GPU 1 NVIDIA GPU
VRAM 4 GB minimum
Host requirements NVIDIA drivers installed
Container runtime Docker with NVIDIA Container Toolkit configured (for GPU access inside containers)
Deployment mode GPU only

CPU-only deployment is not supported.

Item Recommendation
GPU 1 NVIDIA GPU
VRAM 8 GB or more
Use case Faster indexing and higher throughput

Notes