Xinference v2.10.0 Release Notes

✦ Highlights

🔐

Enterprise Auth & Security

OIDC / Keycloak SSO
IP & API Key Banning
Rate Limiting
Audit Logging
API Key Description & Status

⚠️ Disabled by default in v2.10.0; will be default-enabled in v3.0.

📊

Observability

Per-model GPU memory metrics
Grafana GPU Dashboard
Security Audit Dashboard
Filebeat config examples
Structured JSON logging

⚠️ Grafana/Filebeat require self-deployment.

⚠️ JSON logs via XINFERENCE_LOG_FORMAT=json.

🎨

New Web UI

Redesigned model registration & launch
Cache management & env variables UI
Optimized menu structure
Updated sidebar, logo & favicon
Server-side launch history

Continuously evolving

Community

🌐 Community Edition

New features, enhancements, and fixes available to everyone.

✨ New Features

OIDC / Keycloak SSO login support
IP address and API Key banning
Request rate limiting protection
Comprehensive audit logging system
API Key description field and status display
Server-side model launch configuration history
Three-level progress display for download logs
New UI continuous improvements

📊 Observability Enhancements

Per-model GPU memory usage metrics
Grafana Dashboard with GPU memory monitoring panel
New security audit Dashboard
Filebeat configuration integration
Inference logs in structured JSON format

🛠 Enhancements

Menu structure and i18n optimization
API Key editing supports modifying name and description
ChatTTS loading security enhancement
Continuous model config updates (Qwen3.6, ChatTTS, etc.)

🐞 Bug Fixes

Fixed FP8 model quantization parameters in vLLM
Fixed expired / disabled API Key error messages
Fixed GPU monitoring collection issues
Fixed jina-embeddings-v2-base-zh deployment dependency
Fixed vLLM LoRA request path compatibility
Fixed llama.cpp streaming tool call boundary issue
Fixed DGX Spark / GB10 GPU information detection
Fixed concurrent model launch causing heartbeat timeout
Fixed virtualenv CUDA version detection and override logic

📚 Documentation

Added v2.9.0 release notes
New AI Agent development guide
Removed WeChat QR code links from documentation

Enterprise

🏢 Enterprise Edition

Stability, security, and reliability improvements for production deployments.

🛡

Stability & Security Fixes

Numerous stability and security patches for enterprise-grade reliability.

🔧

Enterprise Deployment

Improved reliability and maintainability in production environments.

📦 Installation