Description of the offer

The Wallaroo.AI Inference Server Free Edition gives you an efficient, easy and flexible method to deploy and serve models for common AI use cases such as computer vision (CV) and Large Language Models (LLMs) with optimal performance and utilization on the infrastructure of your choice across the following architectures: x86, x64, ARM64, GPU.

The Wallaroo.AI inference server features the following capabilities:

• Rust-lang-based performance for model and data processing (batch and realtime)
• Support for common Machine Learning/Deep Learning runtimes and pipelines - TensorFlow, ONNX, PyTorch, HuggingFace, scikit-learn, XGBoost etc.
• Support for common hardware architectures and accelerators for AI: GPU, x86, x64, ARM, Ampere AIO
• Configurable Inference serving endpoints for MLOps with performance metrics

Type of User that Benefits from the offer

• Data scientists
• Machine learning engineers
• MLOps Engineers

Customer need or pain that the offer addresses.

• Our customers report up to
• 4 - 6x Quicker Time to production
• Up to 6x Faster Inference
• Up to 80% compute utilization efficiency

Want to learn more about deploying models in Wallaroo? You can download Wallaroo Community Edition for free at https://portal.wallaroo.community To learn more about how Wallaroo.AI can accelerate your AI deployments, please contact community@wallaroo.ai