Juice performance A100 Bare metal

Explore groundbreaking GPU-over-IP technology and exceptional benchmarks for models like BERT, ResNet, YOLO, and LLaMa showcasing near-native performance, over standard network. Optimize your infrastructure without compromising on performance. 

As artificial intelligence, machine learning, and high-performance computing continue to accelerate at a breathtaking pace, a flexible, efficient, and optimized IT infrastructure becomes even more paramount. Enter Juice. Our groundbreaking, proprietary technology enables GPU-over-IP, delivering unprecedented composability in server infrastructure and optimizing resource utilization in ways never before possible.

Today, we're excited to share some exceptional performance benchmarks for Juice across several pivotal models such as BERT, ResNet, YOLO, and LLaMa. These tests were conducted over standard network infrastructure, demonstrating the versatility of Juice under regular operating conditions.

BERT, a cornerstone model in machine learning, shows impressive near-native performance with Juice. For example, in FP32 mode with a batch size of 28 and sequence length of 384, Juice on an NVIDIA A100 GPU delivers a robust 96% of the local PCIe setup performance. Meanwhile, in FP16 mode, a batch size of 160 and sequence length of 384 maintains 97% of PCIe performance.

For the popular real-time object detection model YOLO, Juice on an A100 boasts 98% of the native PCIe performance in both FP32 mode with a batch size of 80 and sequence length of 512, and in FP16 mode with a batch size of 160 and sequence length of 512.

On LLaMa, a cutting-edge language model, Juice excels. The A100 under Juice attains 98% of the performance of the local PCIe setup in both FP32 and FP16 modes with a batch size of 16 and sequence length of 128.

In the context of the widely-used ResNet model in FP32 mode with a batch size of 360, Juice on an A100 GPU delivers 95% of the local PCIe performance. This impressive statistic ensures swift and accurate image recognition tasks that are vital across a wide array of sectors.

Here's a breakdown of our results:

These results reinforce that with Juice, you're able to optimize your infrastructure without compromising on performance, all while delivering the agility demanded in today's rapidly evolving technological landscape. Whether you're an IT manager or a systems architect, Juice provides the flexibility and performance you need. The future of GPU infrastructure is here, and it's powered by Juice.

‍