AMD + Xilinx | World record breaking for inference performance for data centers with 32 core EPYC CPUs

The new systems include Xilinx’s new machine learning accelerator cards, called Alveo offers real-time machine learning

AMD and Xilinx partnered to create high-performance inference systems for data centers that Xilinx this week claimed breaks the world record for inference performance. The new systems include Xilinx’s new machine learning accelerator cards, called Alveo, which promise real-time machine learning inference, as well as video processing, genomics and data analytics. They start at $8,995 each, and Xilinx said that it’s now working with OEMs, including Dell EMC, Fujitsu, Hewlett Packard Enterprise and IBM, to qualify them for data centers.

A New Inference World Record In Datacenter And AI

AMD and Xilinx created a new system for data centers that includes a 32-core EPYC 7551 CPU and eight Alveo U250 accelerator cards. The cards will be powered by Xilinx’s ML Suite, which also supports ML software frameworks, such as TensorFlow. After joining Xilinx CEO Victor Peng onstage at a Xilinx event showcasing the new platform made by EPYC cpus, Mark Papermaster, AMD CTO and senior vice president of technology and engineering, said that new workloads can take advantage of the whole system and not just the CPU.

The two companies said that their system reached an inference throughput of 30,000 images per second on the GoogLeNet convolutional neural networks. Such high inference performance is seemingly being requested these days by companies that need to analyze massive amounts of data. Tomshardware reports

Xilinx introduced two new FPGA cards (Alveo U200 and U250), which for the first time are optimized to “accelerate” real-time machine learning inference. The focus here seems to be “real-time” inference because the Alveo cards promise three times lower latency than GPUs with four times the throughput for low-latency applications.

They start at $8,995 each, and Xilinx said that it’s now working with OEMs, including Dell EMC, Fujitsu, Hewlett Packard Enterprise and IBM, to qualify them for data centers.

Source: xilinx 

Tags:

Technology, amd, Xilinx , datacenter, AMD and Xilinx, Alveo, Alveo U200 and U250, amd stock, stock, amd shares, amd price, amd news,Dell EMC, Fujitsu, Hewlett Packard Enterprise, IBM

Mohsen Daemi
Latest posts by Mohsen Daemi (see all)