Improve AI accelerator performance with AMD EPYC™ AI host processors

Post Content

​ AMD EPYC 9575F is the highest performance CPU for hosting AI accelerators:
~1.24x the total token throughput performance on Mixtral 8x7B
~1.10x the total token throughput performance on Llama4-Maverick-17B-128E-FP8
~1.05x the AI inference throughput performance on Deepseek-R1-SGLang

vs Intel® Xeon® 8592+ both running with 8x AMD Instinct(tm) MI300X GPUs

Discover more: https://www.amd.com/en/products/processors/server/epyc/9005-series/demos.html

***

Subscribe: https://bit.ly/Subscribe_to_AMD
Join the AMD Red Team Discord Server: https://discord.gg/amd-gaming
Like us on Facebook: https://bit.ly/AMD_on_Facebook
Follow us on Twitter: https://bit.ly/AMD_On_Twitter
Follow us on Twitch: https://Twitch.tv/AMD
Follow us on LinkedIn: https://bit.ly/AMD_on_Linkedin
Follow us on Instagram: https://bit.ly/AMD_on_Instagram

©2025 Advanced Micro Devices, Inc. AMD, the AMD Arrow Logo, and combinations thereof are trademarks of Advanced Micro Devices, Inc. in the United States and other jurisdictions. Other names are for informational purposes only and may be trademarks of their respective owners.   Read More AMD