Loading…
Attending this event?
June 19-20, 2024
Paris, France
View More Details & Registration
Note: The schedule is subject to change.

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for AI_dev Europe to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

This schedule is automatically displayed in CEST (Central European Summer Time) UTC/GMT +2 hours. To see the schedule in your preferred timezone, please select from the drop-down menu to the right, above "Filter by Date."

IMPORTANT NOTE: Timing of sessions and room locations are subject to change.

Back To Schedule
Wednesday, June 19 • 11:20 - 11:50
Powering Your Generative AI Workloads with AMD and Open-Source ROCm - Farshad Ghodsian, Sourced Group

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
In the generative AI ecosystem today, there is a strong emphasis on expensive AI hardware and proprietary CUDA implementations. While CUDA has undeniably played a crucial role in the success of generative AI, I’d like to share my experience with running generative AI workloads and applications on cost-effective AMD hardware and the open-source ROCm software stack. This alternative approach aims to provide users with greater flexibility and options, allowing them to apply their generative AI solutions across a wider range of hardware and software choices than ever before. Learn how to run your favourite open source large language and image generation models using ROCm, how far ROCm has come from previous versions and what features are currently supported, including PyTorch support, Optimum-AMD, Flash Attention 2, GPTQ and vLLM and how more affordable workstation class AMD GPUs compare to their Nvidia counterparts in terms of performance and inference speed. You will also see several demos of ROCm in action and some tips and things to watch out for when working with AMD GPUs.
Speakers
avatar for Farshad Ghodsian

Farshad Ghodsian

Lead Consultant, Data and AI, Sourced Group
Farshad is a Lead Consultant at Sourced Group, an Amdocs company. He specializes in helping large enterprises build out Data and ML Platforms in the Cloud. He is currently leading efforts to develop an end-to-end MLOps platform running on Kubeflow and other open-sourced software... Read More →

Wednesday June 19, 2024 11:20 - 11:50 CEST
Monge (Level 3)
  AI Systems & Performance
Feedback form isn't open yet.