Loading…
Attending this event?
June 19-20, 2024
Paris, France
View More Details & Registration
Note: The schedule is subject to change.

The Sched app allows you to build your schedule but is not a substitute for your event registration. You must be registered for AI_dev Europe to participate in the sessions. If you have not registered but would like to join us, please go to the event registration page to purchase a registration.

This schedule is automatically displayed in CEST (Central European Summer Time) UTC/GMT +2 hours. To see the schedule in your preferred timezone, please select from the drop-down menu to the right, above "Filter by Date."

IMPORTANT NOTE: Timing of sessions and room locations are subject to change.

Back To Schedule
Wednesday, June 19 • 17:05 - 17:35
Moxin: The All-In-One Tool to Run LLMs on Your Personal Device - Michael Yuan, Second State

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Tweet Share
Moxin is a new and fast growing open-source project to run Large Language Models (LLMs) on your personal computers. It has a Rust-based GUI for rich interactions from LLM model exploration, selection, to chatting. Using the Rust in-process messaging channels, it has a backend service that runs LLM apps, and respond to user messages. The backend service is based on the WasmEdge Runtime, which enables the application to take advantage of a variety of the different GPUs or other accelerators that might be available on the device. In addition, the team has also built an LLM database that provides up-to-date meta-data and benchmark results services to all open-source LLM models on Hugging Face.

In this talk, we will showcase the Moxin app and discuss the design decisions behind it. The application offers a template and a component library for Rust developers to create their own cross-platform LLM applications. Developer will learn how to build rich UI applications, and LLM services in Rust.
Speakers
avatar for Michael Yuan

Michael Yuan

Maintainer, CNCF WasmEdge and CEO, Second State
Dr. Michael Yuan is a maintainer of WasmEdge Runtime (a project under CNCF) and a co-founder of Second State. He is the author of 5 books on software engineering published by Addison-Wesley, Prentice-Hall, and O'Reilly. Michael is a long-time open-source developer and contributor... Read More →

Wednesday June 19, 2024 17:05 - 17:35 CEST
Jussieu (Level 3)
  AI in Action
Feedback form isn't open yet.