Deploying LLMs locally with Apple’s MLX framework

A technical deep dive into the new deep learning library MLX

Heiko Hotz
Towards Data Science
9 min readJan 20, 2024

--

Image by author (using DALL-E 3)

What is this about?

In December 2023, Apple released their new MLX deep learning framework, an array framework for machine learning on Apple silicon, developed by their machine learning research team. This tutorial will explore the framework…

--

--