Run LLMs on macOS using llm-mlx and Apple’s MLX framework
llm-mlx is a brand new plugin for the LLM Python Library and CLI utility which builds on top of Apple’s excellent MLX array framework library and mlx-lm package. If you’re a terminal user or Python developer with a Mac this may be the new easiest way to start exploring local Large Language Models.