Models and runtimes
``MLXLLM``
MLXLLM Example implementations of various Large Language Models (LLMs). Other MLX Libraries Packages MLXEmbedders MLXLLM MLXLMCommon MLXMNIST MLXVLM StableDiffusion Quick Start See . Using LLMs and VLMs is as easy as this: More advanced API
MLXLLM
Example implementations of various Large Language Models (LLMs).
Other MLX Libraries Packages
Quick Start
See doc:evaluation.
Using LLMs and VLMs is as easy as this:
let model = try await loadModel(id: "mlx-community/Qwen3-4B-4bit")
let session = ChatSession(model)
print(try await session.respond(to: "What are two things to see in San Francisco?")
print(try await session.respond(to: "How about a great place to eat?")
More advanced APIs are available for those that need them, see doc:using-model.
Topics
Models
CohereModelGemmaModelGemma2ModelInternLM2ModelLlamaModelOpenELMModelPhiModelPhi3ModelPhiMoEModelQwen2ModelQwen3ModelStarcoder2ModelMiMoModelGLM4ModelAceReason