When it comes to LLMs, most of them require an online connection for access. That is very inconvenient if you don’t want to compromise on privacy or simply are going to spend time off the grid. Here are 3 offline, private LLM apps for Vision Pro or iPhone you shouldn’t miss:
AI on Device: one of the better apps in this category as it runs on all your favorite Apple devices. It offers Siri support. It lets you run Llama, Phi, Mistral, Qwen, and other models locally. You do have the option to access the internet to get the most of these models. This app can read PDFs and images for content extraction.
Enchanted LLM: lets you chat with self-hosted models on your iPhone, Mac, or Vision Pro. It has a simple interface for switching between models. It supports Markdown. It has multimodal support, so you can add images to your conversations.
OfflineLLM: a private AI chartbot for the Vision Pro. It lets you use your voice to enter information. It is completely private, so your privacy won’t be compromised.
Stay tuned as we will cover more offline LLM apps here in the future.