Build Applications with Local AI Models on a Mac

Get the eBook free when you register your print book at Manning.

"A goldmine of technical advice, with actionable project ideas and learning resources.”
—C. Scott Anderson, Garmin International

Running AI applications on local hardware unlocks architecturally guaranteed privacy, eliminates costly subscriptions and API fees, and gives you the power to tune your models to your exact needs. In Build Applications with Local AI Models on a Mac, author Keiji Kamigusa guides you step-by-step as you build a voice-enabled chatbot that will run on any recent Mac—from a basic Mac mini to a top-of-the-line Mac Studio. As you set up your custom hardware and software stack, you’ll experience a powerful paradigm shift that turns you from a passive consumer into an AI architect.

The book draws you in immediately with a hands-on project that connects three local technologies: audio capture, speech transcription, and language model inference. You’ll start by building the foundation of your chatbot, including command-line navigation and directory management, setting up Homebrew as your package manager, and downloading your first local large language model. Then, you’ll quickly review the features that make local AI on the Mac special, such as Apple Silicon’s unified memory architecture. You’ll also meet a Mac-optimized software suite that includes the Apple-optimized MLX Whisper speech recognition model that offers 100% offline privacy and an integrated voice AI pipeline that runs natively on M-series chips.

As you go, you’ll explore universal concepts that apply to all AI applications—such as temperature configuration, context windows, and system prompts—and learn how they map to the specific needs of your local Mac environment. The book then guides you through expanding your assistant with Retrieval-Augmented Generation (RAG) and autonomous agents. You will store documents locally in ChromaDB to ground your AI’s responses and prevent hallucinations. You’ll also learn how to use the Python-based Streamlit framework to customize your chatbot’s behavior without writing complex callbacks or HTML.

In later chapters, you’ll discover how self-hosting models on your Mac provide absolute control over your workflows while keeping your infrastructure completely private. You’ll explore the Unsloth-to-Ollama pipeline to fine-tune frontier models on your custom data and how to manage stateless LLMs by implementing explicit history tracking. Reviewer Arun Sivakumar of Expedia Group noted, “The context window and token consumption are valuable details that many LLM users ignore, and concepts like how to fine tune models are highly relevant for day-to-day usage.”

Spanning 18 chapters, this book provides a complete local AI roadmap. As reviewer C. Scott Anderson of Garmin International points out, this book gives you exactly what you need to see how “the benefits of open-source models can eclipse the economic realities of proprietary models.”

What's inside

• Building a fully offline, voice-enabled assistant
• Completing data privacy with no cloud API fees
• Maximizing Apple Silicon hardware
• Custom Modelfiles, RAG, and local AI agent integration

About the reader

Perfect for professionals and hobbyists who want to build secure, private, and free AI applications on macOS. No prior programming or AI experience required.

About the author

Keiji Kamigusa is an authority in AI and machine learning with over 16 years of industry experience. A former CTO of a text mining company, he has created more than 50 courses and taught 59,000+ students. He holds three patents in text analytics and is the founder of AIGYM Inc., specializing in AI-driven corporate training.

Table of Contents

Part 1
1 Getting started with local AI
2 Installing and using Homebrew
3 Installing and setting up Ollama
Part 2
4 Downloading an LLM and having your first conversation
5 Setting up VS Code and your Python development environment
6 Creating and managing Python virtual environments
7 Controlling LLMs with the Ollama Python library
8 Building a web UI with Streamlit
9 Recording audio and transcribing speech with MLX Whisper
10 Building a voice-enabled AI chat application
11 Managing session state and chat history
Part 3
12 Comparing and selecting LLM models
13 System prompts and parameter tuning
14 Offline LLMs and their benefits
15 Common errors and troubleshooting
16 Advancing to RAG, Web UI, and fine-tuning
17 The open model revolution of 2026
18 Where to go from here
A Command reference
B References and additional resources