QuickAI

Run AI models on your own computer. Chat, code, pictures and video, private by default.

QuickAI's window running Bonsai 8B: the menu bar, the toolbar with Start, Stop, Open Chat UI and Connect an app, the models in a list on the left, the chosen model with its tags, the server's options, the log, and the status bar saying Running.QuickAI's window running Bonsai 8B: the menu bar, the toolbar with Start, Stop, Open Chat UI and Connect an app, the models in a list on the left, the chosen model with its tags, the server's options, the log, and the status bar saying Running.

Download QuickAI 0.1.0

Each package carries QuickAI, llama.cpp and the two Bonsai models, so there is nothing to install first.

ForFileSizeSHA-256
Windows 10 and 11quickai-0.1.0-windows-x86_64.zip1.43 GBcbb7a678d9d1a18330fc81dcfa78099a594bb59b25e2d549159448b3be516415
macOS 13.3 and later, Apple silicon and Intelquickai-0.1.0-macos-universal.dmg1.44 GB40b80747dbaf53148875cf17f8d3d6ed42cce2762d9ff1a527942c881439fb5f
Linux (AppImage)quickai-0.1.0-x86_64.AppImage1.43 GBd0285edbaf49886e67aad913e56519421591da35001deb485830408c3423b7b1
Linux (tar.gz)quickai-0.1.0-linux-x86_64.tar.gz1.43 GB36c8e196a05336c0a4c52b061f37ca0f395f95b918e2778a8d9b2c254fdac982

macOS

Drag QuickAI to Applications. It is not notarized by Apple yet, so the first time macOS says it cannot check it: choose Done, then press Open Anyway in System Settings, Privacy & Security. It asks once.

Windows

Unzip it and run quickai.exe. Windows may say it protected your PC, as it does for apps without a paid certificate: choose More info, then Run anyway.

Linux

Make the AppImage executable (chmod +x) and run it, or unpack the tar.gz and run ./quickai in its folder.

For servers: quickai-run, without a window

ForFileSizeSHA-256
Linux servers (x86_64)quickai-run-0.1.0-linux-x86_64.tar.gz4.6 MBd38fc2af98c6f83c92736e7018fea34dd668eab45c3239374e550b124746d8f2
Macs (Apple silicon and Intel)quickai-run-0.1.0-macos-universal.tar.gz8.4 MB0166a3415587b5ffb2b10ccb04a642d37ee00d71236f853d560de50bcce06997

Why QuickAI

  • Private by default

    Models run on your computer, and the servers QuickAI starts listen on 127.0.0.1 only. No telemetry, no account, no update checks.

  • Works out of the box

    It comes with llama.cpp and two 1-bit Bonsai models (1.1 GB and 0.25 GB), so your first chat needs no download at all.

  • Runs on ordinary hardware

    GPU acceleration through Vulkan on AMD, NVIDIA and Intel, and Metal on Apple silicon. QuickAI suggests a model that fits your memory and estimates its speed before you start it.

  • 80+ recommended models

    For chat, reasoning, code, vision, reading documents, speech, translation and search. Every file is checked against its SHA-256 as it arrives.

  • Works with your other apps

    An OpenAI-compatible API on your own machine, for editors, scripts and chat clients. The Live tab shows what each app asks, as it happens.

  • Setups you can share

    Save an engine, a model and its settings as one small file and give it to someone else. Local paths and secrets are never in it.

Four engines, one window

Every engine QuickAI installs lives in its own folder under ~/.quickai, listens on 127.0.0.1 only and has its own calls home switched off.

EngineForHow you get it
llama.cppChat, code, vision and embeddings, with any GGUF modelBuilt in
OllamaThe Ollama model libraryDownloaded when you ask, and checked
ComfyUIPictures and video from workflows (LTX-Video, Wan 2.2 and more)Installed when you ask, in a folder of its own, with ComfyUI-Manager unless you untick it
Open WebUIA full chat page for OllamaInstalled when you ask; offline by default

For your apps, and for your servers

An API on your own machine

While a model runs, any client that takes a custom OpenAI base URL works with it.

curl http://127.0.0.1:8080/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{"messages": [{"role": "user",
       "content": "Hello!"}]}'

quickai-run, without a window

Takes a configuration made in the app, installs what it needs, fetches the models and starts it on a server.

quickai-run check vision-chat.toml
quickai-run up    vision-chat.toml

Requirements, privacy and license

What it needs

  • Windows 10 or 11, macOS 13.3 or later (Apple silicon or Intel), or Linux with glibc 2.34+ (Ubuntu 22.04 and later)
  • About 1.5 GB of disk with its two models
  • A graphics card is optional

What it sends

  • Nothing, until you search for or download a model or an engine
  • ComfyUI's Manager, if you keep it, fetches its lists when ComfyUI starts
  • No telemetry, analytics or crash reports
  • Every host it can contact, and why

What it costs

  • Nothing for personal and other noncommercial use
  • A commercial license for use in or for a business
  • How the license works

Hear about new versions

One email when QuickAI 0.1.0 is released. Nothing else, and your address is never shared.

Tell me when

One email per product, when it's ready. No newsletter. What we keep.