getting started

Run OCC Node

OCC Node is the local runtime. It runs a small language model on your hardware, retrieves verified knowledge from the server privately, and connects to the broker network. Setup takes a few minutes.

01

Prerequisites

  • Python 3.11 or newer — download and run the installer. On Windows, check Add Python to PATH before clicking Install.
  • Git — download and run the installer, all defaults are fine.
  • Ollama — OCC checks for it automatically and will prompt you if it is missing.
02

Installation

Open a terminal, then clone the repository:

git clone https://github.com/VikFinlay/occ.git
cd occ

Then run the setup script for your platform:

Windows

start.bat

macOS / Linux

./start.sh

The script walks you through setup step by step — it checks all requirements, installs dependencies, and launches OCC automatically. At the end, it creates an OCC Node shortcut on your desktop so future launches require no terminal at all.

03

First launch

On the first run, OCC detects your available VRAM and downloads the appropriate model automatically. The table below shows which model you will get. This download only happens once — subsequent launches start in seconds.

TierVRAMModelQuantSize
MicroCPUqwen3.5:2bQ4_K_M
Small4 GBqwen3.5:4bQ4_K_M3.4 GB
Mid8 GBqwen3.5:9bQ4_K_M5.97 GB
Large16 GBqwen3.5:9bQ8_09.53 GB
XL24 GBqwen3.5:9bBF1619 GB
Server S32 GBqwen3.6:27bQ4_K_M16.8 GB
Server L80 GBqwen3.6:27bBF1656 GB

All tiers use the Qwen family with adaptive context optimised for your hardware, and support multimodal input. Learn more →

04

Launching OCC

Double-click the OCC Node icon on your desktop. The server starts and OCC opens in your browser automatically — no terminal needed.

Manual fallback

If the shortcut does not work, open a terminal in the OCC folder and run:

python node/apps/gui/server.py

Then open http://localhost:7891 in your browser.

05

Updating

Inside OCC Node, open Settings and click Update to Latest. OCC will pull the newest version, reinstall dependencies, and restart automatically.

Manual fallback

If the button does not work, open a terminal in the OCC folder and run:

git pull
06

Commands

/clear

Clear conversation history and reset context

! <query>

Force network mode — consult peers regardless of local knowledge

/packs

List all loaded packs and domains

/peers

Show active peer nodes on the broker

/status

Show current config

/local on

Use local packs only — for private Forge packs

/local off

Use server packs (default)

/unload

Unload model from VRAM

/load

Reload model into VRAM

/openrouter on

Switch to OpenRouter (if configured)

/openrouter off

Switch to local model

Need help?

Open an issue on GitHub or start a discussion in the repository.