Skip to main content

Third-Party Models, Runtimes, and Licenses

Phlox bundles inference runtimes and downloads a number of third-party models whose licenses require attribution. Models are not bundled in the app artifacts — they are downloaded on demand from HuggingFace on first use (the speaker embedding model below is the exception: it is fetched at build time from its GitHub release).

Large Language Models​

Qwen3.5 (0.8B / 2B / 4B / 9B / 27B / 35B-A3B — Q4_K_M GGUF)​

  • Creator: Qwen Team at Alibaba Cloud; GGUF quantizations by Unsloth.
  • Source: https://huggingface.co/unsloth/Qwen3.5-*-GGUF
  • Quantization: Q4_K_M.
  • Vision projector: each download also fetches an mmproj-BF16.gguf multimodal projector from the same repo, which enables vision when loaded into the LLM server.
  • License: Apache-2.0.

Qwen3-Embedding-0.6B (Q8_0 GGUF)​

Omi Med STT v1 (q8_0 GGUF)​

CAM++ Speaker Embedding (3D-Speaker, ONNX)​

Bundled Inference Runtimes (desktop)​

parakeet.cpp (patched)​

  • Authors: Ettore Di Giacinto (@mudler), Richard Palethorpe; the LocalAI team.
  • Source: https://github.com/mudler/parakeet.cpp
  • License: MIT.
  • The bundled phlox-whisper-server is parakeet.cpp with an in-house patch (parakeet-cpp-omi-adapter.patch) that adds the Omi Med STT adapter, derived from the MIT-licensed omi-med-stt-runtime reference.

llama.cpp​

  • Source: https://github.com/ggml-org/llama.cpp
  • License: MIT.
  • Phlox runs two llama.cpp server processes on desktop: one for the LLM (with optional vision projector) and one in --embedding mode for embeddings.

System Components​

TEN VAD (WebAssembly)​

SQLCipher​

Tesseract OCR (Docker only)​

  • Source: https://github.com/tesseract-ocr/tesseract
  • License: Apache-2.0.
  • Docker-only: Tesseract is installed in the Docker image (via apt, used through pytesseract). The desktop (macOS) and Flatpak (Linux) builds do not bundle Tesseract — the OCR fallback path is unavailable there, and document processing relies on text-layer extraction or vision instead.

Notable Dependencies​

The following Apache-2.0 / copyleft dependencies are used by Phlox. Each retains its original license and copyright notices.

Python:

  • openai — Apache-2.0
  • mcp — MIT
  • pytesseract — Apache-2.0 (Docker only)
  • pypdf — BSD-3-Clause
  • sherpa-onnx — Apache-2.0 (ONNX Runtime speech stack; runs the CAM++ speaker embedding model above on CPU)

JavaScript:

The complete list of Python dependencies with resolved licenses is in server/uv.lock. The complete list of JavaScript dependencies is in package-lock.json. All third-party packages retain their original licenses and copyright notices.