All runbooks
runbookuapiredacted view

UAPI Grok Adjacent Product Fork/Borrow Review 2026-06-22

Grok adjacent product review for Intel AI Playground, IPEX-LLM, OpenArc, NoLlama, llama.cpp OpenVINO, and archived NPU library.

Updated 2026-06-22·Freshness: Reference·Sensitive tokens or credentials were hidden before display.

UAPI Grok Adjacent Product Fork/Borrow Review 2026-06-22

Grok adjacent product review for Intel AI Playground, IPEX-LLM, OpenArc, NoLlama, llama.cpp OpenVINO, and archived NPU library.

Promotion Metadata

  • Source feedback id: 113
  • Source feedback ids: 113
  • Promotion request id: 44
  • Feedback category: beneficial
  • Feedback source: [REDACTED:high-entropy]
  • Feedback created at: 2026-06-22T18:22:35.047494+00:00
  • Target slug: [REDACTED:high-entropy]
  • Review state: review
  • Reviewer note: AI lane auto-promoted redacted feedback into internal catalog context.

Source Feedback Body

Feedback 113

  • Product: uapi
  • Category: beneficial
  • Related slug: [REDACTED:high-entropy]
  • Source: [REDACTED:high-entropy]
  • Created at: 2026-06-22T18:22:35.047494+00:00

Grok Adjacent Product Fork-Borrow Review (2026-06-22)

ALIVE: true
Lane: Grok / UAPI hardware autorouter
Sources: local preflight/inventory/route docs (2026-06-22-*.md + agent-work-queue-v0.md); public primary GitHub only for listed items. No recommendations.

Items Reviewed (no fork/import advice)

Intel AI Playground

  • Repo: https://github.com/intel/AI-Playground (MIT license confirmed).
  • Description: Electron Windows app + installer for local GenAI on Arc GPU (chat, images, code, document). Releases available (v3.x alpha/beta).
  • Fit notes: Targets Arc iGPU/dGPU users; easy onboarding. Not a low-level stack or server lib. Windows-focused (Linux issues reported).
  • Status: Intel-maintained with releases; source open.

IPEX-LLM

  • Repo: https://github.com/intel/ipex-llm (ARCHIVED 2026-01-28, read-only).
  • Notes: LLM accel for Intel GPU/NPU/CPU; supported Gemma, llama.cpp/Ollama portable zips, NPU quickstarts. Had Windows NPU support.
  • Critical: Archive banner: "Intel will not provide... support... maintenance... This project has been identified as having known security issues." No patches accepted.
  • Do not borrow code or assume ongoing NPU/GPU paths.

OpenArc

  • Repo: https://github.com/SearchSavior/OpenArc (Apache-2.0).
  • Description: Community inference server for Intel devices using OpenVINO. Serves LLMs/VLMs/Whisper etc over OpenAI compat endpoints. Claims NPU device support.
  • Fit notes: Server layer on top of OpenVINO (aligns primary). Not Intel official. Small repo.

NoLlama

  • Repo: https://github.com/aweussom/NoLlama.
  • Description: Ollama/OpenAI-compatible API server targeting Intel OpenVINO (NPU + ARC iGPU + discrete + CPU). Auto hardware detect.
  • Fit notes: Compatibility shim. Community. Depends on OpenVINO stack underneath.

llama.cpp Intel/OpenVINO/NPU discussion

  • Upstream: https://github.com/ggml-org/llama.cpp (docs/backend/OPENVINO.md).
  • Confirmed: OpenVINO backend merged; enables GGUF models on Intel CPU/GPU/NPU without model changes. Validated on Core Ultra Series 1/2 AI PCs.
  • Related: Prior IPEX-LLM provided portable zips for NPU llama.cpp (archived now).
  • Status: Active upstream support path. Primary alternative to pure GenAI for GGUF users.

Archived Intel NPU Acceleration Library

  • Repo: https://github.[REDACTED:high-entropy] (ARCHIVED 2025-04-24).
  • Notes: Python lib for direct NPU (MatMul, torch.compile hooks, TinyLlama example). "PROJECT NOT UNDER ACTIVE MANAGEMENT. Intel has ceased development..."
  • Explicit note in README: "For performant production ready solutions please refer to ... OpenVINO".
  • No maintenance; avoid.

Summary Constraints

  • No fork, import, or dependency recommendation for any adjacent item until license audit, maintenance status, security review (esp. IPEX-LLM flagged), and exact fit vs primary OpenVINO GenAI are completed by authorized parties.
  • Primary stack remains OpenVINO GenAI per lane guidance.
  • Community shims (OpenArc, NoLlama) and upstream llama.cpp OpenVINO backend are observable only; integration requires gate + contracts.
  • All items surface NPU/Arc paths but none replace need for benchmark evidence on target NUC.

Blockers: security/maintenance checks incomplete; no operator/Codex approval for any borrow; preflight shows zero AI packages present.

Sources: exact cited public GitHub repos + local sanitized evidence only. No broad local dirs.

End. Constraints met. No actions taken.