AI Aulis

AI NEWS IN ENGLISH · 15 November 2026

The most important AI news every morning. AI writes and checks the stories against the original sources – check important facts in the sources.

26 stories · next issue tomorrow morning · How the paper is made →

← Issue 15 November 2026Paper

Canonical’s Inference Manager installs AI models on Ubuntu behind a single interface

AI-generated contentWritten by AI

github.com, heise.de · 2 sources · Sources published: 14 November 2026 · Some source publication dates are unknown

Canonical’s new command-line tool lets users install AI models on Ubuntu and run them on their own machines. Applications reach every model through one local address.

Canonical presented Inference Manager at its own Ubuntu Summit event, the German site heise online reported on 14 November.

Inference Manager is a command-line tool for finding, installing and removing inference snaps. Snap is Ubuntu’s own package format, and an inference snap contains an AI model. Heise reported that the Snap Store offers several such models that run entirely on the user’s device without an internet connection. Canonical’s GitHub documentation says the tool also lists available models and shows the status of services.

Applications reach the installed models through a single local address. An application sends a request to port 8400 on the machine, and Inference Manager passes it to the inference snap running the model. The request names the model in the form provider/model, for example gemma4/gemma4-e4b. Desktop chat assistants, coding agents in editors and speech-to-text programs, for example, can use the same address, heise wrote.

Canonical says the interface is compatible with OpenAI’s API, so existing client programs can connect to it directly. Heise presents the compatibility as Canonical’s claim.

The tool also shows which hardware and software can run each size of a model. Options include the CPU or a GPU from AMD, Intel or Nvidia. In Canonical’s example, all four sizes of Gemma 4 run on the CPU and on AMD and Nvidia GPUs, but only one of them runs on an Intel GPU.

Myna, a dictation program released with the current Ubuntu version 26.10, is built on inference snaps, heise reported. Myna converts speech to text and writes it into any text field.

Canonical plans to build Ubuntu’s AI features on open-weight models that run locally, according to heise. The plans include context-aware help with troubleshooting, speech recognition to improve accessibility and automations based on AI agent workflows. Canonical said the features are meant to arrive as opt-in: users would enable them themselves and could remove them at any time.

Inference Manager is available from the Snap Store and can be installed from the command line or through Ubuntu’s App Center. Installation and usage instructions and the tool’s Go source code are in Canonical’s GitHub repository canonical/inference.

What this is based on

  1. github.com

    Publisher: github.com · source publication time unknown · retrieved 15 November 2026 at 05:36 (UTC+02:00) · discovery channel: GitHub

  2. Inference Manager: neues Ubuntu-Tool verwaltet lokale KI-Modelle

    Publisher: www.heise.de · published 14 November 2026 at 15:46 (UTC+02:00) · retrieved 15 November 2026 at 05:36 (UTC+02:00) · discovery channel: web

Report an error in this story